feat(v1): CSR-backed sparse groupby-sum - skew-independent build memory (6-9x on the #745 hub case) - #870

Draft

FBumann wants to merge 102 commits into

feat/v1-sparse-groupby

Commits on May 21, 2026

docs: add arithmetic-convention goals

FBumann
and
claude
committed
c854b5d
docs: add convention.md placeholder

FBumann
and
claude
committed
1e336a4
docs: write the v1 arithmetic convention spec

FBumann
and
claude
committed
93193d7
docs: drop the narrow "arithmetic" framing from the spec

FBumann
and
claude
committed
5e40c56

Commits on May 22, 2026

feat: add semantics option and convention test harness

FBumann
and
claude
committed
edb8edd

Commits on May 23, 2026

feat: v1 §5 and §8 on expression-OP-constant path

FBumann
and
claude
committed
1a3f2be
feat: v1 §8 on the expr+expr / var+var merge path

FBumann
and
claude
committed
9b52ebd
feat: v1 §6 absence propagation through every operator

FBumann
and
claude
committed
e1a2390
feat: Variable.reindex / .reindex_like (§4 absence creation)

FBumann
and
claude
committed
15b87e9
fix: enforce v1 dead-term invariant in merge

FBumann
and
claude
committed
4d87a05
feat: v1 §10 named-method join + §12 constraint RHS

FBumann
and
claude
committed
602dbdd
feat: make piecewise and SOS2 reformulation v1-aware

FBumann
and
claude
committed
317e57f
test: pin v1 §13 reductions skip absent

FBumann
and
claude
committed
786d126
feat: v1 §11 raises on auxiliary-coordinate conflicts

FBumann
and
claude
committed
0ebccc1
test: pin aux-coord propagation guarantees (§11)

FBumann
and
claude
committed
c7e9099
test: pin v1 dead-term invariant, == constraints, §11 ops, end-to-end solve

FBumann
and
claude
committed
e2cb24f
refactor: extract v1 semantics helpers into linopy/semantics.py

FBumann
and
claude
committed
e8d7b6b
test: parameterize the three operator-uniform v1 test groups

FBumann
and
claude
committed
6093f66
refactor: split _add_constant / _apply_constant_op for clean 1.0 removal

FBumann
and
claude
committed
f0bced4
fix(ci): defer linopy import in conftest + add missing type annotations

FBumann
and
claude
committed
4a6e8e4
feat: self-describing v1 error messages

FBumann
and
claude
committed
4dc67bf
test: round out v1 coverage gaps + fix Variable.unstack absence sentinel

FBumann
and
claude
committed
56ad5bf
test: pin upstream catches for objective and constraint-LHS NaN

FBumann
and
claude
committed
e21b144

Commits on May 24, 2026

feat: site-specific, actionable legacy warnings (goal #2)

FBumann
and
claude
committed
9455683
feat: full-text warning assertions + stdlib stacklevel + docs-plan

FBumann
and
claude
committed
7a44e62
fix: §11 aux-coord check fires on every join, not just join=None

FBumann
and
claude
committed
72ddd99
fix: §6 absence propagates through quadratic factor product

FBumann
and
claude
committed
a38a50d
test: parametrize §6 quadratic propagation across entry points

FBumann
and
claude
committed
71e0fd2
fix: §5 user-NaN check on Variable.to_linexpr(coefficient)

FBumann
and
claude
committed
df34c72
fix: §10 join='override' rejects shared-dim size mismatch

FBumann
and
claude
committed
1c77a74
fix: split legacy RHS warnings — coord-mismatch vs user-NaN

FBumann
and
claude
committed
a4c7f06
fix: structural §8 pre-check, drop brittle xarray exception parse

FBumann
and
claude
committed
578c6f4
docs: lock §5 — user NaN raises, close #627 alternative

FBumann
and
claude
committed
7498cc3
perf: hoist semantics imports out of Variable.to_linexpr hot path

FBumann
and
claude
committed
1517a11
refactor: thread op_kind explicitly through _apply_constant_op

FBumann
and
claude
committed
79b89b1
fix: §11 aux-coord — document asymmetric presence, split shape vs value, handle object-dtype NaN

FBumann
and
claude
committed
99c87cf
fix(types): sort with key=str so override gate is Hashable-safe

FBumann
and
claude
committed
32edfaf
docs: trim docs-plan to an early-stage outline

FBumann
and
claude
committed
d32be12
refactor: dedupe v1-semantics helpers

FBumann
and
claude
committed
b6d38bf

Commits on Jun 1, 2026

docs: define object scope and the unlabeled-operand pairing rule

FBumann
and
claude
committed
55d9e0c
docs: link unlabeled-pairing TODO to tracking issue #736

FBumann
and
claude
committed
a91b901

Commits on Jun 3, 2026

Merge master into feat/arithmetic-convention

FBumann
and
claude
committed
04c7cb4
feat(alignment): make implicit MI projection semantics-aware (#738, scenario B v1)

FBumann
and
claude
committed
f036c24
docs(convention): spec the stacked-MultiIndex rule (scenario B)

FBumann
and
claude
committed
4598d94
fix(expressions): close merge gap — _add_constant_v1 must broadcast its operand

FBumann
and
claude
committed
a644ad3

Commits on Jun 4, 2026

feat: unlabeled-operand pairing by size (#736)

FBumann
and
claude
authored
11cbbca
Merge remote-tracking branch 'origin/master' into feat/arithmetic-convention
FBumann
committed
ff0b691
Merge branch 'master' into feat/arithmetic-convention
FBumann
authored
1b83bd8
fix: align reordered shared-dim coords by label in merge (#550) (#758)

FBumann
and
claude
authored
e7d1217
test: pin legacy side of §13 reductions-over-absent divergence

FBumann
and
claude
committed
a4c6dde
test: pin legacy side of remaining v1/legacy result divergences

FBumann
and
claude
committed
1e8944a
test: unmark equal-behaviour tests so they run under both semantics

FBumann
and
claude
committed
7f5d8d8

Commits on Jun 5, 2026

test: re-mark reordered-merge tests v1 and pin the legacy pairing

FBumann
and
claude
committed
f06908f
test: re-mark fillna-on-masked tests v1 (strict-equality bar)

FBumann
and
claude
committed
a81f00c
test: add strict v1/legacy equivalence guard

FBumann
and
claude
committed
8b2fd9f

Commits on Jun 24, 2026

Commits on Jun 29, 2026

Merge branch 'master' into feat/arithmetic-convention
FBumann
authored
83abcc6
ci(benchmarks): v1-vs-legacy build report + v1 benchmark coverage

FBumann
and
claude
committed
51841fe

Commits on Jul 1, 2026

docs(arithmetics): track open-items.md rollout checklist (#744)

FBumann
and
claude
committed
71bd655
docs(convention): scope §13 to implemented reductions; defer rest to #703

FBumann
and
claude
committed
6b8d65e
docs(convention): note §13's future reductions are v1-only (#703)

FBumann
and
claude
committed
562d528
perf: fix v1 build-memory regressions (exact-join reindex + Variable×const routing) (#804)

FBumann
and
claude
authored
825e90a
docs(convention): §10 — override is size-guarded; assign_coords is unguarded

FBumann
and
claude
committed
d88689f

Commits on Jul 13, 2026

feat(v1): drop first-class MultiIndex — feasibility + implementation (#744) (#803)

authored
f6e0090

Commits on Jul 14, 2026

Merge origin/master (groupby scatter kernel, int32 labels, zero pruning)

FBumann
and
claude
committed
590fd77
test(groupby): NaN-const kernel coverage via .where under both semantics

FBumann
and
claude
committed
b88fc62

Commits on Jul 15, 2026

fix(v1): align reordered coefficient by label in coeff * x

FBumann
and
claude
committed
16d3d7b
test: fix mypy failures in test_common and test_mi_feasibility

FBumann
and
claude
committed
61dfabd
docs(v1): spell out that the default join is "exact"

FBumann
and
claude
committed
5322c67
docs(v1): default join follows options["semantics"], not a fixed "exact"

FBumann
and
claude
committed
9902945
docs(v1): describe join=None default without headlining "exact" (#832)

FBumann
and
claude
authored
28de967

Commits on Jul 16, 2026

feat(v1): tighten §8 alignment to full join="exact" (#831)

FBumann
and
claude
authored
e71d4d3
fix(v1): make coeff * x reorder-exact, purge stale reorder-tolerant text (#834)

FBumann
and
claude
authored
7196d61
docs(notebooks): run example notebooks under the v1 convention (#833)

FBumann
and
claude
authored
91c33c1
Merge branch 'master' into feat/arithmetic-convention
FBumann
authored
33a1d56
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
88a97e8
perf(v1): skip mask/where/const for dense variables in to_linexpr (#836)

FBumann
and
claude
authored
6d995fb
feat(v1): warn on reordered constants under legacy; spec groupers (#837)

FBumann
and
claude
authored
1b0e1c6
perf(v1): skip no-op reindex_like in Variable.to_linexpr (#838)

FBumann
and
claude
authored
02ec23f
Merge branch 'master' into feat/arithmetic-convention
FBumann
authored
b860e9a
fix(v1): warn on legacy multi-key groupby MultiIndex; suggest reset_index (#840)

FBumann
and
claude
authored
c4bbc7e
perf: make fill_missing_coords copy lazily (skip the no-op deep copy) (#844)

FBumann
and
claude
authored
69db061
docs: changelog entry for opt-in v1 arithmetic semantics (#841)

FBumann
and
claude
authored
5a131a6
docs: add v1 migration guide (#842)

FBumann
and
claude
authored
40c2022

Commits on Jul 20, 2026

fix(v1): don't warn on exactly-aligned @/dot under legacy (#849) (#850)

FBumann
and
claude
authored
392ee7f
fix(v1): make Variable.fillna(scalar) resolve absence under both conventions (#847, #848) (#851)

FBumann
and
claude
authored
3700657
test(v1): use public accessors + scoped option in groupby tests (#852)

FBumann
and
claude
authored
ddf3762
test(v1): co-locate §6 masked-addend tests and pin fallback-guard messages (#853)

FBumann
and
claude
authored
71df679
fix(v1): detect NaN scalars of any float dtype; harden merge dedup; drop dead code (#854)

FBumann
and
claude
authored
b4ff193
docs(v1): cover unlabeled-operand and grouper cases, fold MI-level into MI row (#855)

FBumann
and
claude
authored
cc9d3f2
docs(v1): fix §11 MultiIndex-level projection example; note 1.0 doc graduation (#856)

FBumann
and
claude
authored
921392a
docs(v1): cover the scalar-leftover-coord aux conflict (isel drop=True) (#858)

FBumann
and
claude
authored
1362134
test(v1): polish the #717 convention test suite (#859)

FBumann
and
claude
authored
8ce901e

Commits on Jul 21, 2026

Merge branch 'master' into feat/arithmetic-convention
FabianHofmann
authored
c48dafd

Commits on Jul 22, 2026

docs(v1): move arithmetic-convention specs into doc/ as published rst (#861)

FBumann
and
claude
authored
89bb293

Commits on Jul 24, 2026

Merge branch 'master' into feat/arithmetic-convention
FabianHofmann
authored
3469433
proto: deferred groupby-sum realized directly as CSRConstraint

FBumann
and
claude
committed
2af0867
feat(v1): lazy groupby-sum with direct CSR realization under freeze

FBumann
and
claude
committed
e225992
feat(v1): CSR-backed sparse groupby-sum (payload swap from lazy recipe)

FBumann
and
claude
committed
2518c67
bench(patterns): sparse sibling for nodal_balance; drop dev-script repro

FBumann
and
claude
committed
f083482
refactor: condense sparse-groupby code and docs

FBumann
and
claude
committed
c207a6b