Repository navigation

feat: add ReplaySSM state modes for GDN and KDA - #1689

Closed

sufubao wants to merge 56 commits into

ModelTC:mainfrom

sufubao:support-replayssm-v2

Closed

feat: add ReplaySSM state modes for GDN and KDA#1689
sufubao wants to merge 56 commits into
ModelTC:mainfrom
sufubao:support-replayssm-v2

Commits on Sep 20, 2026
- feat: add ReplaySSM support for linear attention
  sufubao
  committed
  762c235
Commits on Oct 6, 2026
- feat: finalize ReplaySSM state storage for GDN
  sufubao
  committed
  8b2c9fb
- style: use the pinned Black formatting
  sufubao
  committed
  4213a74
- fix: skip hybrid checkpoints when prefix caching is disabled
  sufubao
  committed
  2727aae
- refactor: simplify GDN SSM state handling
  sufubao
  committed
  b63c50b
- feat: support ReplaySSM state modes for KDA
  sufubao
  committed
  9f791ad
- fix: keep KDA tuning cache filenames within filesystem limits
  sufubao
  committed
  28f2aca
- fix: handle empty GLM indexer rows during graph capture
  sufubao
  committed
  59fae10
Commits on Oct 7, 2026
- Simplify ReplaySSM updates and cache metadata access
  sufubao
  committed
  a55770c
- Tune SSM layouts per batch and preserve verify configs
  sufubao
  committed
  3af33c2
Commits on Oct 14, 2026
- perf(replayssm): optimize GDN MTP decoding and sampling
  sufubao
  committed
  3fa7c6a
- Merge PR #1585 into current checkout
  sufubao
  committed
  e882a1f
- style: format ReplaySSM kernels
  sufubao
  committed
  b580198
- chore: exclude ReplaySSM docs from PR
  sufubao
  committed
  62258cd
- fix: pass required arguments to SGL FA3 vision attention
  sufubao
  committed
  7c25a7e
Commits on Oct 15, 2026
- fix: separate draft tail graph layouts across padding
  sufubao
  committed
  fb029ed
- test: cover continuous ReplaySSM derived state lifecycle
  sufubao
  committed
  16d55f8
- refactor: group ReplaySSM options in a JSON config
  sufubao
  committed
  7dcda70
- fix: reject unsupported compact MTP widths at startup
  sufubao
  committed
  833d5eb
- fix: validate GDN and KDA MTP widths across state modes
  sufubao
  committed
  aca2281
Commits on Oct 16, 2026
- Merge remote-tracking branch 'upstream/main' into replayssm-main-sync
  sufubao
  committed
  b047f64
Commits on Oct 17, 2026
Commits on Oct 19, 2026
- Merge commit 'refs/pull/1585/head' of https://github.com/ModelTC/LightLLM into merge-pr-1585
  sufubao
  committed
  d66fec2
- refactor: split independent vision FA3 fixes out of ReplaySSM
  sufubao
  committed
  600df9e
- fix: shorten GDN precompute tuning cache filenames
  sufubao
  committed
  60ba1f3
- refactor: clarify linear layer index naming
  sufubao
  committed
  a1c86f0
- refactor: pass immutable SSM run configs directly
  sufubao
  committed
  e1dc47a
- style: group PR imports and clarify SSM layer indices
  sufubao
  committed
  12532af
Commits on Oct 20, 2026
- fix: pass ReplaySSM tile dimensions as compile-time constants
  sufubao
  committed
  0f663cd
Commits on Nov 3, 2026
- Merge remote-tracking branch 'upstream/main' into merge-pr-1585
  sufubao
  committed
  167eb4e
- style: match pinned Black formatting
  sufubao
  committed
  db380b5
- fix: bound SSM tuning memory and prepare remote configs
  sufubao
  committed
  f1e8288
- refactor: simplify ReplaySSM state interfaces
  sufubao
  committed
  924088d
- style: revert unrelated blank-line changes in ReplaySSM PR
  
  hiworldwzj
  authored and
  sufubao
  committed
  c3818f8
- refactor: keep SSM run configs in attention state
  sufubao
  committed
  1527002
- refactor: split accepted-tail draft projection out of ReplaySSM PR
  
  hiworldwzj
  authored and
  sufubao
  committed
  ac4a82c
- style: restore original infer_struct imports
  
  hiworldwzj
  authored and
  sufubao
  committed
  355357a
- refactor: encapsulate hybrid checkpoint and PD state interfaces
  
  hiworldwzj
  authored and
  sufubao
  committed
  69f65be
- refactor: separate SSM state execution and acceptance
  sufubao
  committed
  d3622db
- fix: preserve logical GDN layer state in loop models
  sufubao
  committed
  26627bf
- test: initialize runtime args for SSM checkpoint tests
  sufubao
  committed
  38d9a6b
- docs: remove ReplaySSM design document
  sufubao
  committed
  cfc9f8b
Commits on Nov 4, 2026
- refactor: limit PR changes to ReplaySSM
  sufubao
  committed
  c3439c9
- refactor: unify SSM acceptance and execution
  sufubao
  committed
  dc85b49
- fix: bound SSM checkpoint memory and acceptance compilation
  sufubao
  committed
  0de73fe
- perf: reuse ReplaySSM kernels across eager batch sizes
  sufubao
  committed
  d3ca333
Commits on Nov 5, 2026
- docs: explain ReplaySSM state interfaces
  sufubao
  committed
  e785143
- refactor: split ReplaySSM kernels by lifecycle
  sufubao
  committed
  f4b004b
- docs: clarify ReplaySSM interfaces and kernel lifecycle
  sufubao
  committed
  2128f74
- refactor: centralize bounded attention validation
  sufubao
  committed
  ae6aa34
- refactor: remove redundant ReplaySSM guards
  sufubao
  committed
  3a95a9e
- perf: validate graph layout once per capture
  sufubao
  committed
  0a44f17
Commits on Nov 6, 2026
- refactor: split bounded attention state strategies
  sufubao
  committed
  439a1a5

Commits

Commits on Sep 20, 2026

Commits on Oct 6, 2026

Commits on Oct 7, 2026

Commits on Oct 14, 2026

Commits on Oct 15, 2026

Commits on Oct 16, 2026

Commits on Oct 17, 2026

Commits on Oct 19, 2026

Commits on Oct 20, 2026

Commits on Nov 3, 2026

Commits on Nov 4, 2026

Commits on Nov 5, 2026

Commits on Nov 6, 2026