Repository navigation

feat: add ReplaySSM state modes for GDN and KDA - #1690

Merged

hiworldwzj merged 54 commits into

ModelTC:mainfrom

sufubao:support/replayssm-clean

Nov 12, 2026

Merged

feat: add ReplaySSM state modes for GDN and KDA#1690
hiworldwzj merged 54 commits into
ModelTC:mainfrom
sufubao:support/replayssm-clean

Commits on Nov 12, 2026
- feat: add ReplaySSM state modes for GDN and KDA
  
  sufubao
  authored and
  hiworldwzj
  committed
  656550c
- refactor: remove retired ReplaySSM modes
  
  sufubao
  authored and
  hiworldwzj
  committed
  398cc21
- refactor: name the SSM executor explicitly
  
  sufubao
  authored and
  hiworldwzj
  committed
  ead7d04
- style: modernize ReplaySSM Python interfaces
  
  sufubao
  authored and
  hiworldwzj
  committed
  fec53e8
- style: document ReplaySSM Python functions
  
  sufubao
  authored and
  hiworldwzj
  committed
  f88e7ba
- refactor: split GDN and KDA replay into standalone state modules
  
  hiworldwzj
  and
  cursoragent
  committed
  8720368
- refactor: move GDN and KDA replay off the native attention path
  
  hiworldwzj
  and
  cursoragent
  committed
  ed4f140
- refactor: make replay KDA and GDN backends standalone
  
  hiworldwzj
  and
  cursoragent
  committed
  7948824
- refactor: move replay decode onto GDN and KDA step modules
  
  hiworldwzj
  and
  cursoragent
  committed
  cb6f6f8
- refactor: keep GDN and KDA replay history on the state
  
  hiworldwzj
  and
  cursoragent
  committed
  98957a4
- refactor: fold replay history when decode accepts
  
  hiworldwzj
  and
  cursoragent
  committed
  93d7249
- refactor: drop the SSM slot property and keyword-only arguments
  
  hiworldwzj
  and
  cursoragent
  committed
  3f9f313
- refactor: keep replay page layout on the state
  
  hiworldwzj
  and
  cursoragent
  committed
  8d6308c
- refactor: let replay state commit accepted lengths directly
  
  hiworldwzj
  and
  cursoragent
  committed
  c3075fe
- refactor: name the replay decode kernel helpers
  
  hiworldwzj
  and
  cursoragent
  committed
  4f5f3f5
- refactor: place private helpers after the public interfaces
  
  hiworldwzj
  and
  cursoragent
  committed
  91ec748
- refactor: tune replay on a one-layer scratch state
  
  hiworldwzj
  and
  cursoragent
  committed
  5e7a285
- refactor: drop replay decode wrappers and restore native backends
  
  hiworldwzj
  and
  cursoragent
  committed
  0e08843
- refactor: keep replay history as one accepted prefix
  
  hiworldwzj
  and
  cursoragent
  committed
  476cfdc
- refactor: compress replay prefixes inside the materialize kernel
  
  hiworldwzj
  and
  cursoragent
  committed
  8374064
- refactor: close replay tokens in-kernel and drop tuning OOM bypass
  
  hiworldwzj
  and
  cursoragent
  committed
  0ead21c
- refactor: honor replay precompute for single-token decode
  
  hiworldwzj
  and
  cursoragent
  committed
  8f3681f
- style: restore the blank line in Autotuner initialization
  
  hiworldwzj
  and
  cursoragent
  committed
  b399522
- refactor: inline one-use replay helpers
  
  hiworldwzj
  and
  cursoragent
  committed
  b1a78bb
- refactor: put replay entry points ahead of their helpers
  
  hiworldwzj
  and
  cursoragent
  committed
  a8cb33b
- refactor: restore the original MTP state-params layout
  
  hiworldwzj
  and
  cursoragent
  committed
  833cf51
- refactor: name replay kernels by decode, cursor, and fold
  
  hiworldwzj
  and
  cursoragent
  committed
  eb91e42
- feat: reconstruct GDN and KDA replay outputs on tensor cores
  
  hiworldwzj
  and
  cursoragent
  committed
  2f117c6
- fix: fold replay prefixes inside the decode kernel
  
  hiworldwzj
  and
  cursoragent
  committed
  fea39d6
- refactor: share the accepted-prefix fold between replay and compress
  
  hiworldwzj
  and
  cursoragent
  committed
  c63ad74
- refactor: remove the unused full-prefix replay path
  
  hiworldwzj
  and
  cursoragent
  committed
  244c986
- refactor: drop the unused replay prepare_decode hook
  
  hiworldwzj
  and
  cursoragent
  committed
  3a8540b
- refactor: fill replay kernel defaults at launch
  
  hiworldwzj
  and
  cursoragent
  committed
  e73ae2e
- refactor: copy the prefill baseline into replay pages
  
  hiworldwzj
  and
  cursoragent
  committed
  5b8623a
- refactor: drop the empty prefill fold from replay state
  
  hiworldwzj
  and
  cursoragent
  committed
  8bfc2cc
- refactor: advance the replay cursor after the whole window is accepted
  
  hiworldwzj
  and
  cursoragent
  committed
  28db987
- fix: wait for every value tile before a folded replay writes history
  
  hiworldwzj
  and
  cursoragent
  committed
  69c2518
- refactor: require cursor prefixes at decode setup
  
  hiworldwzj
  and
  cursoragent
  committed
  5dc284e
- refactor: keep one MTP index path and commit only when MTP is enabled
  
  hiworldwzj
  and
  cursoragent
  committed
  1d9162a
- refactor: fold replay prefixes only back into the canonical SSM
  
  hiworldwzj
  and
  cursoragent
  committed
  64b6f1f
- refactor: drop unused replay kernel exports and the dense stride fallback
  
  hiworldwzj
  and
  cursoragent
  committed
  e97fce7
- refactor: name replay inputs by the tensors they address
  
  hiworldwzj
  and
  cursoragent
  committed
  664d543
- refactor: require one packed layout for replay decode
  
  hiworldwzj
  and
  cursoragent
  committed
  88b886e
- refactor: tune GDN and KDA replay on their own kernels
  
  hiworldwzj
  and
  cursoragent
  committed
  7bd612f
- refactor: pass replay tile configs as arguments
  
  hiworldwzj
  and
  cursoragent
  committed
  bc474ff
- refactor: give GDN and KDA separate linear backend entries.
  
  hiworldwzj
  and
  cursoragent
  committed
  ba78baa
- refactor: pass KDA replay tensors instead of the state object.
  
  hiworldwzj
  and
  cursoragent
  committed
  85f0f22
- chore: record Cursor rules for new code.
  
  hiworldwzj
  and
  cursoragent
  committed
  c79a062
- refactor: name replay kernel arguments and pass tile configs explicitly.
  
  hiworldwzj
  and
  cursoragent
  committed
  1567491
- refactor: move SSM config validation to the end of startup.
  
  hiworldwzj
  and
  cursoragent
  committed
  7bcedef
- fix: ignore reused replay history and store deltas in fp32
  
  hiworldwzj
  and
  cursoragent
  committed
  5a441ba
- fix: wait for every value head sharing a key before replay overwrites it
  
  hiworldwzj
  and
  cursoragent
  committed
  6fb01a0
- refactor: launch replay value heads before requests
  
  hiworldwzj
  and
  cursoragent
  committed
  59adc05
- test: fix replay padding and restore grouped-head coverage
  sufubao
  committed
  083ac58

Commits

Commits on Nov 12, 2026