Skip to content

feat: support Qwen3.8 Flash Next with ReplaySSM - #1706

Draft
sufubao wants to merge 6 commits into
ModelTC:mainfrom
sufubao:qwen38-flash-next-consolidated
Draft

sufubao wants to merge 6 commits into
ModelTC:mainfrom
sufubao:qwen38-flash-next-consolidated

Conversation

@sufubao

@sufubao sufubao commented Nov 11, 2026 •

Copy link
Copy Markdown
Collaborator

支持 Qwen3.8-Flash-Next/Qwen4Exp,接入模型、tokenizer、QSA、n-gram/PLE 和 MTP,并将 GDN/KDA ReplaySSM 与混合注意力状态管理整理到同一 PR。覆盖 history、accepted-state、页缓存、CPU/PD/DP 转移和 MTP 提交。

补齐 causal-convolution 的可选后端和本地 Triton fallback,支持缺少可加载 sgl_kernel 的运行环境;保留 packed prefill、前缀状态、padding、非连续缓存和环形游标语义,并修复 SGL update 原地写入但不返回 Tensor 的适配。

验证:H200 上 ReplaySSM fold/history 40 项、execution/acceptance 57 项回归通过;本次卷积数值、状态与 CUDA Graph 回归 114 项通过。相关 Python 通过 Black、Flake8。增加固定请求全文的 AgentX 控制回放:统一逐轮预热、缓存重置、SSE 用量审计和三轮波动门槛;相关回归 33 项通过,并验证 SGLang 缓存重置及阶段间空闲等待。H100 完整模型 ReplaySSM AgentX 尚无可用吞吐结论;公开数据回放不代表真实业务验收。

@sufubao
sufubao marked this pull request as draft November 12, 2026 04:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant