diff --git a/golden_al_distribution/README.md b/golden_al_distribution/README.md index 93666c4fba..15dcb6d172 100644 --- a/golden_al_distribution/README.md +++ b/golden_al_distribution/README.md @@ -112,6 +112,7 @@ Before accepting an updated curve, reviewers should verify: | Qwen3.5 397B-A17B | MTP | [`qwen3.5_mtp.yaml`](qwen3.5_mtp.yaml) | [27317114007](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/27317114007) | | Kimi K2.5 | EAGLE3 | [`kimik2.5_eagle3.yaml`](kimik2.5_eagle3.yaml) | [28122195822](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28122195822) | | MiniMax-M3 | EAGLE3 | [`minimaxm3_eagle3.yaml`](minimaxm3_eagle3.yaml) | [28061204145](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28061204145) | +| GLM-5.2 | MTP | [`glm5.2_mtp.yaml`](glm5.2_mtp.yaml) | [28058352479](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28058352479) | ## Primary references diff --git a/golden_al_distribution/README_zh.md b/golden_al_distribution/README_zh.md index e4231027e5..1285b613bd 100644 --- a/golden_al_distribution/README_zh.md +++ b/golden_al_distribution/README_zh.md @@ -112,6 +112,7 @@ gh workflow run speedbench-al.yml \ | Qwen3.5 397B-A17B | MTP | [`qwen3.5_mtp.yaml`](qwen3.5_mtp.yaml) | [27317114007](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/27317114007) | | Kimi K2.5 | EAGLE3 | [`kimik2.5_eagle3.yaml`](kimik2.5_eagle3.yaml) | [28122195822](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28122195822) | | MiniMax-M3 | EAGLE3 | [`minimaxm3_eagle3.yaml`](minimaxm3_eagle3.yaml) | [28061204145](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28061204145) | +| GLM-5.2 | MTP | [`glm5.2_mtp.yaml`](glm5.2_mtp.yaml) | [28058352479](https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28058352479) | ## 主要参考资料 diff --git a/golden_al_distribution/glm5.2_mtp.yaml b/golden_al_distribution/glm5.2_mtp.yaml new file mode 100644 index 0000000000..afebacac98 --- /dev/null +++ b/golden_al_distribution/glm5.2_mtp.yaml @@ -0,0 +1,19 @@ +# Source GitHub Actions run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/28058352479 +# Acceptance Length (AL) reference values measured with SPEED-Bench. +# dataset: coding | temperature: 1.0 | top_p: 0.95 | output_len: 4096 +# thinking_on chat_template_kwargs: {"enable_thinking": true} +# thinking_off chat_template_kwargs: {"enable_thinking": false} +# Measured on glm-5.2-fp8 (B300, vLLM MTP), per num_speculative_tokens. +# Auto-generated by benchmarks/single_node/speedbench/glm52_fp4_b300_vllm.sh (speedbench-al.yml). +# +# key = num_speculative_tokens (MTP level); value = golden AL +glm-5.2-fp8: + thinking_on: + 1: 1.84 + 2: 2.50 + 3: 2.99 + 4: 3.33 + 5: 3.61 + 6: 3.78 + 7: 3.91 + 8: 4.06