Skip to content

feat: support hf-overrides for realtime server - #3768

Closed
gotorion wants to merge 1 commit into
modelscope:mainfrom
gotorion:support-hf-overrides
Closed

gotorion wants to merge 1 commit into
modelscope:mainfrom
gotorion:support-hf-overrides

Conversation

@gotorion

@gotorion gotorion commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

Summary

Type of change

  • Bug fix
  • Documentation
  • Example or demo
  • Runtime or deployment
  • Benchmark or evaluation
  • Model/training change

Validation

  • python -m compileall funasr examples tests
  • Docs or links checked
  • Runtime/deployment command tested

User impact

People who has their own vLLM backend may use different model implementation.

Notes for reviewers

@gotorion
gotorion marked this pull request as draft October 9, 2026 08:22
@gotorion
gotorion marked this pull request as ready for review October 9, 2026 08:22
LauraGPT added a commit that referenced this pull request Oct 31, 2026
Integrate #3768 with the preserved compatibility correction, object validation and durable CI.

Co-authored-by: Li Junhui <lijunhui.me@foxmail.com>

Signed-off-by: LauraGPT <zhifu.gzf@alibaba-inc.com>
LauraGPT added a commit that referenced this pull request Oct 31, 2026
Integrate gotorion's #3768 with compatible optional access, JSON object validation and durable CI. 185 focused CPU tests and native synthetic FP32/BF16 vLLM CUDA execution passed; not pretrained ASR quality or a full-suite claim.

Signed-off-by: LauraGPT <zhifu.gzf@alibaba-inc.com>
@LauraGPT

Copy link
Copy Markdown
Collaborator

Thanks @gotorion. Your realtime hf-overrides support is now integrated through #3810 with contributor credit in the signed+DCO commit. The original fork/head is unchanged. This PR is closed as superseded, not described as a merged original commit.

The integration preserves callers without the optional Namespace attribute, rejects non-object JSON before loading models, and keeps the tests in both NumPy CI matrices. Local verification: 185 focused CPU cases, zero skips; actual L20Z/native vLLM execution in FP32 and BF16 using saved, hashed random weights. The initial undersized GPU fixture failure is retained and corrected, not hidden. This validates CLI/loader boundaries and native config/CUDA generation, not pretrained audio accuracy, every custom architecture or the full repository suite.

New-head and final-main CI succeeded. Actual downloaded evidence for each of the four NumPy matrix runs contains 358 passing cases, including all 90 realtime service and 13 JSON validation cases, and the exact source-commit marker. No release, PyPI upload, protection change or administrator bypass is included.

@LauraGPT LauraGPT closed this Oct 31, 2026
@LauraGPT LauraGPT mentioned this pull request Nov 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants