FunASR llama.cpp runtime runtime-llamacpp-v0.1.5

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with bash download-funasr-model.sh <sensevoice|paraformer|nano>, then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. Use the default x64 asset for maximum CPU compatibility; use the x64-avx2 asset on CPUs with AVX2/FMA/F16C/BMI2 for higher throughput. No Python, no build. Docs: runtime/llama.cpp/README.md

FunASR llama.cpp runtime runtime-llamacpp-v0.1.4

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with bash download-funasr-model.sh <sensevoice|paraformer|nano>, then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. Use the default x64 asset for maximum CPU compatibility; use the x64-avx2 asset on CPUs with AVX2/FMA/F16C/BMI2 for higher throughput. No Python, no build. Docs: runtime/llama.cpp/README.md

FunASR llama.cpp runtime runtime-llamacpp-v0.1.3

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with bash download-funasr-model.sh <sensevoice|paraformer|nano>, then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. No Python, no build. Docs: runtime/llama.cpp/README.md

FunASR v1.3.14: safer SenseVoice and Paraformer inference

FunASR v1.3.14 fixes two inference failures and makes the first-run model choice and benchmark evidence easier to understand.

Runtime fixes

• SenseVoice Triton path imports correctly again. Misplaced text between Triton decorators and kernel definitions caused a Python SyntaxError during auto-registration and prevented the optimized DTW module from loading. The module now compiles normally. (#3027)
• Paraformer no longer crashes when a short or near-silent segment produces no CIF boundary. The no-fire path now returns an empty frame result safely. On the reported 184-file Chinese benchmark, decoding improved from 179/184 to 184/184 while micro-average CER remained 10.17%. (#3028)

Onboarding and benchmark clarity

• Quick Start now leads with the flagship Fun-ASR-Nano path while retaining SenseVoice as the CPU-friendly multilingual option.
• The benchmark table reports Fun-ASR-Nano's vLLM throughput (340x realtime) and adds Chinese CER, with English and Chinese READMEs kept in sync.
• The model-selection guide and duplicated Quick Start sections were cleaned up so installation, model choice, and first inference are easier to scan.

Upgrade

pip install --upgrade funasr==1.3.14

Included changes

• #3019 — lead Quick Start with Fun-ASR-Nano
• #3020 — update model-selection ordering
• #3021 — remove duplicated Quick Start content
• #3023 — report Fun-ASR-Nano vLLM throughput
• #3024 — add Chinese CER to the benchmark
• #3025 — synchronize translated README benchmarks
• #3027 — fix SenseVoice Triton SyntaxError
• #3028 — guard Paraformer CIF no-fire segments

Full changelog: v1.3.13...v1.3.14

v1.3.13

What's Changed

• docs(vllm_guide): explain EmbedsPrompt/streaming partial/SPK/concurre… by @qiulang in #3011
• docs(README): make the llama.cpp/GGUF (CPU/edge) runtime a first-class section by @LauraGPT in #3012
• feat: q8_0 GGUF export — half-size encoders, CER unchanged by @LauraGPT in #3013
• docs(README): refresh What's New with June updates by @LauraGPT in #3015
• docs(README): holistic fixes — broken quickstart, stray links, consistency by @LauraGPT in #3016
• docs(README): canonical iic/ ModelScope namespace by @LauraGPT in #3017
• fix(glm_asr): dedup result keys for duplicate audio basenames by @SuperMarioYL in #3014

Full Changelog: v1.3.12...v1.3.13

v1.3.12

What's Changed

• docs(vllm_guide): drop stale repetition_penalty hardcode note by @LauraGPT in #3007
• fix(qwen3-asr): map ISO/short language codes to qwen-asr canonical names by @montvid in #3008
• docs(README): make the quickstart runnable (missing model.generate call) by @LauraGPT in #3010
• docs(vllm_guide): let vLLM pin torch/torchaudio in the installation steps by @qiulang in #3009

New Contributors

• @montvid made their first contribution in #3008
• @qiulang made their first contribution in #3009

Full Changelog: v1.3.11...v1.3.12

FunASR llama.cpp runtime runtime-llamacpp-v0.1.2

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with bash download-funasr-model.sh <sensevoice|paraformer|nano>, then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. No Python, no build. Docs: runtime/llama.cpp/README.md

v1.3.11

What's Changed

• docs: python wss server now supports multiple concurrent clients by @LauraGPT in #2985
• docs: make README quickstart runnable and output truthful by @LauraGPT in #2986
• docs: fix README streaming example (runnable + actually streams) by @LauraGPT in #2987
• Add llama.cpp / GGUF runtime (Fun-ASR-Nano, SenseVoice, Paraformer) by @LauraGPT in #2988
• docs: link llama.cpp / GGUF (CPU/edge) runtime from Deploy section by @LauraGPT in #2991
• ci: auto-create GitHub Release on version tag push by @LauraGPT in #2995
• docs: CPU benchmark vs whisper.cpp (Chinese ASR) by @LauraGPT in #2992
• feat: accept any audio input (any rate/channels, wav/mp3/flac) via miniaudio by @LauraGPT in #2994
• feat: built-in FSMN-VAD (--vad) — single-binary speech segmentation, no Python at runtime by @LauraGPT in #2998
• fix: FSMN-VAD review findings (MSVC M_PI, short-audio guard, tensor validation) by @LauraGPT in #2999
• feat: B1 packaging — one-command download, standalone convert, CI-friendly CMake by @LauraGPT in #3000
• docs: build note for funasr-common (A1 follow-up) by @LauraGPT in #2996
• ci: cross-platform prebuilt binaries for the llama.cpp runtime by @LauraGPT in #3001
• fix: B1 script portability (HF CLI fallback + friendly missing-dep error) by @LauraGPT in #3002
• test: numerical regression harness (frozen golden vs ggml/VAD/CIF/CTC output) by @LauraGPT in #3003
• feat: print transcription text in the binaries (in-binary detok) by @LauraGPT in #3004
• fix: detok review findings (null vocab guard + utf-8 tokens read) by @LauraGPT in #3005
• fix(glm_asr): warn when vLLM dtype=fp16 (degraded output) by @SuperMarioYL in #2993
• fix(glm_asr): honor sampling params in vLLM generate() by @SuperMarioYL in #2997

Full Changelog: v1.3.10...v1.3.11

FunASR llama.cpp runtime runtime-llamacpp-v0.1.1

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with bash download-funasr-model.sh <sensevoice|paraformer|nano>, then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. No Python, no build. Docs: runtime/llama.cpp/README.md

FunASR llama.cpp runtime runtime-llamacpp-v0.1.0

Prebuilt self-contained binaries for the FunASR llama.cpp / GGUF runtime — SenseVoice, Paraformer and Fun-ASR-Nano with built-in FSMN-VAD (a whisper.cpp-style on-device ASR, strong on Chinese). Get a model with bash download-funasr-model.sh <sensevoice|paraformer|nano>, then run llama-funasr-cli / llama-funasr-sensevoice / llama-funasr-paraformer. No Python, no build. Docs: runtime/llama.cpp/README.md