mirror of
https://github.com/modelscope/FunASR.git
synced 2026-10-12 02:19:18 +00:00
docs(runtime): publish verified v0.2.5 download matrix
Signed-off-by: LauraGPT <[email protected]>
This commit is contained in:
LauraGPT
@@ -306,7 +306,7 @@ GPUs report compute capability 12.0 (`sm_120`) and should use the CPU package or
|
||||
build from source with `-DCMAKE_CUDA_ARCHITECTURES=120` until a dedicated CUDA
|
||||
asset is published.
|
||||
|
||||
**Prebuilt binaries:** [Releases](https://github.com/modelscope/FunASR/releases) · [v0.2.4](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4) · [Linux Vulkan tarball](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-x64-vulkan.tar.gz) · [Windows Vulkan zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-vulkan.zip) · [Windows CUDA zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-cuda.zip) · **Download & quickstart:** [funasr.com/deploy/llama-cpp](https://www.funasr.com/en/deploy/llama-cpp.html) · **GGUF models:** [Hugging Face](https://huggingface.co/FunAudioLLM) · **Docs & benchmarks:** [runtime/llama.cpp/](./runtime/llama.cpp/)
|
||||
**Prebuilt binaries:** [Releases](https://github.com/modelscope/FunASR/releases) · [v0.2.5](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5) · [Linux Vulkan tarball](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-x64-vulkan.tar.gz) · [Windows Vulkan zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-vulkan.zip) · [Windows CUDA zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-cuda.zip) · **Download & quickstart:** [funasr.com/deploy/llama-cpp](https://www.funasr.com/en/deploy/llama-cpp.html) · **GGUF models:** [Hugging Face](https://huggingface.co/FunAudioLLM) · **Docs & benchmarks:** [runtime/llama.cpp/](./runtime/llama.cpp/)
|
||||
|
||||
[OpenAI API example →](./examples/openai_api/) · [Gradio demo →](./examples/openai_api/GRADIO.md) · [Client recipes →](./examples/openai_api/CLIENTS.md) · [JavaScript/TypeScript recipes →](./examples/openai_api/JAVASCRIPT.md) · [Kubernetes template →](./examples/openai_api/kubernetes/) · [Workflow recipes →](./examples/openai_api/WORKFLOWS.md) · [Postman collection →](./examples/openai_api/POSTMAN.md) · [OpenAPI spec →](./examples/openai_api/OPENAPI.md) · [Security guide →](./examples/openai_api/SECURITY.md) · [Deployment matrix →](./docs/deployment_matrix.md) · [Deployment docs →](./runtime/readme.md) · [Agent integration →](https://modelscope.github.io/FunASR/agent.html)
|
||||
|
||||
@@ -330,6 +330,7 @@ asset is published.
|
||||
|
||||
## What's new
|
||||
|
||||
- 2026/08/29: **llama.cpp runtime v0.2.5** — uploads host weights into the selected Vulkan backend buffer before graph execution. Q8 and F16 weights pass local Linux Vulkan llvmpipe validation, and all nine Linux, macOS, and Windows archives were built from exact commit `f371370d4c5e4c61d13d4eb9c55cda2f4dd95e4f` and verified against their published SHA-256 values. This does not claim the AMD Windows hardware crash is fixed; [#3479](https://github.com/modelscope/FunASR/issues/3479) remains open for reporter retesting. [Fix ->](https://github.com/modelscope/FunASR/pull/3555) · [Release ->](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5)
|
||||
- 2026/08/29: **llama.cpp runtime v0.2.4** — fixes intermittent empty SenseVoiceSmall transcripts with F16 GGUF models. Query embeddings are now decoded according to their GGML F16/F32 type instead of reading F16 storage as F32. The exact v0.2.3 AVX2 asset reproduced 22 blank outputs across 298 completed runs; the fixed head produced one identical non-empty result in 100/100 runs and matched the Q8 model byte-for-byte. The release workflow will build nine Linux, macOS, and Windows archives from one exact commit. [Fix ->](https://github.com/modelscope/FunASR/pull/3550) · [Release ->](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4)
|
||||
- 2026/08/29: **v1.4.6 on PyPI** — the realtime WebSocket server keeps 20-second pings but no longer closes healthy sessions by default when queued decoding delays pong handling; operators can still configure a positive timeout after measuring production queue and decode latency. This release also avoids `IndexError` on empty English timestamp segments and groups adjacent subtitle words into readable cues. Upgrade with `python -m pip install -U "funasr==1.4.6"`. The GitHub Release carries the verified nine-platform llama.cpp v0.2.3 runtime archives. [Release ->](https://github.com/modelscope/FunASR/releases/tag/v1.4.6)
|
||||
- 2026/08/29: **llama.cpp runtime v0.2.3** — adds flushed stage boundaries after backend initialization for model loading, audio/VAD, graph construction and allocation, and compute. These diagnostics narrow Windows AMD Vulkan `0xC0000005` failures that occur after `vulkan backend ready`; they do not claim the hardware-specific crash is fixed. Nine Linux, macOS, and Windows archives are published from one exact commit. [Troubleshooting boundaries ->](./runtime/llama.cpp/README.md#optional-windows-vulkan-backend-for-sensevoicesmall) · [Release ->](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.3)
|
||||
|
||||
@@ -99,6 +99,7 @@ Whisper は単一モデルですが、**FunASR はツールキット**です—
|
||||
|
||||
## 最新情報
|
||||
|
||||
- 2026/08/29：**llama.cpp runtime v0.2.5** — graph 実行前に host weight を選択された Vulkan backend buffer へ upload します。Q8/F16 weight は Linux Vulkan llvmpipe で検証済みで、Linux、macOS、Windows 向け 9 archive は exact commit `f371370d4c5e4c61d13d4eb9c55cda2f4dd95e4f` から build し、公開 SHA-256 と照合しました。AMD Windows hardware crash の修正済みとはしておらず、[#3479](https://github.com/modelscope/FunASR/issues/3479) は reporter の実機再テスト待ちで open のままです。[修正 →](https://github.com/modelscope/FunASR/pull/3555) · [Release →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5)
|
||||
- 2026/08/29：**llama.cpp runtime v0.2.4** — F16 GGUF model で transcript が断続的に空になる問題を修正しました。Query embedding は F16 storage を F32 として読むのではなく、GGML の F16/F32 type に従って decode されます。正確な v0.2.3 AVX2 asset では 298 回の完了 run 中 22 回の空出力を再現しましたが、修正後は 100/100 回で同一の非空出力となり、Q8 model と byte 単位で一致しました。Release workflow は同一の exact commit から 9 platform archive を構築します。[修正 →](https://github.com/modelscope/FunASR/pull/3550) · [Release →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4)
|
||||
- 2026/08/29：**v1.4.6 を PyPI に公開** — realtime WebSocket server は 20 秒間隔の ping を維持しつつ、decode queue によって pong 処理が遅れた正常な session を default では切断しなくなりました。運用環境の queue と decode latency を測定したうえで、正の timeout を明示設定することもできます。空の英語 timestamp segment による `IndexError` を防ぎ、隣接する subtitle word を読みやすい cue にまとめます。更新：`python -m pip install -U "funasr==1.4.6"`。GitHub Release には検証済みの llama.cpp v0.2.3 9 platform runtime archive も含まれます。[Release →](https://github.com/modelscope/FunASR/releases/tag/v1.4.6)
|
||||
- 2026/08/29：**llama.cpp runtime v0.2.3** — backend 初期化後に、model 読み込み、audio/VAD、graph の構築と割り当て、compute の各段階を即時 flush する境界ログを追加しました。`vulkan backend ready` 後に起きる Windows AMD Vulkan `0xC0000005` の発生箇所を絞り込むための診断であり、hardware 固有の crash が修正済みとはしていません。同一の exact commit から Linux、macOS、Windows 向け 9 archive を公開します。[トラブルシューティング →](./runtime/llama.cpp/README.md#optional-windows-vulkan-backend-for-sensevoicesmall) · [Release →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.3)
|
||||
|
||||
@@ -99,6 +99,7 @@ Whisper는 단일 모델이지만, **FunASR는 툴킷**입니다. 용도에 맞
|
||||
|
||||
## 최신 소식
|
||||
|
||||
- 2026/08/29: **llama.cpp runtime v0.2.5** — graph 실행 전에 host weight를 선택한 Vulkan backend buffer에 upload합니다. Q8/F16 weight는 Linux Vulkan llvmpipe에서 검증했으며, Linux, macOS, Windows용 archive 9개를 exact commit `f371370d4c5e4c61d13d4eb9c55cda2f4dd95e4f`에서 build하고 공개 SHA-256과 대조했습니다. AMD Windows hardware crash가 수정됐다고 주장하지 않으며, [#3479](https://github.com/modelscope/FunASR/issues/3479)는 제보자의 실제 hardware 재검증을 위해 open 상태를 유지합니다. [수정 →](https://github.com/modelscope/FunASR/pull/3555) · [Release →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5)
|
||||
- 2026/08/29: **llama.cpp runtime v0.2.4** — F16 GGUF model에서 transcript가 간헐적으로 비는 문제를 수정했습니다. Query embedding은 F16 storage를 F32로 읽지 않고 GGML F16/F32 type에 맞게 decode됩니다. 정확한 v0.2.3 AVX2 asset은 완료된 298회 실행 중 22회의 빈 출력을 재현했지만, 수정 후에는 100/100회 동일한 비어 있지 않은 결과를 냈고 Q8 model과 byte 단위로 일치했습니다. Release workflow가 동일한 exact commit에서 9개 platform archive를 빌드합니다. [수정 →](https://github.com/modelscope/FunASR/pull/3550) · [Release →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4)
|
||||
- 2026/08/29: **v1.4.6 PyPI 공개** — realtime WebSocket server는 20초 간격 ping을 유지하면서 decode queue 때문에 pong 처리가 늦어진 정상 session을 기본적으로 종료하지 않습니다. 운영 환경의 queue 및 decode latency를 측정한 뒤 양수 timeout을 명시적으로 설정할 수도 있습니다. 빈 영어 timestamp segment에서 발생하는 `IndexError`를 방지하고 인접 subtitle word를 읽기 쉬운 cue로 묶습니다. 업데이트: `python -m pip install -U "funasr==1.4.6"`. GitHub Release에는 검증된 llama.cpp v0.2.3 9개 platform runtime archive도 포함됩니다. [Release →](https://github.com/modelscope/FunASR/releases/tag/v1.4.6)
|
||||
- 2026/08/29: **llama.cpp runtime v0.2.3** — backend 초기화 이후 model load, audio/VAD, graph build와 allocation, compute 단계마다 즉시 flush되는 경계 로그를 추가했습니다. `vulkan backend ready` 이후 발생하는 Windows AMD Vulkan `0xC0000005`의 위치를 좁히기 위한 진단이며, hardware별 crash가 수정됐다고 주장하지 않습니다. 동일한 exact commit에서 Linux, macOS, Windows용 archive 9개를 공개합니다. [문제 해결 경계 →](./runtime/llama.cpp/README.md#optional-windows-vulkan-backend-for-sensevoicesmall) · [Release →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.3)
|
||||
|
||||
+2
-1
@@ -149,6 +149,7 @@ Whisper 是单个模型，**FunASR 是一个工具箱**——按场景挑模型
|
||||
|
||||
## 最新动态
|
||||
|
||||
- 2026/08/29：**llama.cpp runtime v0.2.5** — 在计算图执行前，将 host 权重上传到所选 Vulkan backend buffer。Q8 与 F16 权重已通过本地 Linux Vulkan llvmpipe 验证，九个 Linux、macOS 与 Windows 压缩包均由准确提交 `f371370d4c5e4c61d13d4eb9c55cda2f4dd95e4f` 构建，并按公开 SHA-256 逐一复核。本版本不宣称 AMD Windows 硬件崩溃已经修复；[#3479](https://github.com/modelscope/FunASR/issues/3479) 保持开放，等待报告者实机复测。[修复 →](https://github.com/modelscope/FunASR/pull/3555) · [发布页 →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5)
|
||||
- 2026/08/29：**llama.cpp runtime v0.2.4** — 修复 F16 GGUF 模型偶发空转写。运行时现在按 GGML 的 F16/F32 类型解码查询 embedding，不再把 F16 存储误读为 F32。精确的 v0.2.3 AVX2 发布包在 298 次完整运行中复现 22 次空结果；修复后 100/100 次输出稳定唯一，并与 Q8 模型逐字节一致。发布工作流将在同一准确提交上构建九个 Linux、macOS 与 Windows 压缩包。[修复 →](https://github.com/modelscope/FunASR/pull/3550) · [发布页 →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4)
|
||||
- 2026/08/29：**v1.4.6 已发布到 PyPI** — 实时 WebSocket 服务继续每 20 秒发送 ping，但当排队解码延迟 pong 处理时，默认不再误关仍健康的连接；运维人员仍可在测量生产队列与解码延迟后显式配置正数超时。本版本同时避免空英文时间戳片段触发 `IndexError`，并将相邻字幕词组合为更易读的字幕段。升级命令：`python -m pip install -U "funasr==1.4.6"`。GitHub 发布页同时提供已验证的 llama.cpp v0.2.3 九平台运行包。[发布页 →](https://github.com/modelscope/FunASR/releases/tag/v1.4.6)
|
||||
- 2026/08/29：**llama.cpp runtime v0.2.3** — 后端初始化完成后新增可立即刷新的阶段边界，覆盖模型加载、音频/VAD、计算图构建与分配、推理计算，可继续缩小发生在 `vulkan backend ready` 之后的 Windows AMD Vulkan `0xC0000005` 崩溃范围；本版本不宣称已经修复该硬件相关崩溃。九个 Linux、macOS 与 Windows 压缩包由同一准确提交构建并发布。[排障边界 →](./runtime/llama.cpp/README.md#optional-windows-vulkan-backend-for-sensevoicesmall) · [发布页 →](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.3)
|
||||
@@ -364,7 +365,7 @@ Windows Vulkan ZIP 使用显卡驱动提供的系统 Vulkan loader，不需要
|
||||
compute capability 12.0（`sm_120`），在专用 CUDA 产物发布前，请使用 CPU 包，或从
|
||||
源码构建并设置 `-DCMAKE_CUDA_ARCHITECTURES=120`。
|
||||
|
||||
**预编译二进制：** [Releases](https://github.com/modelscope/FunASR/releases) · [v0.2.4](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4) · [Linux Vulkan tarball](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-x64-vulkan.tar.gz) · [Windows Vulkan zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-vulkan.zip) · [Windows CUDA zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-cuda.zip) · **下载与快速开始：** [funasr.com/deploy/llama-cpp](https://www.funasr.com/deploy/llama-cpp.html) · **GGUF 模型：** [Hugging Face](https://huggingface.co/FunAudioLLM) · **文档与评测：** [runtime/llama.cpp/](./runtime/llama.cpp/)
|
||||
**预编译二进制：** [Releases](https://github.com/modelscope/FunASR/releases) · [v0.2.5](https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5) · [Linux Vulkan tarball](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-x64-vulkan.tar.gz) · [Windows Vulkan zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-vulkan.zip) · [Windows CUDA zip](https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-cuda.zip) · **下载与快速开始：** [funasr.com/deploy/llama-cpp](https://www.funasr.com/deploy/llama-cpp.html) · **GGUF 模型：** [Hugging Face](https://huggingface.co/FunAudioLLM) · **文档与评测：** [runtime/llama.cpp/](./runtime/llama.cpp/)
|
||||
|
||||
[OpenAI API 示例 →](./examples/openai_api/README_zh.md) · [Gradio Demo →](./examples/openai_api/GRADIO_zh.md) · [客户端配方 →](./examples/openai_api/CLIENTS.md) · [JavaScript/TypeScript 配方 →](./examples/openai_api/JAVASCRIPT_zh.md) · [Kubernetes 模板 →](./examples/openai_api/kubernetes/README_zh.md) · [工作流配方 →](./examples/openai_api/WORKFLOWS_zh.md) · [Postman 集合 →](./examples/openai_api/POSTMAN_zh.md) · [OpenAPI 规范 →](./examples/openai_api/OPENAPI_zh.md) · [安全指南 →](./examples/openai_api/SECURITY_zh.md) · [部署选型 →](./docs/deployment_matrix_zh.md) · [部署文档 →](./runtime/readme_cn.md) · [Agent 集成 →](https://modelscope.github.io/FunASR/agent.html)
|
||||
|
||||
|
||||
@@ -1 +1 @@
|
||||
runtime-llamacpp-v0.2.4
|
||||
runtime-llamacpp-v0.2.5
|
||||
|
||||
@@ -170,8 +170,8 @@ assert_readme_quickstart() {
|
||||
printf 'non-portable Releases link in %s\n' "$readme" >&2
|
||||
exit 1
|
||||
fi
|
||||
if ! grep -F 'runtime-llamacpp-v0.2.4' <<<"$section" >/dev/null; then
|
||||
printf 'missing current runtime v0.2.4 link in %s\n' "$readme" >&2
|
||||
if ! grep -F 'runtime-llamacpp-v0.2.5' <<<"$section" >/dev/null; then
|
||||
printf 'missing current runtime v0.2.5 link in %s\n' "$readme" >&2
|
||||
exit 1
|
||||
fi
|
||||
if ! grep -F 'funasr-llamacpp-linux-x64-vulkan' <<<"$section" >/dev/null; then
|
||||
|
||||
@@ -254,28 +254,29 @@
|
||||
"models": ["SenseVoiceSmall-GGUF", "Paraformer-GGUF", "Fun-ASR-Nano-GGUF", "FSMN-VAD-GGUF"],
|
||||
"operating_systems": ["Linux", "macOS", "Windows"],
|
||||
"interfaces": ["CLI", "local HTTP server"],
|
||||
"tested": {"funasr": "runtime-llamacpp-v0.2.4", "runtime": "llama.cpp@c8d43b10", "verified": "2026-08-29"},
|
||||
"tested": {"funasr": "runtime-llamacpp-v0.2.5", "runtime": "llama.cpp@c8d43b10", "verified": "2026-08-29"},
|
||||
"commands": {
|
||||
"install": ["curl -fLO https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-x64.tar.gz", "echo \"51951c8d916b4babd873780b2070b03351cf0e7fda572955c81c120439158d7e funasr-llamacpp-linux-x64.tar.gz\" | sha256sum -c -", "mkdir funasr-llamacpp && tar -xzf funasr-llamacpp-linux-x64.tar.gz -C funasr-llamacpp && cd funasr-llamacpp && bash download-funasr-model.sh sensevoice ./funasr-gguf f16"],
|
||||
"install": ["curl -fLO https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-x64.tar.gz", "echo \"69d47bf724216093bedc89a50efe0a97c80a2f4b89367378a72d2d3d94e4f241 funasr-llamacpp-linux-x64.tar.gz\" | sha256sum -c -", "mkdir funasr-llamacpp && tar -xzf funasr-llamacpp-linux-x64.tar.gz -C funasr-llamacpp && cd funasr-llamacpp && bash download-funasr-model.sh sensevoice ./funasr-gguf f16"],
|
||||
"launch": ["cd funasr-llamacpp && ./llama-funasr-sensevoice -m funasr-gguf/sensevoice-small-f16.gguf --vad funasr-gguf/fsmn-vad.gguf -a sample.wav"],
|
||||
"health": ["cd funasr-llamacpp && ./llama-funasr-sensevoice --help"],
|
||||
"smoke": ["cd funasr-llamacpp && ./llama-funasr-sensevoice -m funasr-gguf/sensevoice-small-f16.gguf --vad funasr-gguf/fsmn-vad.gguf -a sample.wav | tee transcript.txt && test -s transcript.txt"]
|
||||
},
|
||||
"downloads": [
|
||||
{"operating_system": "Linux", "architecture": "arm64", "backend": "CPU", "archive": "funasr-llamacpp-linux-arm64.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-arm64.tar.gz", "sha256": "acdda3aae906ab77ae99852336d4989a863e4125182ffc74ec6523aa6f9c8353"},
|
||||
{"operating_system": "Linux", "architecture": "x64", "backend": "CPU", "archive": "funasr-llamacpp-linux-x64.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-x64.tar.gz", "sha256": "51951c8d916b4babd873780b2070b03351cf0e7fda572955c81c120439158d7e"},
|
||||
{"operating_system": "Linux", "architecture": "x64 AVX2", "backend": "CPU", "archive": "funasr-llamacpp-linux-x64-avx2.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-x64-avx2.tar.gz", "sha256": "fec98150cd2fe845df0150e950faf17319a46b67a8c621ad24c659ba26a1ab72"},
|
||||
{"operating_system": "Linux", "architecture": "x64", "backend": "Vulkan", "archive": "funasr-llamacpp-linux-x64-vulkan.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-linux-x64-vulkan.tar.gz", "sha256": "169f8a6532a31d9c4a9bf6ecfe5db9949f0bf78d362dc6791ef6ac4ee42faa48"},
|
||||
{"operating_system": "macOS", "architecture": "arm64", "backend": "CPU", "archive": "funasr-llamacpp-macos-arm64.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-macos-arm64.tar.gz", "sha256": "d58dda9da783733d59797bbec49568cf3984c3b783ab152f039b22c24d3ac10e"},
|
||||
{"operating_system": "Windows", "architecture": "x64", "backend": "CPU", "archive": "funasr-llamacpp-windows-x64.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64.zip", "sha256": "7beb08c3d7376643b69a4b280ea85a426e8d7cbef694290e5aa3c8d3589c75cd"},
|
||||
{"operating_system": "Windows", "architecture": "x64 AVX2", "backend": "CPU", "archive": "funasr-llamacpp-windows-x64-avx2.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-avx2.zip", "sha256": "97b4783ec5366be637621afad213ed4f3427bee1ff49e2d4f1561535fe96842c"},
|
||||
{"operating_system": "Windows", "architecture": "x64", "backend": "Vulkan", "archive": "funasr-llamacpp-windows-x64-vulkan.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-vulkan.zip", "sha256": "a1b46b31c31b32cac2e91e07b5718afb9289f47f9d22122da8ab20f630d37276"},
|
||||
{"operating_system": "Windows", "architecture": "x64", "backend": "CUDA", "archive": "funasr-llamacpp-windows-x64-cuda.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/funasr-llamacpp-windows-x64-cuda.zip", "sha256": "6c4b1bbc68a27d6acf5588e3195b85229d128ec5f576d8e47ba71611a206e1f1"}
|
||||
{"operating_system": "Linux", "architecture": "arm64", "backend": "CPU", "archive": "funasr-llamacpp-linux-arm64.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-arm64.tar.gz", "sha256": "4350ed49b1220374231ddafc84fed2dbe6a1d5e19d830edcb6a252d19d78b5db"},
|
||||
{"operating_system": "Linux", "architecture": "x64", "backend": "CPU", "archive": "funasr-llamacpp-linux-x64.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-x64.tar.gz", "sha256": "69d47bf724216093bedc89a50efe0a97c80a2f4b89367378a72d2d3d94e4f241"},
|
||||
{"operating_system": "Linux", "architecture": "x64 AVX2", "backend": "CPU", "archive": "funasr-llamacpp-linux-x64-avx2.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-x64-avx2.tar.gz", "sha256": "f9bb3fe78776ef86feb334b02488d3b1a5c16926a9a1cc79b3d5b1219ef1fb30"},
|
||||
{"operating_system": "Linux", "architecture": "x64", "backend": "Vulkan", "archive": "funasr-llamacpp-linux-x64-vulkan.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-linux-x64-vulkan.tar.gz", "sha256": "88cd52ba1ce92af9bf344944521a9d47ed9ceb424b312a5993369228c1e8c4fb"},
|
||||
{"operating_system": "macOS", "architecture": "arm64", "backend": "CPU", "archive": "funasr-llamacpp-macos-arm64.tar.gz", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-macos-arm64.tar.gz", "sha256": "c6b3cea2c5238ae48175c931365231b1c47351f95ca289455536de0a959648af"},
|
||||
{"operating_system": "Windows", "architecture": "x64", "backend": "CPU", "archive": "funasr-llamacpp-windows-x64.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64.zip", "sha256": "dc90e85bc9a22477c5a8b556427fa5a6e0caf8951b5b6ec0237317406ce11bf5"},
|
||||
{"operating_system": "Windows", "architecture": "x64 AVX2", "backend": "CPU", "archive": "funasr-llamacpp-windows-x64-avx2.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-avx2.zip", "sha256": "6f19b8af0ce623122c767a0160bb8faabbc9666ae4f0cef1675cdf6250a9ea26"},
|
||||
{"operating_system": "Windows", "architecture": "x64", "backend": "Vulkan", "archive": "funasr-llamacpp-windows-x64-vulkan.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-vulkan.zip", "sha256": "d51e34afed66c0898dba3d944cb17d2abc92c5fb7758fa4ee376561d5ce35a4c"},
|
||||
{"operating_system": "Windows", "architecture": "x64", "backend": "CUDA", "archive": "funasr-llamacpp-windows-x64-cuda.zip", "url": "https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/funasr-llamacpp-windows-x64-cuda.zip", "sha256": "3bb704e6b86f2e2e613aba84c361a51273e729c107183c7b69a1f2781c95cce8"}
|
||||
],
|
||||
"evidence": [
|
||||
{"label": "llama.cpp runtime", "url": "https://github.com/modelscope/FunASR/blob/main/runtime/llama.cpp/README.md"},
|
||||
{"label": "runtime v0.2.4 release", "url": "https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.4"},
|
||||
{"label": "nine-platform release workflow", "url": "https://github.com/modelscope/FunASR/actions/runs/33231441888"},
|
||||
{"label": "runtime v0.2.5 release", "url": "https://github.com/modelscope/FunASR/releases/tag/runtime-llamacpp-v0.2.5"},
|
||||
{"label": "nine-platform release workflow", "url": "https://github.com/modelscope/FunASR/actions/runs/33256725222"},
|
||||
{"label": "Vulkan weight upload fix", "url": "https://github.com/modelscope/FunASR/pull/3555"},
|
||||
{"label": "F16 empty-transcript fix", "url": "https://github.com/modelscope/FunASR/pull/3550"},
|
||||
{"label": "regression tests", "url": "https://github.com/modelscope/FunASR/tree/main/runtime/llama.cpp/tests"}
|
||||
],
|
||||
@@ -323,11 +324,11 @@
|
||||
"translations": {
|
||||
"zh": {
|
||||
"name": "llama.cpp / GGUF 独立运行",
|
||||
"summary": "使用 v0.2.4 的九个预编译包或源码构建，在 CPU、Vulkan、CUDA 和边缘设备上运行 FunASR GGUF 模型。",
|
||||
"summary": "使用 v0.2.5 的九个预编译包或源码构建，在 CPU、Vulkan、CUDA 和边缘设备上运行 FunASR GGUF 模型。",
|
||||
"fit": ["不依赖 Python ML 环境", "桌面应用和离线边缘部署", "需要 Linux、macOS、Windows 的 CPU、Vulkan 或 CUDA 发布包"],
|
||||
"not_fit": ["需要 vLLM 式大批量 GPU 调度", "未验证目标 GPU 架构的通用预编译 CUDA 包", "必须使用完整 Python 模型生态的流程"],
|
||||
"selection_reason": "GGUF 运行时和独立二进制优先满足可移植、离线和低依赖部署。",
|
||||
"primary_limitation": "v0.2.4 修复 F16 GGUF 查询 embedding 被当作 F32 读取所导致的偶发空转写，但不宣称已经修复 RX 9070 XT 等 AMD Windows 0xC0000005 崩溃；Android/Mali 也不是本版预编译或验证目标。",
|
||||
"primary_limitation": "v0.2.5 将 host 权重上传到所选 Vulkan backend buffer，并在 Linux llvmpipe 上通过 Q8/F16 验证，但不宣称已经修复 RX 9070 XT 等 AMD Windows 0xC0000005 崩溃；Android/Mali 也不是本版预编译或验证目标。",
|
||||
"status_label": "生产验证",
|
||||
"operations": ["按页面列出的 SHA-256 校验九个发布资产", "模型和二进制使用同一发布清单", "保留旧二进制和模型目录用于回滚"],
|
||||
"security": ["默认只读取本地音频和模型", "HTTP 服务绑定内网地址并限制上传大小", "不要从不可信地址加载 GGUF"],
|
||||
@@ -335,11 +336,11 @@
|
||||
},
|
||||
"en": {
|
||||
"name": "llama.cpp / GGUF standalone",
|
||||
"summary": "Use the nine v0.2.4 release packages or source builds to run FunASR GGUF models on CPU, Vulkan, CUDA, and edge devices.",
|
||||
"summary": "Use the nine v0.2.5 release packages or source builds to run FunASR GGUF models on CPU, Vulkan, CUDA, and edge devices.",
|
||||
"fit": ["No Python ML environment", "Desktop applications and offline edge deployment", "CPU, Vulkan, or CUDA packages for Linux, macOS, and Windows"],
|
||||
"not_fit": ["vLLM-style large GPU batch scheduling", "A universal prebuilt CUDA package for an unverified GPU architecture", "Workflows that require the full Python model ecosystem"],
|
||||
"selection_reason": "GGUF runtimes and standalone binaries prioritize portability, offline use, and low dependency count.",
|
||||
"primary_limitation": "v0.2.4 fixes intermittent empty transcripts caused by reading F16 GGUF query embeddings as F32, but does not claim to fix RX 9070 XT or every AMD Windows 0xC0000005 crash; Android/Mali is not a prebuilt or validated target.",
|
||||
"primary_limitation": "v0.2.5 uploads host weights into the selected Vulkan backend buffer and passes Q8/F16 validation on Linux llvmpipe, but does not claim to fix RX 9070 XT or every AMD Windows 0xC0000005 crash; Android/Mali is not a prebuilt or validated target.",
|
||||
"status_label": "Production verified",
|
||||
"operations": ["Verify all nine release assets against the listed SHA-256 values", "Keep models and binaries on the same release manifest", "Retain the previous binary and model directory for rollback"],
|
||||
"security": ["Read local audio and models by default", "Bind the HTTP server to a private address and limit uploads", "Do not load GGUF files from untrusted sources"],
|
||||
|
||||
@@ -135,13 +135,13 @@ for (const viewport of [
|
||||
{ name: 'mobile', width: 390, height: 844 },
|
||||
{ name: 'desktop', width: 1440, height: 900 },
|
||||
]) {
|
||||
test(`llama.cpp v0.2.4 download matrix is stable at ${viewport.name}`, async ({ page }, testInfo) => {
|
||||
test(`llama.cpp v0.2.5 download matrix is stable at ${viewport.name}`, async ({ page }, testInfo) => {
|
||||
await page.setViewportSize(viewport);
|
||||
await page.goto('/deploy/llama-cpp.html');
|
||||
|
||||
const section = page.locator('[data-section="downloads"]');
|
||||
await expect(section.locator('[data-download-asset]')).toHaveCount(9);
|
||||
await expect(section.locator('a[href*="runtime-llamacpp-v0.2.4"]')).toHaveCount(9);
|
||||
await expect(section.locator('a[href*="runtime-llamacpp-v0.2.5"]')).toHaveCount(9);
|
||||
await expect(page.getByText('Windows AMD Vulkan', { exact: false }).first()).toBeVisible();
|
||||
await expect(page.getByText('resolving buffer type', { exact: false }).first()).toBeVisible();
|
||||
await expect(page.getByText('model ready', { exact: false }).first()).toBeVisible();
|
||||
|
||||
@@ -158,14 +158,14 @@ def test_realtime_page_publishes_verified_v142_quickstart(built_site):
|
||||
('en/deploy/llama-cpp.html', 'Windows AMD'),
|
||||
),
|
||||
)
|
||||
def test_llama_cpp_pages_render_v024_download_matrix(built_site, relative, boundary):
|
||||
def test_llama_cpp_pages_render_v025_download_matrix(built_site, relative, boundary):
|
||||
soup = read_soup(built_site / relative)
|
||||
section = soup.select_one('[data-section="downloads"]')
|
||||
|
||||
assert section
|
||||
rows = section.select('[data-download-asset]')
|
||||
assert len(rows) == 9
|
||||
assert all(row.select_one('a[href*="runtime-llamacpp-v0.2.4"]') for row in rows)
|
||||
assert all(row.select_one('a[href*="runtime-llamacpp-v0.2.5"]') for row in rows)
|
||||
assert all(len(row.select_one('[data-field="sha256"]').get_text(strip=True)) == 64 for row in rows)
|
||||
assert boundary in soup.get_text(' ', strip=True)
|
||||
text = soup.get_text(' ', strip=True)
|
||||
|
||||
@@ -271,30 +271,30 @@ def test_sensevoice_tensorrt_contract_tracks_merged_native_runtime(valid_registr
|
||||
assert 'tensorrt version' in limitation
|
||||
|
||||
|
||||
def test_llama_cpp_contract_tracks_v024_release_assets(valid_registry):
|
||||
def test_llama_cpp_contract_tracks_v025_release_assets(valid_registry):
|
||||
entry = next(item for item in valid_registry['deployments'] if item['id'] == 'llama-cpp')
|
||||
|
||||
assert entry['tested'] == {
|
||||
'funasr': 'runtime-llamacpp-v0.2.4',
|
||||
'funasr': 'runtime-llamacpp-v0.2.5',
|
||||
'runtime': 'llama.cpp@c8d43b10',
|
||||
'verified': '2026-08-29',
|
||||
}
|
||||
assert len(entry['downloads']) == 9
|
||||
assert {item['archive']: item['sha256'] for item in entry['downloads']} == {
|
||||
'funasr-llamacpp-linux-arm64.tar.gz': 'acdda3aae906ab77ae99852336d4989a863e4125182ffc74ec6523aa6f9c8353',
|
||||
'funasr-llamacpp-linux-x64.tar.gz': '51951c8d916b4babd873780b2070b03351cf0e7fda572955c81c120439158d7e',
|
||||
'funasr-llamacpp-linux-x64-avx2.tar.gz': 'fec98150cd2fe845df0150e950faf17319a46b67a8c621ad24c659ba26a1ab72',
|
||||
'funasr-llamacpp-linux-x64-vulkan.tar.gz': '169f8a6532a31d9c4a9bf6ecfe5db9949f0bf78d362dc6791ef6ac4ee42faa48',
|
||||
'funasr-llamacpp-macos-arm64.tar.gz': 'd58dda9da783733d59797bbec49568cf3984c3b783ab152f039b22c24d3ac10e',
|
||||
'funasr-llamacpp-windows-x64.zip': '7beb08c3d7376643b69a4b280ea85a426e8d7cbef694290e5aa3c8d3589c75cd',
|
||||
'funasr-llamacpp-windows-x64-avx2.zip': '97b4783ec5366be637621afad213ed4f3427bee1ff49e2d4f1561535fe96842c',
|
||||
'funasr-llamacpp-windows-x64-vulkan.zip': 'a1b46b31c31b32cac2e91e07b5718afb9289f47f9d22122da8ab20f630d37276',
|
||||
'funasr-llamacpp-windows-x64-cuda.zip': '6c4b1bbc68a27d6acf5588e3195b85229d128ec5f576d8e47ba71611a206e1f1',
|
||||
'funasr-llamacpp-linux-arm64.tar.gz': '4350ed49b1220374231ddafc84fed2dbe6a1d5e19d830edcb6a252d19d78b5db',
|
||||
'funasr-llamacpp-linux-x64.tar.gz': '69d47bf724216093bedc89a50efe0a97c80a2f4b89367378a72d2d3d94e4f241',
|
||||
'funasr-llamacpp-linux-x64-avx2.tar.gz': 'f9bb3fe78776ef86feb334b02488d3b1a5c16926a9a1cc79b3d5b1219ef1fb30',
|
||||
'funasr-llamacpp-linux-x64-vulkan.tar.gz': '88cd52ba1ce92af9bf344944521a9d47ed9ceb424b312a5993369228c1e8c4fb',
|
||||
'funasr-llamacpp-macos-arm64.tar.gz': 'c6b3cea2c5238ae48175c931365231b1c47351f95ca289455536de0a959648af',
|
||||
'funasr-llamacpp-windows-x64.zip': 'dc90e85bc9a22477c5a8b556427fa5a6e0caf8951b5b6ec0237317406ce11bf5',
|
||||
'funasr-llamacpp-windows-x64-avx2.zip': '6f19b8af0ce623122c767a0160bb8faabbc9666ae4f0cef1675cdf6250a9ea26',
|
||||
'funasr-llamacpp-windows-x64-vulkan.zip': 'd51e34afed66c0898dba3d944cb17d2abc92c5fb7758fa4ee376561d5ce35a4c',
|
||||
'funasr-llamacpp-windows-x64-cuda.zip': '3bb704e6b86f2e2e613aba84c361a51273e729c107183c7b69a1f2781c95cce8',
|
||||
}
|
||||
assert all(item['url'].startswith(
|
||||
'https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.4/'
|
||||
'https://github.com/modelscope/FunASR/releases/download/runtime-llamacpp-v0.2.5/'
|
||||
) for item in entry['downloads'])
|
||||
assert any('actions/runs/33231441888' in item['url'] for item in entry['evidence'])
|
||||
assert any('actions/runs/33256725222' in item['url'] for item in entry['evidence'])
|
||||
assert any(
|
||||
'download-funasr-model.sh sensevoice ./funasr-gguf f16' in command
|
||||
for command in entry['commands']['install']
|
||||
|
||||
Reference in New Issue
Block a user