Commit Graph
27 Commits
Author SHA1 Message Date
LauraGPT b28d764bad docs: surface current runtime packages in ja and ko
Signed-off-by: LauraGPT <[email protected]>
2026-09-01 18:32:38 +00:00
LauraGPT 2d14544f38 docs(runtime): publish v0.2.6 download matrix
Signed-off-by: LauraGPT <[email protected]>
2026-08-30 03:32:30 +00:00
LauraGPT c0b0174738 fix(runtime): bundle Windows CUDA dependencies
Signed-off-by: LauraGPT <[email protected]>
2026-08-30 02:34:31 +00:00
LauraGPT c567595900 feat(runtime): add Windows Blackwell CUDA asset
Signed-off-by: LauraGPT <[email protected]>
2026-08-30 01:48:01 +00:00
LauraGPT 36f03086af docs(runtime): publish verified v0.2.5 download matrix
Signed-off-by: LauraGPT <[email protected]>
2026-08-29 15:02:09 +00:00
LauraGPT 949ccf46f3 fix(runtime): upload SenseVoice weights to backend buffer
Signed-off-by: LauraGPT <[email protected]>
2026-08-29 13:26:37 +00:00
LauraGPT d15175f361 docs(runtime): prepare llama.cpp v0.2.4 release
Signed-off-by: LauraGPT <[email protected]>
2026-08-29 03:25:09 +00:00
LauraGPT 178a36718c fix(runtime): decode SenseVoice F16 query embeddings
Signed-off-by: LauraGPT <[email protected]>
2026-08-29 02:40:29 +00:00
LauraGPT cabecbf133 test(runtime): track v0.2.3 release contract
Signed-off-by: LauraGPT <[email protected]>
2026-08-28 17:58:13 +00:00
LauraGPT 7429dbd787 fix(runtime): trace SenseVoice backend stages
Signed-off-by: LauraGPT <[email protected]>
2026-08-28 17:14:09 +00:00
LauraGPT 0395c59eb7 fix(vulkan): guard backend initialization failures
Signed-off-by: LauraGPT <[email protected]>
2026-08-28 14:49:31 +00:00
zhifu gaoandLauraGPT b454f9b7d6 docs: publish llama.cpp runtime v0.2.1 downloads (#3532)
Signed-off-by: LauraGPT <[email protected]>
Co-authored-by: LauraGPT <[email protected]>
2026-08-27 17:32:44 +08:00
zhifu gao c69e69a0b7 fix(runtime): allow integrated GPU backends (#3531)
Prefer matching discrete GPU devices while retaining a matching integrated GPU as fallback. Tested with the pinned llama.cpp revision in CPU and Vulkan builds; this addresses the iGPU selector bug without claiming to fix the separate RX 9070 XT backend crash.
2026-08-27 00:55:09 +08:00
zhifu gao 62b784b2b9 docs: surface llama.cpp runtime v0.2.0 (#3484)
Signed-off-by: LauraGPT <[email protected]>
2026-08-11 14:17:59 +08:00
zhifu gao 6c3b47c2e5 docs: publish runtime v0.1.9 download links (#3399) 2026-07-23 19:38:51 +08:00
zhifu gao 9b918d74d7 feat(runtime): publish Windows Vulkan binary (#3398)
* feat(runtime): add Windows Vulkan release asset

* fix(ci): install SPIR-V headers for Windows Vulkan

* fix(runtime): make Windows Vulkan package standalone
2026-07-23 18:49:28 +08:00
zhifu gao 5882f3cf79 docs: surface Vulkan llama.cpp runtime in README
Expose the v0.1.8 Linux Vulkan runtime asset in the top-level README docs.
2026-07-22 19:25:17 +08:00
zhifu gao c7f6edb9e6 docs(runtime): mention Vulkan asset in release notes
Keep generated runtime release notes aligned with the new Linux Vulkan asset.
2026-07-22 18:44:03 +08:00
zhifu gao e3327be1bd feat(runtime): add Vulkan llama.cpp backend packaging
Add Linux Vulkan packaging and runtime selection for the FunASR llama.cpp SenseVoice GGUF backend.
2026-07-22 18:40:34 +08:00
zhifu gao b798e2679f feat(runtime): add GGUF HTTP transcription wrapper
Expose the llama.cpp/GGUF command-line binaries through a lightweight OpenAI-compatible transcription endpoint.
2026-07-22 18:16:22 +08:00
zhifu gao a2a6ba3ddf docs: clarify Windows CUDA GPU architecture support
Document the current sm_86 Windows CUDA prebuilt limit and direct RTX 50 / Blackwell users to CPU binaries or source builds with CMAKE_CUDA_ARCHITECTURES=120 until a dedicated asset is available.
2026-07-19 18:39:13 +08:00
zhifu gao f1e287edc2 Add Windows CUDA llama.cpp release asset
Adds a Windows x64 CUDA release asset for the llama.cpp SenseVoice runtime, with CUDA Toolkit setup, architecture-86 build flags, focused SenseVoice target packaging, docs, and workflow regression tests. Manual workflow dispatch 29656771776 passed all build matrix jobs including build-windows-x64-cuda.
2026-07-19 03:24:07 +08:00
zhifu gao 57721fc8ce Add SenseVoice llama.cpp backend selector (#3247) 2026-07-18 19:16:03 +08:00
zhifu gao 68a21aafbb docs(llama.cpp): fix default GGUF quickstart (#3234)
* docs(llama.cpp): fix default GGUF quickstart

Signed-off-by: 游雁 <[email protected]>

* fix(llama.cpp): make release quickstart executable

Signed-off-by: 游雁 <[email protected]>

* fix(llama.cpp): validate Windows release layout

Signed-off-by: 游雁 <[email protected]>

* test(llama.cpp): require runnable quickstart lines

Signed-off-by: 游雁 <[email protected]>

---------

Signed-off-by: 游雁 <[email protected]>
2026-07-15 20:15:07 +08:00
游雁 916c175ec9 test(llama.cpp): validate downloader failure paths 2026-07-15 04:35:18 +00:00
游雁 9c17931645 fix(llama.cpp): download one GGUF variant by default 2026-07-15 04:28:57 +00:00
zhifu gao 3610b759ce test: numerical regression harness (frozen golden vs ggml/VAD/CIF/CTC output) (#3003)
* test: numerical regression harness (frozen golden vs ggml/VAD/CIF/CTC output)

Adds tests/ — runs each runtime tool on a fixed 6 s clip and diffs against frozen
golden output, catching regressions in the ggml graphs, the FSMN-VAD state machine,
the CIF predictor and CTC decode.

- tests/run_regression.sh: auto-detects which tools are built; VAD model is auto-fetched
  (1.7 MB), ASR GGUFs tested when present or with RUN_FULL=1 (downloads from HF).
  Non-zero exit on any mismatch. BIN_DIR/MODELS_DIR overridable.
- tests/sample.wav (~6 s) + tests/golden/*.txt: golden captured on Linux x86-64 with the
  f16 GGUFs from FunAudioLLM/*-GGUF.

Verified locally: all present tools PASS; default mode fetches VAD + skips absent models.

* test: golden as text (binaries now detok in-process; merge after in-binary-detok)

* test: fix sensevoice golden (correct transcription text)
2026-06-20 16:12:24 +08:00