[GH-ISSUE #2651] [BUG]: Can‘t use speech-to-text #1719

Closed
opened 2026-02-22 18:26:13 -05:00 by yindo · 5 comments
Owner

Originally created by @Kurasa632 on GitHub (Nov 19, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2651

How are you running AnythingLLM?

Docker (local)

What happened?

When I use STT for input.The error is shown in the figure below.
企业微信截图_17320057285826

Are there known steps to reproduce?

No response

Originally created by @Kurasa632 on GitHub (Nov 19, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2651 ### How are you running AnythingLLM? Docker (local) ### What happened? When I use STT for input.The error is shown in the figure below. ![企业微信截图_17320057285826](https://github.com/user-attachments/assets/4baba129-66bb-4858-a6d8-e0de8892f386) ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:26:13 -05:00
yindo closed this issue 2026-02-22 18:26:13 -05:00
Author
Owner

@timothycarambat commented on GitHub (Nov 19, 2024):

You are either offline or cannot download the model from HuggingFace (which is where it comes from). When you use STT for the first time it streams and stores the ONNX of whisper-tiny so you can use it. It is not pre-loaded into the application since not everyone uses it.

If you have internet connectivity issues or are prevented from reaching hf.co/** endpoints (by ISP or VPN) will result in this issue. We do not mirror this model to a fallback URL, so its HF or nothing

@timothycarambat commented on GitHub (Nov 19, 2024): You are either offline or cannot download the model from HuggingFace (which is where it comes from). When you use STT for the first time it streams and stores the ONNX of whisper-tiny so you can use it. It is not pre-loaded into the application since not everyone uses it. If you have internet connectivity issues or are prevented from reaching hf.co/** endpoints (by ISP or VPN) will result in this issue. We do not mirror this model to a fallback URL, so its HF or nothing
Author
Owner

@Kurasa632 commented on GitHub (Nov 19, 2024):

You are either offline or cannot download the model from HuggingFace (which is where it comes from). When you use STT for the first time it streams and stores the ONNX of whisper-tiny so you can use it. It is not pre-loaded into the application since not everyone uses it.

If you have internet connectivity issues or are prevented from reaching hf.co/** endpoints (by ISP or VPN) will result in this issue. We do not mirror this model to a fallback URL, so its HF or nothing

If I manually download whisper-tiny, where should I put it?

@Kurasa632 commented on GitHub (Nov 19, 2024): > You are either offline or cannot download the model from HuggingFace (which is where it comes from). When you use STT for the first time it streams and stores the ONNX of whisper-tiny so you can use it. It is not pre-loaded into the application since not everyone uses it. > > If you have internet connectivity issues or are prevented from reaching hf.co/** endpoints (by ISP or VPN) will result in this issue. We do not mirror this model to a fallback URL, so its HF or nothing If I manually download whisper-tiny, where should I put it?
Author
Owner

@Kurasa632 commented on GitHub (Nov 25, 2024):

in volume

Does the desktop support STT (Speech - to - Text)?

@Kurasa632 commented on GitHub (Nov 25, 2024): > in volume Does the desktop support STT (Speech - to - Text)?
Author
Owner

@shengyu27 commented on GitHub (Nov 28, 2024):

I have the same problem. Can anything help? Or does anyone have any solutions?

@shengyu27 commented on GitHub (Nov 28, 2024): I have the same problem. Can anything help? Or does anyone have any solutions?
Author
Owner

@ethanfrey commented on GitHub (Jan 17, 2025):

I have the same problem on Desktop and do not have any hf connectivity issues.
The error message is: Cannot find fine "http://localhost:3001/static/stt/models/Xenova/whisper-tiny.en/tokenizer.json".

I discovered the internal storage is available (under Linux) at: $HOME/.config/anythingllm-desktop/storage

In particular, it seems the whisper stuff is available at: $HOME/.config/anythingllm-desktop/storage/models/Xenova

@ethanfrey commented on GitHub (Jan 17, 2025): I have the same problem on Desktop and do not have any hf connectivity issues. The error message is: Cannot find fine "http://localhost:3001/static/stt/models/Xenova/whisper-tiny.en/tokenizer.json". I discovered the internal storage is available (under Linux) at: `$HOME/.config/anythingllm-desktop/storage` In particular, it seems the whisper stuff is available at: `$HOME/.config/anythingllm-desktop/storage/models/Xenova`
yindo changed title from [BUG]: Can‘t use speech-to-text to [GH-ISSUE #2651] [BUG]: Can‘t use speech-to-text 2026-06-05 14:42:18 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1719