langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-22 04:25:29 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

window use docker run Text To Speech by Xinference #10488

New Issue
Closed
opened 2026-02-21 18:47:31 -05:00 by yindo · 0 comments
yindo commented 2026-02-21 18:47:31 -05:00
Owner
Copy Link
Copy Source

Originally created by @kfchandsome on GitHub (Mar 12, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.15.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I use the text to speech module in dify and call the CosyVoice2-0.5B model in Xinference, but the error ImportError: Failed to intialize FFmpeg extension is reported during actual operation, and i can not select a voice in options.

✔️ Expected Behavior

how to fix ImportError: Failed to intialize FFmpeg extension? i try to sudo apt-get install FFmpeg in docker containers, but it not work.

❌ Actual Behavior

2025-03-11 21:25:48,206 xinference.core.supervisor 54 DEBUG    [request 12c6bb58-fefa-11ef-a475-0242ac110002] Enter get_model, args: <xinference.core.supervisor.Supervi
sorActor object at 0x7ff8b6f51030>,CosyVoice2-0.5B, kwargs:
2025-03-11 21:25:48,207 xinference.core.worker 54 DEBUG    Enter get_model, args: <xinference.core.worker.WorkerActor object at 0x7ff8b6f532e0>, kwargs: model_uid=CosyV
oice2-0.5B-0
2025-03-11 21:25:48,207 xinference.core.worker 54 DEBUG    Leave get_model, elapsed time: 0 s
2025-03-11 21:25:48,207 xinference.core.supervisor 54 DEBUG    [request 12c6bb58-fefa-11ef-a475-0242ac110002] Leave get_model, elapsed time: 0 s
2025-03-11 21:25:48,209 xinference.core.model 74 DEBUG    Request speech, current serve request count: 0, request limit: inf for the model CosyVoice2-0.5B-0
2025-03-11 21:25:48,209 xinference.core.model 74 DEBUG    [request 12c72ea8-fefa-11ef-b39b-0242ac110002] Enter speech, args: ModelActor(CosyVoice2-0.5B-0), kwargs: inpu
t=hello,voice=,response_format=mp3,speed=1.0,stream=True
2025-03-11 21:25:48,236 xinference.model.audio.cosyvoice 74 INFO     Auto select speaker: 中文女
2025-03-11 21:25:48,237 xinference.model.audio.cosyvoice 74 INFO     CosyVoice inference_sft
2025-03-11 21:25:48,237 xinference.core.model 74 DEBUG    [request 12c72ea8-fefa-11ef-b39b-0242ac110002] Leave speech, elapsed time: 0 s
2025-03-11 21:25:48,237 DEBUG Create generator: 12cb73e6fefa11efb39b0242ac110002
2025-03-11 21:25:48,237 xinference.core.model 74 DEBUG    After request speech, current serve request count: 0 for the model CosyVoice2-0.5B-0
2025-03-11 21:25:48,238 DEBUG Loading FFmpeg6
2025-03-11 21:25:48,239 DEBUG Failed to load FFmpeg6 extension.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 116, in _find_ffmpeg_extension
    ext = _find_versionsed_ffmpeg_extension(ffmpeg_ver)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 108, in _find_versionsed_ffmpeg_extension
    _load_lib(lib)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 94, in _load_lib
    torch.ops.load_library(path)
  File "/usr/local/lib/python3.10/dist-packages/torch/_ops.py", line 1350, in load_library
    ctypes.CDLL(path)
  File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libavutil.so.58: cannot open shared object file: No such file or directory
2025-03-11 21:25:48,263 DEBUG Loading FFmpeg5
2025-03-11 21:25:48,264 DEBUG Failed to load FFmpeg5 extension.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 116, in _find_ffmpeg_extension
    ext = _find_versionsed_ffmpeg_extension(ffmpeg_ver)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 108, in _find_versionsed_ffmpeg_extension
    _load_lib(lib)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 94, in _load_lib
    torch.ops.load_library(path)
  File "/usr/local/lib/python3.10/dist-packages/torch/_ops.py", line 1350, in load_library
    ctypes.CDLL(path)
  File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libavutil.so.57: cannot open shared object file: No such file or directory
2025-03-11 21:25:48,264 DEBUG Loading FFmpeg4
2025-03-11 21:25:48,264 DEBUG Failed to load FFmpeg4 extension.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 116, in _find_ffmpeg_extension
    ext = _find_versionsed_ffmpeg_extension(ffmpeg_ver)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 108, in _find_versionsed_ffmpeg_extension
    _load_lib(lib)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 94, in _load_lib
    torch.ops.load_library(path)
  File "/usr/local/lib/python3.10/dist-packages/torch/_ops.py", line 1350, in load_library
    ctypes.CDLL(path)
  File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libavutil.so.56: cannot open shared object file: No such file or directory
2025-03-11 21:25:48,265 DEBUG Loading FFmpeg
2025-03-11 21:25:48,265 DEBUG Failed to load FFmpeg extension.
    writer = torchaudio.io.StreamWriter(out, format=response_format)
  File "/usr/local/lib/python3.10/dist-packages/torio/io/_streaming_media_encoder.py", line 197, in __init__
    self._s = ffmpeg_ext.StreamingMediaEncoderFileObj(dst, format, buffer_size)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 25, in __getattr__
    self._import_once()
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 39, in _import_once
    self.module = self.import_func()
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 143, in _init_ffmpeg
    ext = _find_ffmpeg_extension(ffmpeg_vers)
  File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 122, in _find_ffmpeg_extension
    raise ImportError(
ImportError: Failed to intialize FFmpeg extension. Tried versions: ['6', '5', '4', '']. Enable DEBUG logging to see more details about the error.
Originally created by @kfchandsome on GitHub (Mar 12, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.15.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce I use the text to speech module in dify and call the CosyVoice2-0.5B model in Xinference, but the error ImportError: Failed to intialize FFmpeg extension is reported during actual operation, and i can not select a voice in options. ### ✔️ Expected Behavior how to fix ImportError: Failed to intialize FFmpeg extension? i try to sudo apt-get install FFmpeg in docker containers, but it not work. ### ❌ Actual Behavior ``` 2025-03-11 21:25:48,206 xinference.core.supervisor 54 DEBUG [request 12c6bb58-fefa-11ef-a475-0242ac110002] Enter get_model, args: <xinference.core.supervisor.Supervi sorActor object at 0x7ff8b6f51030>,CosyVoice2-0.5B, kwargs: 2025-03-11 21:25:48,207 xinference.core.worker 54 DEBUG Enter get_model, args: <xinference.core.worker.WorkerActor object at 0x7ff8b6f532e0>, kwargs: model_uid=CosyV oice2-0.5B-0 2025-03-11 21:25:48,207 xinference.core.worker 54 DEBUG Leave get_model, elapsed time: 0 s 2025-03-11 21:25:48,207 xinference.core.supervisor 54 DEBUG [request 12c6bb58-fefa-11ef-a475-0242ac110002] Leave get_model, elapsed time: 0 s 2025-03-11 21:25:48,209 xinference.core.model 74 DEBUG Request speech, current serve request count: 0, request limit: inf for the model CosyVoice2-0.5B-0 2025-03-11 21:25:48,209 xinference.core.model 74 DEBUG [request 12c72ea8-fefa-11ef-b39b-0242ac110002] Enter speech, args: ModelActor(CosyVoice2-0.5B-0), kwargs: inpu t=hello,voice=,response_format=mp3,speed=1.0,stream=True 2025-03-11 21:25:48,236 xinference.model.audio.cosyvoice 74 INFO Auto select speaker: 中文女 2025-03-11 21:25:48,237 xinference.model.audio.cosyvoice 74 INFO CosyVoice inference_sft 2025-03-11 21:25:48,237 xinference.core.model 74 DEBUG [request 12c72ea8-fefa-11ef-b39b-0242ac110002] Leave speech, elapsed time: 0 s 2025-03-11 21:25:48,237 DEBUG Create generator: 12cb73e6fefa11efb39b0242ac110002 2025-03-11 21:25:48,237 xinference.core.model 74 DEBUG After request speech, current serve request count: 0 for the model CosyVoice2-0.5B-0 2025-03-11 21:25:48,238 DEBUG Loading FFmpeg6 2025-03-11 21:25:48,239 DEBUG Failed to load FFmpeg6 extension. Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 116, in _find_ffmpeg_extension ext = _find_versionsed_ffmpeg_extension(ffmpeg_ver) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 108, in _find_versionsed_ffmpeg_extension _load_lib(lib) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 94, in _load_lib torch.ops.load_library(path) File "/usr/local/lib/python3.10/dist-packages/torch/_ops.py", line 1350, in load_library ctypes.CDLL(path) File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: libavutil.so.58: cannot open shared object file: No such file or directory 2025-03-11 21:25:48,263 DEBUG Loading FFmpeg5 2025-03-11 21:25:48,264 DEBUG Failed to load FFmpeg5 extension. Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 116, in _find_ffmpeg_extension ext = _find_versionsed_ffmpeg_extension(ffmpeg_ver) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 108, in _find_versionsed_ffmpeg_extension _load_lib(lib) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 94, in _load_lib torch.ops.load_library(path) File "/usr/local/lib/python3.10/dist-packages/torch/_ops.py", line 1350, in load_library ctypes.CDLL(path) File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: libavutil.so.57: cannot open shared object file: No such file or directory 2025-03-11 21:25:48,264 DEBUG Loading FFmpeg4 2025-03-11 21:25:48,264 DEBUG Failed to load FFmpeg4 extension. Traceback (most recent call last): File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 116, in _find_ffmpeg_extension ext = _find_versionsed_ffmpeg_extension(ffmpeg_ver) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 108, in _find_versionsed_ffmpeg_extension _load_lib(lib) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 94, in _load_lib torch.ops.load_library(path) File "/usr/local/lib/python3.10/dist-packages/torch/_ops.py", line 1350, in load_library ctypes.CDLL(path) File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: libavutil.so.56: cannot open shared object file: No such file or directory 2025-03-11 21:25:48,265 DEBUG Loading FFmpeg 2025-03-11 21:25:48,265 DEBUG Failed to load FFmpeg extension. writer = torchaudio.io.StreamWriter(out, format=response_format) File "/usr/local/lib/python3.10/dist-packages/torio/io/_streaming_media_encoder.py", line 197, in __init__ self._s = ffmpeg_ext.StreamingMediaEncoderFileObj(dst, format, buffer_size) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 25, in __getattr__ self._import_once() File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 39, in _import_once self.module = self.import_func() File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 143, in _init_ffmpeg ext = _find_ffmpeg_extension(ffmpeg_vers) File "/usr/local/lib/python3.10/dist-packages/torio/_extension/utils.py", line 122, in _find_ffmpeg_extension raise ImportError( ImportError: Failed to intialize FFmpeg extension. Tried versions: ['6', '5', '4', '']. Enable DEBUG logging to see more details about the error. ```
yindo added the 🐞 bugstt & tts labels 2026-02-21 18:47:31 -05:00
yindo closed this issue 2026-02-21 18:47:31 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label stt & tts 🐞 bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#10488
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?