langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-22 04:25:29 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Document vectorization failed #8182

New Issue
Closed
opened 2026-02-21 18:24:22 -05:00 by yindo · 3 comments
yindo commented 2026-02-21 18:24:22 -05:00
Owner
Copy Link
Copy Source

Originally created by @shatang123 on GitHub (Feb 12, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.15.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

我的文档索引配置，使用的是智谱AI提供的接口：
Image

向量化失败：
Image

我尝试过更换embedding模型，使用本地的或者其它云服务的还是失败，下面是日志

✔️ Expected Behavior

向量化成功

❌ Actual Behavior

实际失败了

Originally created by @shatang123 on GitHub (Feb 12, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.15.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce 我的文档索引配置，使用的是智谱AI提供的接口： <img width="653" alt="Image" src="https://github.com/user-attachments/assets/532ccad3-250d-48f2-8343-94780ee91755" /> 向量化失败： <img width="695" alt="Image" src="https://github.com/user-attachments/assets/57a8f525-ac23-4979-adf2-632cf2c81386" /> 我尝试过更换embedding模型，使用本地的或者其它云服务的还是失败，下面是日志 <!-- Failed to upload "1739342592110.jpg" --> ### ✔️ Expected Behavior 向量化成功 ### ❌ Actual Behavior 实际失败了
yindo added the 👻 feat:rag label 2026-02-21 18:24:22 -05:00
yindo closed this issue 2026-02-21 18:24:22 -05:00
yindo commented 2026-02-21 18:24:22 -05:00
Author
Owner
Copy Link
Copy Source

@shatang123 commented on GitHub (Feb 12, 2025):

日志：
2025-02-12 06:38:13.306 INFO [ThreadPoolExecutor-10_8] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK"
2025-02-12 06:38:13.414 INFO [ThreadPoolExecutor-10_0] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK"
2025-02-12 06:38:13.446 INFO [ThreadPoolExecutor-10_8] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK"
2025-02-12 06:38:13.447 INFO [ThreadPoolExecutor-10_5] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK"
2025-02-12 06:38:13.572 INFO [ThreadPoolExecutor-10_8] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK"
2025-02-12 06:38:13.608 ERROR [Dummy-181] [indexing_runner.py:96] - consume document failed
Traceback (most recent call last):
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 72, in map_httpcore_exceptions
yield
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 236, in handle_request
resp = self._pool.handle_request(req)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 256, in handle_request
raise exc from None
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 236, in handle_request
response = connection.handle_request(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 101, in handle_request
raise exc
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 78, in handle_request
stream = self._connect(request)
^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 124, in _connect
stream = self._network_backend.connect_tcp(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_backends/sync.py", line 207, in connect_tcp
with map_exceptions(exc_map):
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
self.gen.throw(value)
File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc) from exc
httpcore.ConnectError: [Errno -2] Name or service not known

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/app/api/.venv/lib/python3.12/site-packages/qdrant_client/http/api_client.py", line 101, in send_inner
response = self._client.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 926, in send
response = self._send_handling_auth(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 954, in _send_handling_auth
response = self._send_handling_redirects(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 991, in _send_handling_redirects
response = self._send_single_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1027, in _send_single_request
response = transport.handle_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 235, in handle_request
with map_httpcore_exceptions():
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.12/contextlib.py", line 158, in exit
self.gen.throw(value)
File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 89, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ConnectError: [Errno -2] Name or service not known

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/app/api/core/indexing_runner.py", line 80, in run

@shatang123 commented on GitHub (Feb 12, 2025): 日志： 2025-02-12 06:38:13.306 INFO [ThreadPoolExecutor-10_8] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK" 2025-02-12 06:38:13.414 INFO [ThreadPoolExecutor-10_0] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK" 2025-02-12 06:38:13.446 INFO [ThreadPoolExecutor-10_8] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK" 2025-02-12 06:38:13.447 INFO [ThreadPoolExecutor-10_5] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK" 2025-02-12 06:38:13.572 INFO [ThreadPoolExecutor-10_8] [_client.py:1038] - HTTP Request: POST https://open.bigmodel.cn/api/paas/v4/embeddings "HTTP/1.1 200 OK" 2025-02-12 06:38:13.608 ERROR [Dummy-181] [indexing_runner.py:96] - consume document failed Traceback (most recent call last): File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 72, in map_httpcore_exceptions yield File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 236, in handle_request resp = self._pool.handle_request(req) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 256, in handle_request raise exc from None File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection_pool.py", line 236, in handle_request response = connection.handle_request( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 101, in handle_request raise exc File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 78, in handle_request stream = self._connect(request) ^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_sync/connection.py", line 124, in _connect stream = self._network_backend.connect_tcp(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_backends/sync.py", line 207, in connect_tcp with map_exceptions(exc_map): ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/app/api/.venv/lib/python3.12/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions raise to_exc(exc) from exc httpcore.ConnectError: [Errno -2] Name or service not known The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/app/api/.venv/lib/python3.12/site-packages/qdrant_client/http/api_client.py", line 101, in send_inner response = self._client.send(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 926, in send response = self._send_handling_auth( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 954, in _send_handling_auth response = self._send_handling_redirects( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 991, in _send_handling_redirects response = self._send_single_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpx/_client.py", line 1027, in _send_single_request response = transport.handle_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 235, in handle_request with map_httpcore_exceptions(): ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/app/api/.venv/lib/python3.12/site-packages/httpx/_transports/default.py", line 89, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError: [Errno -2] Name or service not known During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/app/api/core/indexing_runner.py", line 80, in run
yindo commented 2026-02-21 18:24:23 -05:00
Author
Owner
Copy Link
Copy Source

@shatang123 commented on GitHub (Feb 12, 2025):

补充错误日志:
2025-02-12 06:52:25.635 INFO [MainThread] [strategy.py:161] - Task tasks.retry_document_indexing_task.retry_document_indexing_task[858e49ce-bd7c-4c71-98b0-a939a31e9ce1] received
2025-02-12 06:52:25.638 INFO [Dummy-184] [retry_document_indexing_task.py:57] - Start retry document: bc8dcb85-b66e-4cfa-93cb-ce7bb152f58e
2025-02-12 06:52:25.663 INFO [Dummy-184] [retry_document_indexing_task.py:92] - [Errno -2] Name or service not known
2025-02-12 06:52:25.663 INFO [Dummy-184] [retry_document_indexing_task.py:96] - Retry dataset: c9c93184-604d-407f-b0fe-505ee7d3abea latency: 0.027348359988536686
2025-02-12 06:52:25.692 INFO [Dummy-184] [trace.py:128] - Task tasks.retry_document_indexing_task.retry_document_indexing_task[858e49ce-bd7c-4c71-98b0-a939a31e9ce1] succeeded in 0.056107232987415045s: None

@shatang123 commented on GitHub (Feb 12, 2025): 补充错误日志: 2025-02-12 06:52:25.635 INFO [MainThread] [strategy.py:161] - Task tasks.retry_document_indexing_task.retry_document_indexing_task[858e49ce-bd7c-4c71-98b0-a939a31e9ce1] received 2025-02-12 06:52:25.638 INFO [Dummy-184] [retry_document_indexing_task.py:57] - Start retry document: bc8dcb85-b66e-4cfa-93cb-ce7bb152f58e 2025-02-12 06:52:25.663 INFO [Dummy-184] [retry_document_indexing_task.py:92] - [Errno -2] Name or service not known 2025-02-12 06:52:25.663 INFO [Dummy-184] [retry_document_indexing_task.py:96] - Retry dataset: c9c93184-604d-407f-b0fe-505ee7d3abea latency: 0.027348359988536686 2025-02-12 06:52:25.692 INFO [Dummy-184] [trace.py:128] - Task tasks.retry_document_indexing_task.retry_document_indexing_task[858e49ce-bd7c-4c71-98b0-a939a31e9ce1] succeeded in 0.056107232987415045s: None
yindo commented 2026-02-21 18:24:23 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Feb 12, 2025):

This is a general network issue, please make sure the worker container can access the vdb container correctly.

@crazywoola commented on GitHub (Feb 12, 2025): This is a general network issue, please make sure the worker container can access the vdb container correctly.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 👻 feat:rag
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#8182
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?