knowledge Search is Slower then early dify version #14591

Closed
opened 2026-02-21 19:17:57 -05:00 by yindo · 7 comments
Owner

Originally created by @fjcondy on GitHub (Jun 12, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.4.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

when update dify 1.4.1 knowledge node execute becomes slower then early dify version.
dify 1.4.1 chatflow execute use time:

Image

✔️ Expected Behavior

dify 0.12.1 use time

Image

Actual Behavior

Image

Originally created by @fjcondy on GitHub (Jun 12, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.4.2 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce when update dify 1.4.1 knowledge node execute becomes slower then early dify version. dify 1.4.1 chatflow execute use time: ![Image](https://github.com/user-attachments/assets/44c22b65-ddd0-4b45-9215-ddd10da0e28d) ### ✔️ Expected Behavior dify 0.12.1 use time ![Image](https://github.com/user-attachments/assets/8d02c82a-44cb-4769-adca-4cbb865ba2c6) ### ❌ Actual Behavior ![Image](https://github.com/user-attachments/assets/c0de0e65-4a51-41b3-894a-3c54ee5c69f3)
yindo added the 🐞 bug label 2026-02-21 19:17:57 -05:00
yindo closed this issue 2026-02-21 19:17:57 -05:00
Author
Owner

@fjcondy commented on GitHub (Jun 13, 2025):

mybe i find slower reason.
knowledge search,why http request Starting new HTTPS connection (1): pypi.org:443 it request slower in chinese network.
and why have two thread knowledge search.
2025-06-13 06:55:43.245 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:241] - Starting new HTTP connection (1): plugin_daemon:5002 2025-06-13 06:55:43.252 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:241] - Starting new HTTP connection (1): plugin_daemon:5002 2025-06-13 06:55:43.268 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:544] - http://plugin_daemon:5002 "GET /plugin/b0ba99ce-7d4d-4ea9-82f5-4bfb3f3277a5/management/models?page=1&page_size=256 HTTP/1.1" 200 None 2025-06-13 06:55:43.309 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://plugin_daemon:5002 "GET /plugin/b0ba99ce-7d4d-4ea9-82f5-4bfb3f3277a5/management/models?page=1&page_size=256 HTTP/1.1" 200 None 2025-06-13 06:55:43.343 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:241] - Starting new HTTP connection (1): weaviate:8080 2025-06-13 06:55:43.346 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:241] - Starting new HTTP connection (1): weaviate:8080 2025-06-13 06:55:43.349 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/meta HTTP/1.1" 200 64 2025-06-13 06:55:43.350 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:1049] - Starting new HTTPS connection (1): pypi.org:443 2025-06-13 06:55:43.350 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/meta HTTP/1.1" 200 64 2025-06-13 06:55:43.352 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:1049] - Starting new HTTPS connection (1): pypi.org:443 2025-06-13 06:55:44.529 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:241] - Starting new HTTP connection (1): plugin_daemon:5002 2025-06-13 06:55:44.530 DEBUG [batchSizeRefresh] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/nodes HTTP/1.1" 200 988 2025-06-13 06:55:44.626 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://plugin_daemon:5002 "POST /plugin/b0ba99ce-7d4d-4ea9-82f5-4bfb3f3277a5/dispatch/text_embedding/invoke HTTP/1.1" 200 None 2025-06-13 06:55:44.664 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://weaviate:8080 "POST /v1/graphql HTTP/1.1" 200 None 2025-06-13 06:55:47.308 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:241] - Starting new HTTP connection (2): weaviate:8080 2025-06-13 06:55:47.311 DEBUG [batchSizeRefresh] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/nodes HTTP/1.1" 200 988 2025-06-13 06:55:47.316 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:544] - http://weaviate:8080 "POST /v1/graphql HTTP/1.1"

@fjcondy commented on GitHub (Jun 13, 2025): mybe i find slower reason. knowledge search,why http request _Starting new HTTPS connection (1): pypi.org:443_ it request slower in chinese network. and why have two thread knowledge search. ` 2025-06-13 06:55:43.245 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:241] - Starting new HTTP connection (1): plugin_daemon:5002 2025-06-13 06:55:43.252 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:241] - Starting new HTTP connection (1): plugin_daemon:5002 2025-06-13 06:55:43.268 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:544] - http://plugin_daemon:5002 "GET /plugin/b0ba99ce-7d4d-4ea9-82f5-4bfb3f3277a5/management/models?page=1&page_size=256 HTTP/1.1" 200 None 2025-06-13 06:55:43.309 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://plugin_daemon:5002 "GET /plugin/b0ba99ce-7d4d-4ea9-82f5-4bfb3f3277a5/management/models?page=1&page_size=256 HTTP/1.1" 200 None 2025-06-13 06:55:43.343 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:241] - Starting new HTTP connection (1): weaviate:8080 2025-06-13 06:55:43.346 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:241] - Starting new HTTP connection (1): weaviate:8080 2025-06-13 06:55:43.349 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/meta HTTP/1.1" 200 64 2025-06-13 06:55:43.350 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:1049] - Starting new HTTPS connection (1): pypi.org:443 2025-06-13 06:55:43.350 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/meta HTTP/1.1" 200 64 2025-06-13 06:55:43.352 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:1049] - Starting new HTTPS connection (1): pypi.org:443 2025-06-13 06:55:44.529 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:241] - Starting new HTTP connection (1): plugin_daemon:5002 2025-06-13 06:55:44.530 DEBUG [batchSizeRefresh] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/nodes HTTP/1.1" 200 988 2025-06-13 06:55:44.626 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://plugin_daemon:5002 "POST /plugin/b0ba99ce-7d4d-4ea9-82f5-4bfb3f3277a5/dispatch/text_embedding/invoke HTTP/1.1" 200 None 2025-06-13 06:55:44.664 DEBUG [ThreadPoolExecutor-120_0] [connectionpool.py:544] - http://weaviate:8080 "POST /v1/graphql HTTP/1.1" 200 None 2025-06-13 06:55:47.308 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:241] - Starting new HTTP connection (2): weaviate:8080 2025-06-13 06:55:47.311 DEBUG [batchSizeRefresh] [connectionpool.py:544] - http://weaviate:8080 "GET /v1/nodes HTTP/1.1" 200 988 2025-06-13 06:55:47.316 DEBUG [ThreadPoolExecutor-120_1] [connectionpool.py:544] - http://weaviate:8080 "POST /v1/graphql HTTP/1.1" `
Author
Owner

@fjcondy commented on GitHub (Jun 13, 2025):

I find reason. weaive client will connect to pypi.org fetch lastest version.
temp resolution: modify
/app/api/.venv/lib/python3.12/site-packages/weaviate/connect/connection.py in api docker
comment version check:
#try: # pkg_info = requests.get(PYPI_PACKAGE_URL, timeout=PYPI_TIMEOUT).json() # pkg_info = pkg_info.get("info", {}) # latest_version = pkg_info.get("version", "unknown version") # if is_weaviate_client_too_old(client_version, latest_version): # _Warnings.weaviate_client_too_old_vs_latest(client_version, latest_version) #except (RequestsConnectionError, JSONDecodeError, ReadTimeout): # pass # air-gaped environments

@fjcondy commented on GitHub (Jun 13, 2025): I find reason. weaive client will connect to pypi.org fetch lastest version. temp resolution: modify /app/api/.venv/lib/python3.12/site-packages/weaviate/connect/connection.py in api docker comment version check: ` #try: # pkg_info = requests.get(PYPI_PACKAGE_URL, timeout=PYPI_TIMEOUT).json() # pkg_info = pkg_info.get("info", {}) # latest_version = pkg_info.get("version", "unknown version") # if is_weaviate_client_too_old(client_version, latest_version): # _Warnings.weaviate_client_too_old_vs_latest(client_version, latest_version) #except (RequestsConnectionError, JSONDecodeError, ReadTimeout): # pass # air-gaped environments `
Author
Owner

@hiwuye commented on GitHub (Jun 13, 2025):

me too

@hiwuye commented on GitHub (Jun 13, 2025): me too
Author
Owner

@mobiusy commented on GitHub (Jun 17, 2025):

I find reason. weaive client will connect to pypi.org fetch lastest version. temp resolution: modify /app/api/.venv/lib/python3.12/site-packages/weaviate/connect/connection.py in api docker comment version check: #try: # pkg_info = requests.get(PYPI_PACKAGE_URL, timeout=PYPI_TIMEOUT).json() # pkg_info = pkg_info.get("info", {}) # latest_version = pkg_info.get("version", "unknown version") # if is_weaviate_client_too_old(client_version, latest_version): # _Warnings.weaviate_client_too_old_vs_latest(client_version, latest_version) #except (RequestsConnectionError, JSONDecodeError, ReadTimeout): # pass # air-gaped environments

I encountered the same problem and have temporarily fixed it through the above method. I look forward to the official resolution of this issue in the next version.

@mobiusy commented on GitHub (Jun 17, 2025): > I find reason. weaive client will connect to pypi.org fetch lastest version. temp resolution: modify /app/api/.venv/lib/python3.12/site-packages/weaviate/connect/connection.py in api docker comment version check: `#try: # pkg_info = requests.get(PYPI_PACKAGE_URL, timeout=PYPI_TIMEOUT).json() # pkg_info = pkg_info.get("info", {}) # latest_version = pkg_info.get("version", "unknown version") # if is_weaviate_client_too_old(client_version, latest_version): # _Warnings.weaviate_client_too_old_vs_latest(client_version, latest_version) #except (RequestsConnectionError, JSONDecodeError, ReadTimeout): # pass # air-gaped environments` I encountered the same problem and have temporarily fixed it through the above method. I look forward to the official resolution of this issue in the next version.
Author
Owner

@kurokobo commented on GitHub (Jun 17, 2025):

I've sent a PR for this: https://github.com/langgenius/dify/pull/21131

@kurokobo commented on GitHub (Jun 17, 2025): I've sent a PR for this: https://github.com/langgenius/dify/pull/21131
Author
Owner

@hiwuye commented on GitHub (Jun 25, 2025):

Image It doesn't seem to have been resolved

@hiwuye commented on GitHub (Jun 25, 2025): ![Image](https://github.com/user-attachments/assets/65a709d0-53de-410e-b5c5-e18c5c6cc501) It doesn't seem to have been resolved
Author
Owner

@dyhack1 commented on GitHub (Dec 2, 2025):

Yes,I have the same problems.
since this pr request https://github.com/langgenius/dify/pull/25096

Image

when I use knowledge search,it looks so slow
Image

my dify verion is 1.9.2

Image

have any good ideas to solve it?
thanks

@dyhack1 commented on GitHub (Dec 2, 2025): Yes,I have the same problems. since this pr request https://github.com/langgenius/dify/pull/25096 <img width="1389" height="718" alt="Image" src="https://github.com/user-attachments/assets/1e064e8e-1ef0-4b77-8fe8-0230d043afbd" /> when I use knowledge search,it looks so slow <img width="1960" height="464" alt="Image" src="https://github.com/user-attachments/assets/5a318317-02fa-4854-8c91-be224f1337af" /> my dify verion is 1.9.2 <img width="1902" height="265" alt="Image" src="https://github.com/user-attachments/assets/4e46afbf-5dd2-485b-b82d-e382ae55a7b8" /> have any good ideas to solve it? thanks
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#14591