How to make llm answer my question in time? #12381

Closed
opened 2026-02-21 19:07:09 -05:00 by yindo · 2 comments
Owner

Originally created by @btdan on GitHub (Mar 31, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.1.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

After deply dify on the local host and create a knowledge base.
And then I want to check the result.
when I ask a question,the reply keep to think and keep timing
just as follows:

Image

✔️ Expected Behavior

I want it to answer my question in time.

Actual Behavior

the answer is so short and it is not What I want.
Can you tell me how to solve this problem?
Thanks very much.

Originally created by @btdan on GitHub (Mar 31, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.1.3 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce After deply dify on the local host and create a knowledge base. And then I want to check the result. when I ask a question,the reply keep to think and keep timing just as follows: ![Image](https://github.com/user-attachments/assets/ad29ef8e-f792-44fc-b6da-3478dc1186c5) ### ✔️ Expected Behavior I want it to answer my question in time. ### ❌ Actual Behavior the answer is so short and it is not What I want. Can you tell me how to solve this problem? Thanks very much.
yindo added the 🙋‍♂️ question label 2026-02-21 19:07:09 -05:00
yindo closed this issue 2026-02-21 19:07:09 -05:00
Author
Owner

@qianyueping1211 commented on GitHub (Mar 31, 2025):

这要看调度的llm模型的反馈,和dify无关哦。
看这个速度一般是本地的模型,三个办法:升级GPU 或者 使用量化更小的模型、要不就是调用在线API服务。

@qianyueping1211 commented on GitHub (Mar 31, 2025): 这要看调度的llm模型的反馈,和dify无关哦。 看这个速度一般是本地的模型,三个办法:升级GPU 或者 使用量化更小的模型、要不就是调用在线API服务。
Author
Owner

@btdan commented on GitHub (Mar 31, 2025):

Thanks very much for your reply.

@btdan commented on GitHub (Mar 31, 2025): Thanks very much for your reply.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#12381