[BUG] - OLLAMA - truncating input prompt #665

Closed
opened 2026-02-16 10:20:07 -05:00 by yindo · 1 comment
Owner

Originally created by @GSubActives on GitHub (Sep 22, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

Latest

Plugin version

0.0.7

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I'm having trouble with the context size. I specified the limit in Dify, but it doesn't seem to have been passed on to Ollama.

My model INFO in OLLAMA :

ollama show mistral-small3.2:latest
  Model
    architecture        mistral3    
    parameters          24.0B       
    context length      131072      
    embedding length    5120        
    quantization        Q4_K_M      

  Capabilities
    completion    
    vision        
    tools         

  Parameters
    temperature    0.15    

  System
    You are Mistral Small 3.2, a Large Language Model (LLM) created by Mistral AI, a French startup         
      headquartered in Paris.                                                                                 
    You power an AI assistant called Le Chat.                                                               
    ...                                                                                                     

  License
    Apache License               
    Version 2.0, January 2004    
    ...  

  • My Config in Dify :
Image

✔️ Error log

  • My Logs in Ollama :
    time=2025-09-22T13:05:26.792Z level=INFO source=server.go:1289 msg="llama runner started in 7.88 seconds"
    time=2025-09-22T13:05:26.878Z level=WARN source=runner.go:159 msg="truncating input prompt" limit=4096 prompt=7900 keep=4 new=4096
Originally created by @GSubActives on GitHub (Sep 22, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version Latest ### Plugin version 0.0.7 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce I'm having trouble with the context size. I specified the limit in Dify, but it doesn't seem to have been passed on to Ollama. My model INFO in OLLAMA : ``` ollama show mistral-small3.2:latest Model architecture mistral3 parameters 24.0B context length 131072 embedding length 5120 quantization Q4_K_M Capabilities completion vision tools Parameters temperature 0.15 System You are Mistral Small 3.2, a Large Language Model (LLM) created by Mistral AI, a French startup headquartered in Paris. You power an AI assistant called Le Chat. ... License Apache License Version 2.0, January 2004 ... ``` - My Config in Dify : <img width="647" height="907" alt="Image" src="https://github.com/user-attachments/assets/2bf6557b-0f65-489a-b422-d3c904da6e60" /> ### ✔️ Error log - My Logs in Ollama : time=2025-09-22T13:05:26.792Z level=INFO source=server.go:1289 msg="llama runner started in 7.88 seconds" time=2025-09-22T13:05:26.878Z level=WARN source=runner.go:159 msg="truncating input prompt" limit=4096 prompt=7900 keep=4 new=4096
yindo added the bug label 2026-02-16 10:20:07 -05:00
yindo closed this issue 2026-02-16 10:20:07 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Oct 8, 2025):

Hi, @GSubActives. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that the input prompt is truncated when using the Ollama plugin with Dify.
  • Despite setting a large context size limit in Dify, the Ollama model's context length of 131072 is not respected.
  • The problem occurs in a self-hosted Docker environment with plugin version 0.0.7.
  • No additional comments or updates have been provided since the initial report.

What's Next:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I do not hear back within 5 days, this issue will be automatically closed.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Oct 8, 2025): Hi, @GSubActives. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that the input prompt is truncated when using the Ollama plugin with Dify. - Despite setting a large context size limit in Dify, the Ollama model's context length of 131072 is not respected. - The problem occurs in a self-hosted Docker environment with plugin version 0.0.7. - No additional comments or updates have been provided since the initial report. **What's Next:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I do not hear back within 5 days, this issue will be automatically closed. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#665