[GH-ISSUE #3412] [FEAT]: Remove the CoT field in the API request #2202

Closed
opened 2026-02-22 18:28:35 -05:00 by yindo · 1 comment
Owner

Originally created by @31415906 on GitHub (Mar 6, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3412

What would you like to see?

Remove the <think> field from the context when making API requests to reduce input tokens and context size

Originally created by @31415906 on GitHub (Mar 6, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3412 ### What would you like to see? Remove the \<think\> field from the context when making API requests to reduce input tokens and context size
yindo added the enhancementfeature request labels 2026-02-22 18:28:35 -05:00
yindo closed this issue 2026-02-22 18:28:35 -05:00
Author
Owner

@timothycarambat commented on GitHub (Sep 15, 2025):

This is automatically handled by the chat template many engines use and is the case for all cloud providers, ollama, and LMstudio. There should be no action for us to take to pre-process the text before sending.

Example: https://github.com/ollama/ollama/issues/10448#issuecomment-2848651636

@timothycarambat commented on GitHub (Sep 15, 2025): This is automatically handled by the chat template many engines use and is the case for all cloud providers, ollama, and LMstudio. There should be no action for us to take to pre-process the text before sending. Example: https://github.com/ollama/ollama/issues/10448#issuecomment-2848651636
yindo changed title from [FEAT]: Remove the CoT field in the API request to [GH-ISSUE #3412] [FEAT]: Remove the CoT field in the API request 2026-06-05 14:45:08 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2202