Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-16 09:54:29 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #3197] Add tools/function call parameters support to stream-chat interface #2057

New Issue
Closed
opened 2026-02-22 18:27:58 -05:00 by yindo · 1 comment
yindo commented 2026-02-22 18:27:58 -05:00
Owner
Copy Link
Copy Source

Originally created by @Jauhuei on GitHub (Feb 13, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3197

Question

Is it possible to add tools (function call) parameters to the Anything-LLM stream-chat interface? What would be the example format for implementation?

Context

  • I'm working with the stream-chat interface and would like to implement function calling capabilities
  • This would enable the integration of custom tools and external functions during chat interactions
  • Similar to how ChatGPT/GPT-4 implements function calling

Specific Information Needed

  1. Is this feature currently supported or planned?
  2. If possible, what would be the expected request format?
  3. Are there any examples of how to structure the tools/function calls in the request?

Example of what I'm looking for

Something like this format (pseudo-code):

{
  "message": "What's the weather?",
  "tools": [{
    "name": "get_weather",
    "description": "Get the current weather",
    "parameters": {
      "location": "string",
      "unit": "string"
    }
  }]
}
Originally created by @Jauhuei on GitHub (Feb 13, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3197 ## Question Is it possible to add tools (function call) parameters to the Anything-LLM stream-chat interface? What would be the example format for implementation? ## Context - I'm working with the stream-chat interface and would like to implement function calling capabilities - This would enable the integration of custom tools and external functions during chat interactions - Similar to how ChatGPT/GPT-4 implements function calling ## Specific Information Needed 1. Is this feature currently supported or planned? 2. If possible, what would be the expected request format? 3. Are there any examples of how to structure the tools/function calls in the request? ## Example of what I'm looking for Something like this format (pseudo-code): ```json { "message": "What's the weather?", "tools": [{ "name": "get_weather", "description": "Get the current weather", "parameters": { "location": "string", "unit": "string" } }] }
yindo added the enhancementfeature requestneeds info / can't replicate labels 2026-02-22 18:27:58 -05:00
yindo closed this issue 2026-02-22 18:27:58 -05:00
yindo commented 2026-02-22 18:27:58 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Feb 13, 2025):

I'm working with the stream-chat interface and would like to implement function calling capabilities

Is this not feasible via the @agent chat? That is how you invoke tools and if you want to be specific you can call out a specific tool with params and the mode can pass that in.

You cant really stream a tool call creation since you dont know what is chat vs JSON until it is fully formed which would result in showing a bunch of JSON noise only for it to disappear once it is determined it was text for a tool call and not a response to the user. Will reopen based on feature request once it is more nailed down - we can keep chatting on this thread.

@timothycarambat commented on GitHub (Feb 13, 2025): > I'm working with the stream-chat interface and would like to implement function calling capabilities Is this not feasible via the `@agent` chat? That is how you invoke tools and if you want to be specific you can call out a specific tool with params and the mode can pass that in. You cant really stream a tool call creation since you dont know what is chat vs JSON until it is fully formed which would result in showing a bunch of JSON noise only for it to disappear once it is determined it was text for a tool call and not a response to the user. Will reopen based on feature request once it is more nailed down - we can keep chatting on this thread.
yindo changed title from Add tools/function call parameters support to stream-chat interface to [GH-ISSUE #3197] Add tools/function call parameters support to stream-chat interface 2026-06-05 14:44:17 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request needs info / can't replicate
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2057
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?