Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2063] [FEAT]: Does anything-llm have API to allow calling from external code? #1344

New Issue
Closed
opened 2026-02-22 18:24:21 -05:00 by yindo · 4 comments
yindo commented 2026-02-22 18:24:21 -05:00
Owner
Copy Link
Copy Source

Originally created by @jingweibhuang on GitHub (Aug 7, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2063

What would you like to see?

Thank you for the awesome tool!

I’m wondering whether anything-llm has API ( like OpenAI API) to allow call anything-llm from python or an external system such as langchain? Such type of APIs will be very useful to allow machines (rather than just human users) to interact with anything-llm. For example, I have a large set of text, each of them needs to call an LLM engine for query.

Thank you:-)

Originally created by @jingweibhuang on GitHub (Aug 7, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2063 ### What would you like to see? Thank you for the awesome tool! I’m wondering whether anything-llm has API ( like OpenAI API) to allow call anything-llm from python or an external system such as langchain? Such type of APIs will be very useful to allow machines (rather than just human users) to interact with anything-llm. For example, I have a large set of text, each of them needs to call an LLM engine for query. Thank you:-)
yindo added the enhancementfeature request labels 2026-02-22 18:24:21 -05:00
yindo closed this issue 2026-02-22 18:24:21 -05:00
yindo commented 2026-02-22 18:24:22 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Aug 7, 2024):

We do, every instance (even desktop) of AnythingLLM has a full developer APi you can use to send chats. https://docs.anythingllm.com/features/api

If you have anythingllm running, opening settings > Tools > Developer API and you can get your own key + view all the docs/endpoints available.

@timothycarambat commented on GitHub (Aug 7, 2024): We do, every instance (even desktop) of AnythingLLM has a full developer APi you can use to send chats. https://docs.anythingllm.com/features/api If you have anythingllm running, opening settings > Tools > Developer API and you can get your own key + view all the docs/endpoints available.
yindo commented 2026-02-22 18:24:22 -05:00
Author
Owner
Copy Link
Copy Source

@jingweibhuang commented on GitHub (Aug 7, 2024):

Thank you for quick response!!
It would be more helpful if a bit more information such as function interface is provided in the documentation page https://docs.anythingllm.com/features/api.
Thanks again:-)

@jingweibhuang commented on GitHub (Aug 7, 2024): Thank you for quick response!! It would be more helpful if a bit more information such as function interface is provided in the documentation page https://docs.anythingllm.com/features/api. Thanks again:-)
yindo commented 2026-02-22 18:24:22 -05:00
Author
Owner
Copy Link
Copy Source

@Nero10578 commented on GitHub (Aug 16, 2024):

Thank you for quick response!! It would be more helpful if a bit more information such as function interface is provided in the documentation page https://docs.anythingllm.com/features/api. Thanks again:-)

Did you get this to work? I just keep getting 401 Unauthorized on the API when trying to chat using openai api endpoint.

@Nero10578 commented on GitHub (Aug 16, 2024): > Thank you for quick response!! It would be more helpful if a bit more information such as function interface is provided in the documentation page https://docs.anythingllm.com/features/api. Thanks again:-) Did you get this to work? I just keep getting 401 Unauthorized on the API when trying to chat using openai api endpoint.
yindo commented 2026-02-22 18:24:22 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Aug 16, 2024):

@Nero10578 did you possibly get an API key first so that you can use the API. On the sidebar > Tools > Developer API > Generate API Key button right at the top.

It is an API - so you need a key, even if you are doing everything locally. 401 means you dont have a key and/or are sending the request incorrectly. Header should be Authorization Bearer API-KEY-GOES-HERE

@timothycarambat commented on GitHub (Aug 16, 2024): @Nero10578 did you possibly get an API key first so that you can use the API. On the sidebar > Tools > Developer API > Generate API Key button right at the top. It is an API - so you need a key, even if you are doing everything locally. 401 means you dont have a key and/or are sending the request incorrectly. Header should be `Authorization Bearer API-KEY-GOES-HERE`
yindo changed title from [FEAT]: Does anything-llm have API to allow calling from external code? to [GH-ISSUE #2063] [FEAT]: Does anything-llm have API to allow calling from external code? 2026-06-05 14:40:16 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1344
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?