[GH-ISSUE #1621] Can AnythingLLM support langchain API calls? #1059

Closed
opened 2026-02-22 18:22:56 -05:00 by yindo · 3 comments
Owner

Originally created by @heiheiheibj on GitHub (Jun 6, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1621

What would you like to see?

I have configured it as a knowledge base in AnythingLLM at http://localhost:3001/api/v1/workspace/hehe/chat and the model is LLAMA3 8B. via postman, it can be called fine. Now I want to call it in langchain, how should I do it.

image

llm = OpenAI(model_name="llama3:8b", temperature=0,openai_api_key='sk-xxxxxxxxxxxxxxxxx',base_url='http://localhost:3001/api/v1/workspace/hehe/chat')`

image

thx ...

Originally created by @heiheiheibj on GitHub (Jun 6, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1621 ### What would you like to see? I have configured it as a knowledge base in AnythingLLM at http://localhost:3001/api/v1/workspace/hehe/chat and the model is LLAMA3 8B. via postman, it can be called fine. Now I want to call it in langchain, how should I do it. ![image](https://github.com/Mintplex-Labs/anything-llm/assets/6910198/a46dabf0-857c-412e-9d16-66ce58bd4699) llm = OpenAI(model_name="llama3:8b", temperature=0,openai_api_key='sk-xxxxxxxxxxxxxxxxx',base_url='http://localhost:3001/api/v1/workspace/hehe/chat')` ![image](https://github.com/Mintplex-Labs/anything-llm/assets/6910198/0cfd492f-0fde-4a3d-890c-5834ab7d9442) thx ...
yindo added the enhancementfeature request labels 2026-02-22 18:22:56 -05:00
yindo closed this issue 2026-02-22 18:22:56 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jun 6, 2024):

The API is not OpenAI compatible! So that is why it does not work.

@timothycarambat commented on GitHub (Jun 6, 2024): The API is _not OpenAI compatible_! So that is why it does not work.
Author
Owner

@bmj-sys commented on GitHub (Jun 8, 2024):

Does langchain have a public api available so that I can ask it questions with postman?

@bmj-sys commented on GitHub (Jun 8, 2024): Does langchain have a public api available so that I can ask it questions with postman?
Author
Owner

@timothycarambat commented on GitHub (Jun 10, 2024):

Langchain is a library - there is no "API" in the sense that it is a service that you can call like a REST service. AnythingLLM API is REST and can be called with postman

@timothycarambat commented on GitHub (Jun 10, 2024): Langchain is a library - there is no "API" in the sense that it is a service that you can call like a REST service. AnythingLLM API is REST and can be called with postman
yindo changed title from Can AnythingLLM support langchain API calls? to [GH-ISSUE #1621] Can AnythingLLM support langchain API calls? 2026-06-05 14:38:44 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1059