[GH-ISSUE #3952] [FEAT]: Support for KoalaChat API #2515

Closed
opened 2026-02-22 18:30:01 -05:00 by yindo · 3 comments
Owner

Originally created by @grumphus on GitHub (Jun 5, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3952

What would you like to see?

Greetings. Do you have plans to allow implementation non-OpenAI APIs? An example is one that I use called KoalaChat which has pretty basic API documentation.

Thank you!

Originally created by @grumphus on GitHub (Jun 5, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3952 ### What would you like to see? Greetings. Do you have plans to allow implementation non-OpenAI APIs? An example is one that I use called [KoalaChat](https://koala.sh/chat) which has pretty basic [API documentation](https://koala.sh/pages/api-docs/koalachat). Thank you!
yindo added the enhancementIntegration Requestfeature request labels 2026-02-22 18:30:01 -05:00
yindo closed this issue 2026-02-22 18:30:01 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jun 5, 2025):

Do you have plans to allow implementation non-OpenAI APIs?

No, since they require much more work to set up, integration with chat + agents, and more work to maintain over time. Unless this is a provider on the level of Gemini (who have moved to OpenAI Compatible) or Anthropic (who have their own SDK), we will not adopt a non-OpenAI provider directly.

Nothing is stopping this work from being done on a personal fork, but we will not merge it into main since we ultimately still have to maintain it forever. The OpenAI standardization has been a huge boon of adoption for any LLM service and it would be in their best interest to adopt it - however, that is up to their discretion, of course.

@timothycarambat commented on GitHub (Jun 5, 2025): > Do you have plans to allow implementation non-OpenAI APIs? No, since they require much more work to set up, integration with chat + agents, and more work to maintain over time. Unless this is a provider on the level of Gemini (who have _moved to OpenAI Compatible_) or Anthropic (who have their own SDK), we will not adopt a non-OpenAI provider directly. Nothing is stopping this work from being done on a personal fork, but we will not merge it into main since we ultimately still have to maintain it forever. The OpenAI standardization has been a huge boon of adoption for any LLM service and it would be in their best interest to adopt it - however, that is up to their discretion, of course.
Author
Owner

@timothycarambat commented on GitHub (Jun 5, 2025):

For what its worth, you can outsource the API calls to Koala to a custom agent - which can call arbitrary API endpoints. Then you can just use their API service to generate articles or whatever you are using.
https://docs.anythingllm.com/agent-flows/blocks/api-call

@timothycarambat commented on GitHub (Jun 5, 2025): For what its worth, you can outsource the API calls to Koala to a custom agent - which can call arbitrary API endpoints. Then you can just use their API service to generate articles or whatever you are using. https://docs.anythingllm.com/agent-flows/blocks/api-call
Author
Owner

@grumphus commented on GitHub (Jun 5, 2025):

For what its worth, you can outsource the API calls to Koala to a custom agent - which can call arbitrary API endpoints. Then you can just use their API service to generate articles or whatever you are using. https://docs.anythingllm.com/agent-flows/blocks/api-call

Thank you very much for this suggestion. I'll take a deeper dive on my spare time. And I completely understand your decision as well. More power to your software and all the best.

@grumphus commented on GitHub (Jun 5, 2025): > For what its worth, you can outsource the API calls to Koala to a custom agent - which can call arbitrary API endpoints. Then you can just use their API service to generate articles or whatever you are using. https://docs.anythingllm.com/agent-flows/blocks/api-call Thank you very much for this suggestion. I'll take a deeper dive on my spare time. And I completely understand your decision as well. More power to your software and all the best.
yindo changed title from [FEAT]: Support for KoalaChat API to [GH-ISSUE #3952] [FEAT]: Support for KoalaChat API 2026-06-05 14:47:00 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2515