[GH-ISSUE #3540] [FEAT]: Support Alibaba Cloud Qwen #2283

Open
opened 2026-02-22 18:28:59 -05:00 by yindo · 5 comments
Owner

Originally created by @ia-builders-ronald on GitHub (Mar 25, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3540

What would you like to see?

Can anything-llm support Alibaba Cloud's Qwen API?
https://www.alibabacloud.com/help/en/model-studio/developer-reference/use-qwen-by-calling-api

Originally created by @ia-builders-ronald on GitHub (Mar 25, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3540 ### What would you like to see? Can anything-llm support Alibaba Cloud's Qwen API? https://www.alibabacloud.com/help/en/model-studio/developer-reference/use-qwen-by-calling-api
yindo added the enhancementIntegration Requestfeature request labels 2026-02-22 18:28:59 -05:00
Author
Owner

@timothycarambat commented on GitHub (Mar 26, 2025):

We dont have access to that service directly as I dont have an account for it, but you can select the Generic OpenAI LLM provider and use this base URL, along with your Auth token, to get completions for a given model

https://dashscope-intl.aliyuncs.com/compatible-mode/v1

@timothycarambat commented on GitHub (Mar 26, 2025): We dont have access to that service directly as I dont have an account for it, but you can select the `Generic OpenAI` LLM provider and use this base URL, along with your Auth token, to get completions for a given model `https://dashscope-intl.aliyuncs.com/compatible-mode/v1`
Author
Owner

@ia-builders-ronald commented on GitHub (Mar 28, 2025):

This works fine! Thanks

@ia-builders-ronald commented on GitHub (Mar 28, 2025): This works fine! Thanks
Author
Owner

@dp666x commented on GitHub (Mar 31, 2025):

Do you support the Zhìpǔ AI(https://www.bigmodel.cn/dev/howuse/introduction)? After I configured Generic OpenAI, the log prompts an error: [backend] info: [GenericOpenAiLLM] Inference API: https://open.bigmodel.cn/api/paas/v4/chat/completions Model: glm-4-plus
[backend] info: [TokenManager] Returning existing instance for model: glm-4-plus
[backend] error: Error: 404 "Not Found"
at APIError.generate (/app/server/node_modules/openai/error.js:54:20)
at OpenAI.makeStatusError (/app/server/node_modules/openai/core.js:263:33)
at OpenAI.makeRequest (/app/server/node_modules/openai/core.js:306:30)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async LLMPerformanceMonitor.measureStream (/app/server/utils/helpers/chat/LLMPerformanceMonitor.js:67:20)
at async GenericOpenAiLLM.streamGetChatCompletion (/app/server/utils/AiProviders/genericOpenAi/index.js:195:35)
at async streamChatWithWorkspace (/app/server/utils/chats/stream.js:248:20)
at async /app/server/endpoints/chat.js:148:9

@dp666x commented on GitHub (Mar 31, 2025): Do you support the Zhìpǔ AI(https://www.bigmodel.cn/dev/howuse/introduction)? After I configured Generic OpenAI, the log prompts an error: [backend] info: [GenericOpenAiLLM] Inference API: https://open.bigmodel.cn/api/paas/v4/chat/completions Model: glm-4-plus [backend] info: [TokenManager] Returning existing instance for model: glm-4-plus [backend] error: Error: 404 "Not Found" at APIError.generate (/app/server/node_modules/openai/error.js:54:20) at OpenAI.makeStatusError (/app/server/node_modules/openai/core.js:263:33) at OpenAI.makeRequest (/app/server/node_modules/openai/core.js:306:30) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async LLMPerformanceMonitor.measureStream (/app/server/utils/helpers/chat/LLMPerformanceMonitor.js:67:20) at async GenericOpenAiLLM.streamGetChatCompletion (/app/server/utils/AiProviders/genericOpenAi/index.js:195:35) at async streamChatWithWorkspace (/app/server/utils/chats/stream.js:248:20) at async /app/server/endpoints/chat.js:148:9
Author
Owner

@timothycarambat commented on GitHub (Mar 31, 2025):

Error: 404 "Not Found"

Your Base URL is incorrect. It should probably be https://open.bigmodel.cn/api/paas/v4, since we will append chat/completions to the end of it.

@timothycarambat commented on GitHub (Mar 31, 2025): > Error: 404 "Not Found" Your Base URL is incorrect. It should probably be `https://open.bigmodel.cn/api/paas/v4`, since we will append `chat/completions` to the end of it.
Author
Owner

@dp666x commented on GitHub (Apr 1, 2025):

Error: 404 "Not Found"错误:404 “未找到”

Your Base URL is incorrect. It should probably be https://open.bigmodel.cn/api/paas/v4, since we will append chat/completions to the end of it.您的基本 URL 不正确。它可能应该是 https://open.bigmodel.cn/api/paas/v4 ,因为我们将附加到 chat/completions 它的末尾。

Well, it has been successful. Thank you very much.

@dp666x commented on GitHub (Apr 1, 2025): > > Error: 404 "Not Found"错误:404 “未找到” > > Your Base URL is incorrect. It should probably be `https://open.bigmodel.cn/api/paas/v4`, since we will append `chat/completions` to the end of it.您的基本 URL 不正确。它可能应该是 `https://open.bigmodel.cn/api/paas/v4` ,因为我们将附加到 `chat/completions` 它的末尾。 Well, it has been successful. Thank you very much.
yindo changed title from [FEAT]: Support Alibaba Cloud Qwen to [GH-ISSUE #3540] [FEAT]: Support Alibaba Cloud Qwen 2026-06-05 14:45:38 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2283