if I deploy an chagpt like api by myself, can it be registered by openllm? #816

Closed
opened 2026-02-21 17:28:34 -05:00 by yindo · 4 comments
Owner

Originally created by @LCorleone on GitHub (Dec 18, 2023).

Self Checks

Dify version

0.3.21

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

hi, i suppose that if i offer an api like chatgpt, no matter how, using openllm or localai or by myself, it can be registered by dify. am i right?
i deploy an api by https://github.com/xusenlinzy/api-for-open-llm/tree/master, it offer apis like chatgpt, and then i want to register this api in dify, i try the openllm. but failed. it stuck in validating. any suggestions?

✔️ Expected Behavior

failed as discussed

Actual Behavior

failed as discussed

Originally created by @LCorleone on GitHub (Dec 18, 2023). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to file this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). ### Dify version 0.3.21 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce hi, i suppose that if i offer an api like chatgpt, no matter how, using openllm or localai or by myself, it can be registered by dify. am i right? i deploy an api by https://github.com/xusenlinzy/api-for-open-llm/tree/master, it offer apis like chatgpt, and then i want to register this api in dify, i try the openllm. but failed. it stuck in validating. any suggestions? ### ✔️ Expected Behavior failed as discussed ### ❌ Actual Behavior failed as discussed
yindo added the 🙏 help wanted label 2026-02-21 17:28:34 -05:00
yindo closed this issue 2026-02-21 17:28:34 -05:00
Author
Owner

@crazywoola commented on GitHub (Dec 18, 2023):

Can you paste the logs in openllm? You can try to ask a issue in their reop. Seems a issue related to their code.

@crazywoola commented on GitHub (Dec 18, 2023): Can you paste the logs in openllm? You can try to ask a issue in their reop. Seems a issue related to their code.
Author
Owner

@LCorleone commented on GitHub (Dec 18, 2023):

Can you paste the logs in openllm? You can try to ask a issue in their reop. Seems a issue related to their code.

hello, I mean that I deploy an chatgpt style api by myself using api-for-open-llm , not using openllm, and my question is how it can be registered in dify? it seems no entrance other than openllm, localai and xinference (sorry for some reasons I cannot use them). So I just try the openllm in model provider because both of them are chatgpt style apis, and i wish it can work but no. I think no matter how the api is deploy, if it is a chatgpt style api it can work.

@LCorleone commented on GitHub (Dec 18, 2023): > Can you paste the logs in openllm? You can try to ask a issue in their reop. Seems a issue related to their code. hello, I mean that I deploy an chatgpt style api by myself using [api-for-open-llm](https://github.com/xusenlinzy/api-for-open-llm/tree/master) , not using openllm, and my question is how it can be registered in dify? it seems no entrance other than openllm, localai and xinference (sorry for some reasons I cannot use them). So I just try the openllm in model provider because both of them are chatgpt style apis, and i wish it can work but no. I think no matter how the api is deploy, if it is a chatgpt style api it can work.
Author
Owner

@LCorleone commented on GitHub (Dec 19, 2023):

update, it seems if i deploy an api following the openllm style (request and response) by myself, this api can rigister by openllm in the model provider?

@LCorleone commented on GitHub (Dec 19, 2023): update, it seems if i deploy an api following the openllm style (request and response) by myself, this api can rigister by openllm in the model provider?
Author
Owner

@LCorleone commented on GitHub (Dec 19, 2023):

yep, I successfully register an api deployed by myself, not using openllm or localai... close this issue

@LCorleone commented on GitHub (Dec 19, 2023): yep, I successfully register an api deployed by myself, not using openllm or localai... close this issue
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#816