mirror of
https://github.com/vxcontrol/pentagi.git
synced 2026-07-21 08:15:23 -04:00
[GH-ISSUE #30] model authentication #13
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @JacksonLvX on GitHub (Apr 8, 2025).
Original GitHub issue: https://github.com/vxcontrol/pentagi/issues/30
The local deepseek model uses X-Ais-Token authentication. How should I set the model's authentication method in the pentagi configuration?
@asdek commented on GitHub (Apr 9, 2025):
Hello @JacksonLvX,
Thank you for reaching out.
I'm not familiar with the X-Ais-Token authentication you mentioned. Could you please provide more details about the LLM backend you're using so I can better assist you?
@icebeer0525 commented on GitHub (Apr 10, 2025):
In DeepSeek's local deployment, the X-Ais-Token is a custom header used for authentication, typically passed via HTTP headers when calling the API. How to config it in pentagi?
@JacksonLvX commented on GitHub (Apr 10, 2025):
Hello @asdek ,
I use this method to request a local deepseek model. How should I configure the pentagi tool so that it passes X-Ais-Token authentication when calling deepseek?
@asdek commented on GitHub (Apr 23, 2025):
Hello @JacksonLvX and @icebeer0525
I apologize for the delayed response; I missed the notification about your messages.
Currently, PentAGI works only with OpenAI-compatible LLM servers. If you're considering an on-premises backend, you might want to explore vLLM, which is tested and supported within our framework.
According to the OpenAI API specification, authorization is handled via the header:
At this time, this is the only method PentAGI supports for sending authentication data.
I searched online for any backend that supports the
X-Ais-Tokenheader but unfortunately couldn't find any information. Could you please share a link to the backend you're using and its documentation? This would help me better understand how to integrate it with PentAGI.It's possible that your backend doesn't fully implement the OpenAI API specification. If that's the case, the issue might not only involve passing authentication data but also the overall communication with the LLM, including how messages are sent and received.
Without compatibility with the OpenAI API standards, PentAGI may not be able to interact properly with your LLM server.
Please provide more details about your backend so I can assist you further.