llama_cloud_services Support for Custom Embedding Endpoints? #478

Open
opened 2026-02-16 00:17:58 -05:00 by yindo · 0 comments
Owner

Originally created by @20130216 on GitHub (May 29, 2025).

I am trying to integrate a custom embedding provider (xxxAPI, endpoint: https://api.xxxapi.com/v1/) with LlamaCloud using the OPENAI_EMBEDDING type by setting api_base in the embedding_config. However, I encounter a 400 error: We encountered an error while validating the embedding connection. Please check the credentials and try again.

The documentation shows that AZURE_EMBEDDING supports a custom azure_endpoint, but OPENAI_EMBEDDING only includes api_key and model_name without an api_base or endpoint field. Does LlamaCloud support custom endpoints for OPENAI_EMBEDDING or other embedding types? If not, is there a plan to add support for third-party embedding providers with custom endpoints?

Originally created by @20130216 on GitHub (May 29, 2025). I am trying to integrate a custom embedding provider (xxxAPI, endpoint: https://api.xxxapi.com/v1/) with LlamaCloud using the OPENAI_EMBEDDING type by setting api_base in the embedding_config. However, I encounter a 400 error: We encountered an error while validating the embedding connection. Please check the credentials and try again. The documentation shows that AZURE_EMBEDDING supports a custom azure_endpoint, but OPENAI_EMBEDDING only includes api_key and model_name without an api_base or endpoint field. Does LlamaCloud support custom endpoints for OPENAI_EMBEDDING or other embedding types? If not, is there a plan to add support for third-party embedding providers with custom endpoints?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#478