[GH-ISSUE #2274] [BUG]: Perplexity model name does not match models available via the API #1485

Closed
opened 2026-02-22 18:25:03 -05:00 by yindo · 5 comments
Owner

Originally created by @rahul-tar on GitHub (Sep 12, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2274

How are you running VectorAdmin?

Docker (local)

What happened?

The model name under perplexity is wrong and does not match any model on perplexity model card.

Are there known steps to reproduce?

Follow these steps:
Chat Settings > Workspace LLM Provider > Perplexity AI > Workspace Chat Model > llama-3.1-sonar-huge-128k-chat

Now try chatting and it will say invalid model. That's because llama-3.1-sonar-huge-128k-chat is not the right name for the 405B model. It is llama-3.1-sonar-huge-128k-online as seen in docs here - https://docs.perplexity.ai/guides/model-cards

Originally created by @rahul-tar on GitHub (Sep 12, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2274 ### How are you running VectorAdmin? Docker (local) ### What happened? The model name under perplexity is wrong and does not match any model on perplexity model card. ### Are there known steps to reproduce? Follow these steps: Chat Settings > Workspace LLM Provider > Perplexity AI > Workspace Chat Model > llama-3.1-sonar-huge-128k-chat Now try chatting and it will say invalid model. That's because `llama-3.1-sonar-huge-128k-chat` is not the right name for the 405B model. It is `llama-3.1-sonar-huge-128k-online` as seen in docs here - https://docs.perplexity.ai/guides/model-cards
yindo added the possible bug label 2026-02-22 18:25:03 -05:00
yindo closed this issue 2026-02-22 18:25:03 -05:00
Author
Owner

@timothycarambat commented on GitHub (Sep 12, 2024):

This chore is so annoying. I really wish they would just host a /models endpoint so we dont have to keep doing this...

@timothycarambat commented on GitHub (Sep 12, 2024): This chore is so annoying. I really wish they would just host a /models endpoint so we dont have to keep doing this...
Author
Owner

@rahul-tar commented on GitHub (Sep 12, 2024):

This chore is so annoying. I really wish they would just host a /models endpoint so we dont have to keep doing this...

Totally get that!
Maybe scrape their model cards URL periodically to get model names?

@rahul-tar commented on GitHub (Sep 12, 2024): > This chore is so annoying. I really wish they would just host a /models endpoint so we dont have to keep doing this... Totally get that! Maybe scrape their model cards URL periodically to get model names?
Author
Owner

@timothycarambat commented on GitHub (Sep 12, 2024):

Would be way more effort than its worth because they also keep changing the docs page too! 😆

~$3B company and can't make a /models endpoint like everyone else, crazy!

@timothycarambat commented on GitHub (Sep 12, 2024): Would be way more effort than its worth because they _also_ keep changing the docs page too! 😆 ~$3B company and can't make a /models endpoint like everyone else, crazy!
Author
Owner

@rahul-tar commented on GitHub (Sep 12, 2024):

Would be way more effort than its worth because they also keep changing the docs page too! 😆

~$3B company and can't make a /models endpoint like everyone else, crazy!

brainstorming here: Maybe a feature where user can type in model name in addition to the preset drop down?

@rahul-tar commented on GitHub (Sep 12, 2024): > Would be way more effort than its worth because they _also_ keep changing the docs page too! 😆 > > ~$3B company and can't make a /models endpoint like everyone else, crazy! brainstorming here: Maybe a feature where user can type in model name in addition to the preset drop down?
Author
Owner

@timothycarambat commented on GitHub (Sep 12, 2024):

Ideally, yeah - basically a combobox for those who dont allow us to pull models dynamically!

@timothycarambat commented on GitHub (Sep 12, 2024): Ideally, yeah - basically a combobox for those who dont allow us to pull models dynamically!
yindo changed title from [BUG]: Perplexity model name does not match models available via the API to [GH-ISSUE #2274] [BUG]: Perplexity model name does not match models available via the API 2026-06-05 14:41:01 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1485