[GH-ISSUE #251] Error : 429 OpenAI::CreateModeration failed with: Request failed with status code 429 #151

Closed
opened 2026-02-22 18:18:06 -05:00 by yindo · 4 comments
Owner

Originally created by @MirzaAreebBaig on GitHub (Sep 27, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/251

Hello,
I have win 10 & setup the instance as OpenAI api & pinecone as vector database with multi user enabled & getting this error when trying to chat.

Originally created by @MirzaAreebBaig on GitHub (Sep 27, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/251 Hello, I have win 10 & setup the instance as OpenAI api & pinecone as vector database with multi user enabled & getting this error when trying to chat.
yindo closed this issue 2026-02-22 18:18:07 -05:00
Author
Owner

@timothycarambat commented on GitHub (Sep 28, 2023):

You 429 is a rate limit request - you either are using a key that is used elsewhere and it subject to rate limit or many users are on the same instance at the same time sending many chats per min.

You can disable moderation via code only currently. Will look into making this a feature you can fully turn off. Moderation calls do not count towards the limit if I recall.

@timothycarambat commented on GitHub (Sep 28, 2023): You 429 is a rate limit request - you either are using a key that is used elsewhere and it subject to rate limit or many users are on the same instance at the same time sending many chats per min. You can disable moderation via code only currently. Will look into making this a feature you can fully turn off. Moderation calls do not count towards the limit if I recall.
Author
Owner

@MirzaAreebBaig commented on GitHub (Sep 28, 2023):

Hello,
Thank you for your reply on this.
Yes i have generated another key & it worked but as of now its working but once i give access to multiple users on that same instance will this issue again arise?
Or as you have pointed i can disable moderation via code how can i achieve this?

@MirzaAreebBaig commented on GitHub (Sep 28, 2023): Hello, Thank you for your reply on this. Yes i have generated another key & it worked but as of now its working but once i give access to multiple users on that same instance will this issue again arise? Or as you have pointed i can disable moderation via code how can i achieve this?
Author
Owner

@timothycarambat commented on GitHub (Sep 28, 2023):

I would find it quite unlikely that even in a multi user instance you would hit the rate limit with normal human traffic unless your instance has hundreds of concurrent users chatting at the same time.

Comment out this section of code:
https://github.com/Mintplex-Labs/anything-llm/blob/e4a5fe5971b45d2415ec74f457d8be1c3a06510f/server/utils/chats/index.js#L78-L90

And it will not go through moderation - however if inappropriate questions are asked the LLM will start to return refusals

@timothycarambat commented on GitHub (Sep 28, 2023): I would find it quite unlikely that even in a multi user instance you would hit the rate limit with normal human traffic unless your instance has hundreds of concurrent users chatting at the same time. Comment out this section of code: https://github.com/Mintplex-Labs/anything-llm/blob/e4a5fe5971b45d2415ec74f457d8be1c3a06510f/server/utils/chats/index.js#L78-L90 And it will not go through moderation - however if inappropriate questions are asked the LLM will start to return refusals
Author
Owner

@MirzaAreebBaig commented on GitHub (Sep 29, 2023):

Alright that's great i got it. Thank you.

@MirzaAreebBaig commented on GitHub (Sep 29, 2023): Alright that's great i got it. Thank you.
yindo changed title from Error : 429 OpenAI::CreateModeration failed with: Request failed with status code 429 to [GH-ISSUE #251] Error : 429 OpenAI::CreateModeration failed with: Request failed with status code 429 2026-06-05 14:33:45 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#151