mirror of
https://github.com/Mintplex-Labs/anything-llm.git
synced 2026-07-19 14:13:35 -04:00
Closed
opened 2026-02-22 18:28:22 -05:00 by yindo
·
2 comments
No Branch/Tag Specified
master
5846-bug-when-scrolling-up-scrolling-jumps
refactor-remove-workspace-pfp
5969-bug-stopgenerationbutton-disappears-on-the-first-prompt-that-initiates-an-agent-session
2235-bug-how-to-upload-a-folder-with-subfolders-with-files-to-anythingllm
5990-workspace-update-fails-with-unknown-argument-router_id-v1130v1150-intel-mac
opencomputer-examples
pg
feat/image-generation-translations
feat/image-generation
5924-bug-meeting-summary-fails-with-sincludes-is-not-a-function-when-default-llm-is-anthropic-claude
render
feat/uniform-modal-component
5883-bug-unescaped-content-in-json-strings-being-passed-to-document-generator-tools
5901-bug-api-update-embeddings-fails-prisma-argument-filename-is-missing-on-workspace_documentscreate-desktop-windows-v1141
hybrid-search
1981-translations
5752-bug-prompts-to-local-jan-endpoint-unresponsive
feat-disable-native-tool-calling-env-var
5676-bug-non-ollama-agent-providers-do-not-parse-and-present-reasoning-content
feat/markdown-web-scraping
5717-bug-apiv1documentupload-silently-drops-metadata-field-in-desktop-1130-arg-count-mismatch-nested-payload-key
fix/aibitat-context-overflow
5711-bug-erratic-deepseek-v4-flash-the-agent-model-failed-to-respond-400-the-reasoning_content
5631-feat-custom-api-request-timeouts-for-ai-providers
feat-reasoning-control
feat-agent-clarifying-questions-translations
5583-bug-lm-studio-provider-does-not-present-reasoning-output
5313-normalize-translations
feat/memory-translations
5305-lemonade-embedding-engine-swallows-errors-falsely-reports-documents-as-embedded
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
pptx-subagent
feat-render-images-from-mcp-tool-results
stt-provider-expansion-openai-api-compatible
feat-file-search-agent-tool
feat-native-embedder-job-queue
5189-normalize-translations
feat-file-search-agent-tool-translations
i18n-eslint
5140-auto-migration
5112-bug-openrouter-failed-message-bug
3506-feat-parameters-for-openrouter-models
4992-feat-preserve-scroll-position
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.15.0
v1.14.2
v1.14.1
v1.14.0
v1.13.0
v1.12.1
v1.12.0
v1.11.2
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
question
stage: specifications
wontfix
Mirrored from GitHub Pull Request
No Label
possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: Mintplex-Labs/anything-llm#2156
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @colakang on GitHub (Feb 26, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3348
How are you running AnythingLLM?
Docker (local)
What happened?
I've encountered an issue while using the agents mode. After submitting a query, I received a "no response" message. Upon checking the logs, I noticed the process was continuously retrying, which resulted in a charge of $20 USD for this single query.
I haven't experienced this problem in the standard mode. The issue only occurs when using the @agent command. I should mention that I have enabled RAG and document review permissions.
Has anyone else faced similar issues or knows how to resolve this problem? I'm concerned about unexpected costs accumulating due to these retry loops.
Log:
[backend] info: [Event Logged] - sent_chat
[backend] info: [AgentHandler] Start 695db8c2-03c4-42f8-b868-7b29289320fc::openai:gpt-4o
[backend] info: [TELEMETRY SENT] {"event":"agent_chat_started","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"runtime":"docker"}}
[backend] info: [AgentHandler] Attached websocket plugin to Agent cluster
[backend] info: [AgentHandler] Attached chat-history plugin to Agent cluster
[backend] info: [AgentHandler] Attaching user and default agent to Agent cluster.
[backend] info: [AgentHandler] Attached rag-memory plugin to Agent cluster
[backend] info: [AgentHandler] Attached document-summarizer plugin to Agent cluster
[backend] info: [AgentHandler] Attached create-chart plugin to Agent cluster
[backend] info: [AgentHandler] Attached web-browsing plugin to Agent cluster
[backend] info: [TELEMETRY SENT] {"event":"agent_chat_sent","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"runtime":"docker"}}
[backend] info: [AgentHandler] End 695db8c2-03c4-42f8-b868-7b29289320fc::openai:gpt-4o
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] info: [TELEMETRY SENT] {"event":"sent_chat","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"multiUserMode":true,"LLMSelection":"openai","Embedder":"openai","VectorDbSelection":"pinecone","multiModal":false,"TTSSelection":"native","runtime":"docker"}}
[backend] info: [Event Logged] - sent_chat
[backend] info: [AgentHandler] Start f3a96998-17d5-44ff-9b88-eaa39e089b48::openai:gpt-4o
[backend] info: [TELEMETRY SENT] {"event":"agent_chat_started","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"runtime":"docker"}}
[backend] info: [AgentHandler] Attached websocket plugin to Agent cluster
[backend] info: [AgentHandler] Attached chat-history plugin to Agent cluster
[backend] info: [AgentHandler] Attaching user and default agent to Agent cluster.
[backend] info: [AgentHandler] Attached rag-memory plugin to Agent cluster
[backend] info: [AgentHandler] Attached document-summarizer plugin to Agent cluster
[backend] info: [AgentHandler] Attached create-chart plugin to Agent cluster
[backend] info: [TokenManager] Returning existing instance for model: gpt-4o
[backend] info: [TELEMETRY SENT] {"event":"agent_chat_sent","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"runtime":"docker"}}
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] info: [TokenManager] Returning existing instance for model: gpt-4o
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:634:22)
[backend] error: (node:139) MaxListenersExceededWarning: Possible EventTarget memory leak detected. 11 abort listeners added to [AbortSignal]. Use events.setMaxListeners() to increase limit
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] info: [AgentHandler] End f3a96998-17d5-44ff-9b88-eaa39e089b48::openai:gpt-4o
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] info: Client took too long to respond, chat thread is dead after 300000ms
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] info: [TokenManager] Returning existing instance for model: gpt-4o
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:634:22)
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Failed to calculate number of tokens, falling back to approximate count Error: Unknown model
at getEncodingNameForModel (/app/server/node_modules/js-tiktoken/dist/lite.cjs:230:13)
at encodingForModel (/app/server/node_modules/@langchain/core/dist/utils/tiktoken.cjs:23:59)
at ChatOpenAI.getNumTokens (/app/server/node_modules/@langchain/core/dist/language_models/base.cjs:182:75)
at LLMChain._getNumTokens (/app/server/node_modules/langchain/dist/chains/llm_chain.cjs:212:44)
at MapReduceDocumentsChain._call (/app/server/node_modules/langchain/dist/chains/combine_docs_chain.cjs:180:73)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async MapReduceDocumentsChain.invoke (/app/server/node_modules/langchain/dist/chains/base.cjs:58:28)
at async summarizeContent (/app/server/utils/agents/aibitat/utils/summarize.js:55:15)
at async Object.summarizeDoc (/app/server/utils/agents/aibitat/plugins/summarize.js:159:22)
at async Object.handler (/app/server/utils/agents/aibitat/plugins/summarize.js:63:22)
[backend] info: [TELEMETRY SENT] {"event":"sent_chat","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"multiUserMode":true,"LLMSelection":"openai","Embedder":"openai","VectorDbSelection":"pinecone","multiModal":false,"TTSSelection":"native","runtime":"docker"}}
[backend] info: [Event Logged] - sent_chat
[backend] info: [TELEMETRY SENT] {"event":"agent_chat_sent","distinctId":"6a267e67-572f-4790-a390-c3a6643224d6","properties":{"runtime":"docker"}}
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] info: Client took too long to respond, chat thread is dead after 300000ms
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
[backend] error: error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions? Error: 404 This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?
at OpenAIProvider.complete (/app/server/utils/agents/aibitat/providers/openai.js:126:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async AIbitat.handleExecution (/app/server/utils/agents/aibitat/index.js:596:24)
at async AIbitat.reply (/app/server/utils/agents/aibitat/index.js:578:21)
at async AIbitat.chat (/app/server/utils/agents/aibitat/index.js:374:15)
at async AIbitat.retry (/app/server/utils/agents/aibitat/index.js:712:5)
[backend] error: retrying in 60 seconds...
Are there known steps to reproduce?
No response
@timothycarambat commented on GitHub (Feb 26, 2025):
What model are you using for this? The looping is not weird since that is exactly how agents work - however it shows that each call was a 404 so these tokens should not have even been sent. Also the UI did not show you anything related to this error while you were in a waiting state? You should have been seeing continous loading states or failures in the UI being reported.
@colakang commented on GitHub (Feb 26, 2025):
I'm using GPT-4o as my default chat model and haven't specifically configured which model the agents use - it's set to the system default.
The UI didn't show any error messages. It only displayed "AI agents executing tasks" for about 5-6 minutes before finally reporting that it couldn't find the information I was querying.
My document is a 2MB Excel file, and I have both RAG and document summarize features enabled for the agents functionality.
I only discovered the $20+ cost when checking my OpenAI billing details afterward. There was no indication during the process that multiple retries were occurring or that costs were accumulating.
So while the looping behavior might be expected for agents, the lack of feedback about 404 errors and the continuous billing without any budget controls seems problematic. The system continued to charge me despite failing to access the required resources.
[BUG]: @agents continuously retrying without budget control limitsto [GH-ISSUE #3348] [BUG]: @agents continuously retrying without budget control limits