litellm with claude 3.5 sonnet hangs #582

Closed
opened 2026-02-16 17:27:25 -05:00 by yindo · 1 comment
Owner

Originally created by @lg2m on GitHub (Jul 9, 2025).

Originally assigned to: @thdxr on GitHub.

> opencode run hi --print-logs
INFO  2025-07-09T19:02:21 +64ms service=app cwd=/home/zmeyer/Development/repos/github.com/lg2m/eee creating
INFO  2025-07-09T19:02:21 +0ms service=default version=0.2.15 args=run,hi,--print-logs opencode
INFO  2025-07-09T19:02:21 +1ms service=app cwd=/home/zmeyer/Development/repos/github.com/lg2m/eee creating
INFO  2025-07-09T19:02:21 +1ms service=app git
INFO  2025-07-09T19:02:21 +0ms service=app git
INFO  2025-07-09T19:02:21 +5ms service=app name=config registering service
INFO  2025-07-09T19:02:21 +1ms service=bus type=storage.write subscribing
INFO  2025-07-09T19:02:21 +0ms service=app name=bus registering service
INFO  2025-07-09T19:02:21 +0ms service=format init
INFO  2025-07-09T19:02:21 +0ms service=bus type=file.edited subscribing
INFO  2025-07-09T19:02:21 +0ms service=config.hooks init
INFO  2025-07-09T19:02:21 +0ms service=bus type=file.edited subscribing
INFO  2025-07-09T19:02:21 +0ms service=bus type=session.idle subscribing
INFO  2025-07-09T19:02:21 +0ms service=app name=lsp registering service
INFO  2025-07-09T19:02:21 +0ms service=lsp initializing
INFO  2025-07-09T19:02:21 +1ms service=session id=ses_80f6ebba4ffeMbnZdfM771LbiS version=0.2.15 title=New Session - 2025-07-09T19:02:21.531Z time=[object Object] created
INFO  2025-07-09T19:02:21 +0ms service=app name=session registering service
INFO  2025-07-09T19:02:21 +0ms service=app name=storage registering service
INFO  2025-07-09T19:02:21 +0ms service=lsp root=/home/zmeyer/Development/repos/github.com/lg2m/eee serverID=typescript
INFO  2025-07-09T19:02:21 +5ms service=config $schema=https://opencode.ai/config.json theme=ayu autoshare=false autoupdate=true model=litellm/us.anthropic.claude-3-5-sonnet-20241022-v2:0 provider=[object Object] loaded
INFO  2025-07-09T19:02:21 +1ms service=bus type=storage.write publishing
INFO  2025-07-09T19:02:21 +0ms service=app name=config registering service
INFO  2025-07-09T19:02:21 +0ms service=config $schema=https://opencode.ai/config.json theme=ayu autoshare=false autoupdate=true model=litellm/us.anthropic.claude-3-5-sonnet-20241022-v2:0 provider=[object Object] loaded
INFO  2025-07-09T19:02:21 +0ms service=bus type=session.updated publishing

█▀▀█ █▀▀█ █▀▀ █▀▀▄ █▀▀ █▀▀█ █▀▀▄ █▀▀
█░░█ █░░█ █▀▀ █░░█ █░░ █░░█ █░░█ █▀▀
▀▀▀▀ █▀▀▀ ▀▀▀ ▀  ▀ ▀▀▀ ▀▀▀▀ ▀▀▀  ▀▀▀

>  hi

@  litellm/us.anthropic.claude-3-5-sonnet-20241022-v2:0

INFO  2025-07-09T19:02:21 +1ms service=bus type=message.part.updated subscribing
INFO  2025-07-09T19:02:21 +0ms service=bus type=session.error subscribing
INFO  2025-07-09T19:02:21 +2ms service=session sessionID=ses_80f6ebba4ffeMbnZdfM771LbiS locking
INFO  2025-07-09T19:02:21 +0ms service=session session=ses_80f6ebba4ffeMbnZdfM771LbiS chatting
INFO  2025-07-09T19:02:21 +0ms service=app name=provider registering service
INFO  2025-07-09T19:02:21 +5ms service=models.dev refreshing
INFO  2025-07-09T19:02:21 +0ms service=provider init
INFO  2025-07-09T19:02:21 +3ms service=provider providerID=litellm found
INFO  2025-07-09T19:02:21 +0ms service=provider providerID=litellm modelID=us.anthropic.claude-3-5-sonnet-20241022-v2:0 getModel
INFO  2025-07-09T19:02:21 +0ms service=provider status=started providerID=litellm getSDK
INFO  2025-07-09T19:02:21 +67ms service=provider status=completed duration=67 providerID=litellm getSDK
INFO  2025-07-09T19:02:21 +2ms service=provider providerID=litellm modelID=us.anthropic.claude-3-5-sonnet-20241022-v2:0 found
INFO  2025-07-09T19:02:21 +12ms service=bus type=storage.write publishing
INFO  2025-07-09T19:02:21 +0ms service=bus type=message.updated publishing
INFO  2025-07-09T19:02:21 +7ms service=bus type=storage.write publishing
INFO  2025-07-09T19:02:21 +0ms service=bus type=message.updated publishing
INFO  2025-07-09T19:02:21 +1ms service=app name=mcp registering service
INFO  2025-07-09T19:02:21 +5ms service=session session=ses_80f6ebba4ffeMbnZdfM771LbiS type=start part
INFO  2025-07-09T19:02:21 +5ms service=lsp initialized
INFO  2025-07-09T19:02:21 +0ms service=bus type=storage.write publishing
INFO  2025-07-09T19:02:21 +0ms service=bus type=message.updated publishing
INFO  2025-07-09T19:02:22 +1016ms service=bus type=storage.write publishing
INFO  2025-07-09T19:02:22 +0ms service=bus type=session.updated publishing

logs from litellm:
litellm.APIConnectionError: BedrockException - {"message":"You invoked an unsupported model or your request did not allow prompt caching. See the documentation for more information."}. Received Model Group=us.anthropic.claude-3-5-sonnet-20241022-v2:0

appears to work w/ deepseek r1 and other anthropic models (3.7 in particular)

noticed it after the 0.2.6 update

Originally created by @lg2m on GitHub (Jul 9, 2025). Originally assigned to: @thdxr on GitHub. ``` > opencode run hi --print-logs INFO 2025-07-09T19:02:21 +64ms service=app cwd=/home/zmeyer/Development/repos/github.com/lg2m/eee creating INFO 2025-07-09T19:02:21 +0ms service=default version=0.2.15 args=run,hi,--print-logs opencode INFO 2025-07-09T19:02:21 +1ms service=app cwd=/home/zmeyer/Development/repos/github.com/lg2m/eee creating INFO 2025-07-09T19:02:21 +1ms service=app git INFO 2025-07-09T19:02:21 +0ms service=app git INFO 2025-07-09T19:02:21 +5ms service=app name=config registering service INFO 2025-07-09T19:02:21 +1ms service=bus type=storage.write subscribing INFO 2025-07-09T19:02:21 +0ms service=app name=bus registering service INFO 2025-07-09T19:02:21 +0ms service=format init INFO 2025-07-09T19:02:21 +0ms service=bus type=file.edited subscribing INFO 2025-07-09T19:02:21 +0ms service=config.hooks init INFO 2025-07-09T19:02:21 +0ms service=bus type=file.edited subscribing INFO 2025-07-09T19:02:21 +0ms service=bus type=session.idle subscribing INFO 2025-07-09T19:02:21 +0ms service=app name=lsp registering service INFO 2025-07-09T19:02:21 +0ms service=lsp initializing INFO 2025-07-09T19:02:21 +1ms service=session id=ses_80f6ebba4ffeMbnZdfM771LbiS version=0.2.15 title=New Session - 2025-07-09T19:02:21.531Z time=[object Object] created INFO 2025-07-09T19:02:21 +0ms service=app name=session registering service INFO 2025-07-09T19:02:21 +0ms service=app name=storage registering service INFO 2025-07-09T19:02:21 +0ms service=lsp root=/home/zmeyer/Development/repos/github.com/lg2m/eee serverID=typescript INFO 2025-07-09T19:02:21 +5ms service=config $schema=https://opencode.ai/config.json theme=ayu autoshare=false autoupdate=true model=litellm/us.anthropic.claude-3-5-sonnet-20241022-v2:0 provider=[object Object] loaded INFO 2025-07-09T19:02:21 +1ms service=bus type=storage.write publishing INFO 2025-07-09T19:02:21 +0ms service=app name=config registering service INFO 2025-07-09T19:02:21 +0ms service=config $schema=https://opencode.ai/config.json theme=ayu autoshare=false autoupdate=true model=litellm/us.anthropic.claude-3-5-sonnet-20241022-v2:0 provider=[object Object] loaded INFO 2025-07-09T19:02:21 +0ms service=bus type=session.updated publishing █▀▀█ █▀▀█ █▀▀ █▀▀▄ █▀▀ █▀▀█ █▀▀▄ █▀▀ █░░█ █░░█ █▀▀ █░░█ █░░ █░░█ █░░█ █▀▀ ▀▀▀▀ █▀▀▀ ▀▀▀ ▀ ▀ ▀▀▀ ▀▀▀▀ ▀▀▀ ▀▀▀ > hi @ litellm/us.anthropic.claude-3-5-sonnet-20241022-v2:0 INFO 2025-07-09T19:02:21 +1ms service=bus type=message.part.updated subscribing INFO 2025-07-09T19:02:21 +0ms service=bus type=session.error subscribing INFO 2025-07-09T19:02:21 +2ms service=session sessionID=ses_80f6ebba4ffeMbnZdfM771LbiS locking INFO 2025-07-09T19:02:21 +0ms service=session session=ses_80f6ebba4ffeMbnZdfM771LbiS chatting INFO 2025-07-09T19:02:21 +0ms service=app name=provider registering service INFO 2025-07-09T19:02:21 +5ms service=models.dev refreshing INFO 2025-07-09T19:02:21 +0ms service=provider init INFO 2025-07-09T19:02:21 +3ms service=provider providerID=litellm found INFO 2025-07-09T19:02:21 +0ms service=provider providerID=litellm modelID=us.anthropic.claude-3-5-sonnet-20241022-v2:0 getModel INFO 2025-07-09T19:02:21 +0ms service=provider status=started providerID=litellm getSDK INFO 2025-07-09T19:02:21 +67ms service=provider status=completed duration=67 providerID=litellm getSDK INFO 2025-07-09T19:02:21 +2ms service=provider providerID=litellm modelID=us.anthropic.claude-3-5-sonnet-20241022-v2:0 found INFO 2025-07-09T19:02:21 +12ms service=bus type=storage.write publishing INFO 2025-07-09T19:02:21 +0ms service=bus type=message.updated publishing INFO 2025-07-09T19:02:21 +7ms service=bus type=storage.write publishing INFO 2025-07-09T19:02:21 +0ms service=bus type=message.updated publishing INFO 2025-07-09T19:02:21 +1ms service=app name=mcp registering service INFO 2025-07-09T19:02:21 +5ms service=session session=ses_80f6ebba4ffeMbnZdfM771LbiS type=start part INFO 2025-07-09T19:02:21 +5ms service=lsp initialized INFO 2025-07-09T19:02:21 +0ms service=bus type=storage.write publishing INFO 2025-07-09T19:02:21 +0ms service=bus type=message.updated publishing INFO 2025-07-09T19:02:22 +1016ms service=bus type=storage.write publishing INFO 2025-07-09T19:02:22 +0ms service=bus type=session.updated publishing ``` logs from litellm: `litellm.APIConnectionError: BedrockException - {"message":"You invoked an unsupported model or your request did not allow prompt caching. See the documentation for more information."}. Received Model Group=us.anthropic.claude-3-5-sonnet-20241022-v2:0` appears to work w/ deepseek r1 and other anthropic models (3.7 in particular) noticed it after the 0.2.6 update
yindo closed this issue 2026-02-16 17:27:25 -05:00
Author
Owner

@rekram1-node commented on GitHub (Dec 27, 2025):

[automated] Closing due to 90+ days of inactivity. Feel free to reopen if you still need this!

@rekram1-node commented on GitHub (Dec 27, 2025): [automated] Closing due to 90+ days of inactivity. Feel free to reopen if you still need this!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#582