anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-22 02:05:26 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

bufio.Scanner: token too long #2260

New Issue
Closed
opened 2026-02-16 17:34:52 -05:00 by yindo · 15 comments
yindo commented 2026-02-16 17:34:52 -05:00
Owner
Copy Link
Copy Source

Originally created by @anthonymq on GitHub (Oct 24, 2025).

Originally assigned to: @rekram1-node on GitHub.

Description

Hi,
When working on a small repo, opencode is stuck after i get a notification "bufio.Scanner: token too long"
After that it's stuck on "Generating..."

in the logs i see:

ERROR 2025-10-24T12:46:16 +40ms service=tui error=bufio.Scanner: token too long Error streaming events
INFO  2025-10-24T12:46:16 +43ms service=snapshot hash=1a759a0149a0c3129b2cc0c5c0bd1da90352e796
 cwd=/Users/antmarqu3/workspace-perso/qa-gitlab git=/Users/antmarqu3/.local/share/opencode/snapshot/d07b7ad4b93274723e8059e42f36a2fca2e70f17 tracking
INFO  2025-10-24T12:46:16 +1ms service=bus type=message.part.updated publishing
INFO  2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-start part
INFO  2025-10-24T12:46:16 +5ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part
INFO  2025-10-24T12:46:16 +2ms service=bus type=message.part.updated publishing
INFO  2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part
INFO  2025-10-24T12:46:16 +0ms service=bus type=message.part.updated publishing
INFO  2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part
INFO  2025-10-24T12:46:16 +1ms service=bus type=message.part.updated publishing
INFO  2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part
INFO  2025-10-24T12:46:16 +0ms service=bus type=message.part.updated publishing
INFO  2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part
INFO  2025-10-24T12:46:16 +0ms service=bus type=message.part.updated publishing
INFO  2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part

OpenCode version

No response

Steps to reproduce

No response

Screenshot and/or share link

No response

Operating System

No response

Terminal

No response

Originally created by @anthonymq on GitHub (Oct 24, 2025). Originally assigned to: @rekram1-node on GitHub. ### Description Hi, When working on a small repo, opencode is stuck after i get a notification "bufio.Scanner: token too long" After that it's stuck on "Generating..." in the logs i see: ``` ERROR 2025-10-24T12:46:16 +40ms service=tui error=bufio.Scanner: token too long Error streaming events INFO 2025-10-24T12:46:16 +43ms service=snapshot hash=1a759a0149a0c3129b2cc0c5c0bd1da90352e796 cwd=/Users/antmarqu3/workspace-perso/qa-gitlab git=/Users/antmarqu3/.local/share/opencode/snapshot/d07b7ad4b93274723e8059e42f36a2fca2e70f17 tracking INFO 2025-10-24T12:46:16 +1ms service=bus type=message.part.updated publishing INFO 2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-start part INFO 2025-10-24T12:46:16 +5ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part INFO 2025-10-24T12:46:16 +2ms service=bus type=message.part.updated publishing INFO 2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part INFO 2025-10-24T12:46:16 +0ms service=bus type=message.part.updated publishing INFO 2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part INFO 2025-10-24T12:46:16 +1ms service=bus type=message.part.updated publishing INFO 2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part INFO 2025-10-24T12:46:16 +0ms service=bus type=message.part.updated publishing INFO 2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part INFO 2025-10-24T12:46:16 +0ms service=bus type=message.part.updated publishing INFO 2025-10-24T12:46:16 +0ms service=session.prompt session=ses_5e9bf06d4ffeCJMWSIdbfCDK7v type=reasoning-delta part ``` ### OpenCode version _No response_ ### Steps to reproduce _No response_ ### Screenshot and/or share link _No response_ ### Operating System _No response_ ### Terminal _No response_
yindo added the bug label 2026-02-16 17:34:52 -05:00
yindo closed this issue 2026-02-16 17:34:52 -05:00
yindo commented 2026-02-16 17:34:52 -05:00
Author
Owner
Copy Link
Copy Source

@github-actions[bot] commented on GitHub (Oct 24, 2025):

This issue might be a duplicate of existing issues. Please check:

  • #2512: Opencode stuck in "generating" - same symptoms of being stuck at "Generating" with unresponsiveness
  • #2137: Message generation interrupted, stuck at Generating - similar stuck behavior during generation
  • #2819: TUI stuck forever - application getting stuck after startup
  • #2699: Stuck on "Generating ..." - identical stuck behavior during generation

Feel free to ignore if none of these address your specific case.

@github-actions[bot] commented on GitHub (Oct 24, 2025): This issue might be a duplicate of existing issues. Please check: - #2512: Opencode stuck in "generating" - same symptoms of being stuck at "Generating" with unresponsiveness - #2137: Message generation interrupted, stuck at `Generating` - similar stuck behavior during generation - #2819: TUI stuck forever - application getting stuck after startup - #2699: Stuck on "Generating ..." - identical stuck behavior during generation Feel free to ignore if none of these address your specific case.
yindo commented 2026-02-16 17:34:52 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Oct 24, 2025):

Hm that's interesting. This will be fixed very soon because all the go code is about to die

@rekram1-node commented on GitHub (Oct 24, 2025): Hm that's interesting. This will be fixed very soon because all the go code is about to die
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@melMass commented on GitHub (Oct 26, 2025):

@rekram1-node is there anything to do? This is among a lot of things that currently stale whole sessions (exiting/resuming it doesn't work)

@melMass commented on GitHub (Oct 26, 2025): @rekram1-node is there anything to do? This is among a lot of things that currently stale whole sessions (exiting/resuming it doesn't work)
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@melMass commented on GitHub (Oct 26, 2025):

It's actually sneaky.. It does run the request/edit file if in edit mode. The UI is just stuck, queued message are also ran, but the UI is "stuck" (only seing my messages stacking up), exiting opencode and going back to the same session I can see the answers/tool calls

Panic Stack on exit:

here 
panic: reflect: NumField of non-struct type tea.Model

goroutine 257 [running]:
reflect.(*rtype).NumField(0x0?)
        /opt/hostedtoolcache/go/1.24.7/x64/src/reflect/type.go:782 +0x59
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder.func1({0x1152890, 0xcbeea0}, {0xc015b89d10, 0x1, 0x1})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:221 +0xc2
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder.func1({0x1152890, 0xd719e0}, {0x174f000, 0x0, 0x0})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:230 +0x236
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder(0xc002802048, {0x1152890, 0xd719e0})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:264 +0x149
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newTypeEncoder(0xc002802048, {0x1152890, 0xd719e0})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:130 +0x33f
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).typeEncoder(0xc002802048, {0x1152890, 0xd719e0})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:93 +0x1d2
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newTypeEncoder.encoder.newInterfaceEncoder.func4({0xc8d100?, 0xc004745ac0?, 0xc8d100?})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:333 +0x68
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).encodeMapEntries(0xc00000e108, {0xc015b89cf0, 0x2, 0x2}, {0xcc0b20?, 0xc005f1c330?, 0x10?})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:372 +0x53b
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newTypeEncoder.(*encoder).newMapEncoder.func3({0xcc0b20?, 0xc005f1c330?, 0xc002a09298?})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:392 +0x65
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newFieldTypeEncoder.func1({0xd3bc80?, 0xc005f1c320?, 0xc0004340e0?})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:316 +0x1d6
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder.func3({0xd39380?, 0xc005f1c240?, 0xd39380?})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:276 +0x145
github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).marshal(0xd39380?, {0xd39380?, 0xc005f1c240?})
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:61 +0xd5
github.com/sst/opencode-sdk-go/internal/apijson.MarshalRoot(...)
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:32
github.com/sst/opencode-sdk-go.AppLogParams.MarshalJSON({{{0x0, 0x0}, {0xd8b325, 0x4}, 0x0, 0x1, {0x0, 0x0}}, {{0x0, 0x0}, ...}, ...})
        /home/runner/work/opencode/opencode/packages/sdk/go/app.go:229 +0x57
github.com/sst/opencode-sdk-go/internal/requestconfig.NewRequestConfig({0x1146b78, 0x174f000}, {0xd8b2f9, 0x4}, {0xd8a69e, 0x3}, {0xd39380, 0xc005f1c120}, {0xc56f80, 0xc016538248}, ...)
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/requestconfig/requestconfig.go:98 +0xa5
github.com/sst/opencode-sdk-go/internal/requestconfig.ExecuteNewRequest({0x1146b78?, 0x174f000?}, {0xd8b2f9?, 0x0?}, {0xd8a69e?, 0xcaef60?}, {0xd39380?, 0xc005f1c120?}, {0xc56f80, 0xc016538248}, ...)
        /home/runner/work/opencode/opencode/packages/sdk/go/internal/requestconfig/requestconfig.go:563 +0x85
github.com/sst/opencode-sdk-go.(*AppService).Log(_, {_, _}, {{{0x0, 0x0}, {0xd8b325, 0x4}, 0x0, 0x1, {0x0, ...}}, ...}, ...)
        /home/runner/work/opencode/opencode/packages/sdk/go/app.go:41 +0x2be
github.com/sst/opencode/internal/util.NewAPILogHandler.func1()
        /home/runner/work/opencode/opencode/packages/tui/internal/util/apilogger.go:55 +0x136
created by github.com/sst/opencode/internal/util.NewAPILogHandler in goroutine 1
        /home/runner/work/opencode/opencode/packages/tui/internal/util/apilogger.go:49 +0x145
@melMass commented on GitHub (Oct 26, 2025): It's actually sneaky.. It does run the request/edit file if in edit mode. The UI is just stuck, queued message are also ran, but the UI is "stuck" (only seing my messages stacking up), exiting opencode and going back to the same session I can see the answers/tool calls Panic Stack on exit: <details><summary>here</summary> ``` panic: reflect: NumField of non-struct type tea.Model goroutine 257 [running]: reflect.(*rtype).NumField(0x0?) /opt/hostedtoolcache/go/1.24.7/x64/src/reflect/type.go:782 +0x59 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder.func1({0x1152890, 0xcbeea0}, {0xc015b89d10, 0x1, 0x1}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:221 +0xc2 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder.func1({0x1152890, 0xd719e0}, {0x174f000, 0x0, 0x0}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:230 +0x236 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder(0xc002802048, {0x1152890, 0xd719e0}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:264 +0x149 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newTypeEncoder(0xc002802048, {0x1152890, 0xd719e0}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:130 +0x33f github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).typeEncoder(0xc002802048, {0x1152890, 0xd719e0}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:93 +0x1d2 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newTypeEncoder.encoder.newInterfaceEncoder.func4({0xc8d100?, 0xc004745ac0?, 0xc8d100?}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:333 +0x68 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).encodeMapEntries(0xc00000e108, {0xc015b89cf0, 0x2, 0x2}, {0xcc0b20?, 0xc005f1c330?, 0x10?}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:372 +0x53b github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newTypeEncoder.(*encoder).newMapEncoder.func3({0xcc0b20?, 0xc005f1c330?, 0xc002a09298?}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:392 +0x65 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newFieldTypeEncoder.func1({0xd3bc80?, 0xc005f1c320?, 0xc0004340e0?}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:316 +0x1d6 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).newStructTypeEncoder.func3({0xd39380?, 0xc005f1c240?, 0xd39380?}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:276 +0x145 github.com/sst/opencode-sdk-go/internal/apijson.(*encoder).marshal(0xd39380?, {0xd39380?, 0xc005f1c240?}) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:61 +0xd5 github.com/sst/opencode-sdk-go/internal/apijson.MarshalRoot(...) /home/runner/work/opencode/opencode/packages/sdk/go/internal/apijson/encoder.go:32 github.com/sst/opencode-sdk-go.AppLogParams.MarshalJSON({{{0x0, 0x0}, {0xd8b325, 0x4}, 0x0, 0x1, {0x0, 0x0}}, {{0x0, 0x0}, ...}, ...}) /home/runner/work/opencode/opencode/packages/sdk/go/app.go:229 +0x57 github.com/sst/opencode-sdk-go/internal/requestconfig.NewRequestConfig({0x1146b78, 0x174f000}, {0xd8b2f9, 0x4}, {0xd8a69e, 0x3}, {0xd39380, 0xc005f1c120}, {0xc56f80, 0xc016538248}, ...) /home/runner/work/opencode/opencode/packages/sdk/go/internal/requestconfig/requestconfig.go:98 +0xa5 github.com/sst/opencode-sdk-go/internal/requestconfig.ExecuteNewRequest({0x1146b78?, 0x174f000?}, {0xd8b2f9?, 0x0?}, {0xd8a69e?, 0xcaef60?}, {0xd39380?, 0xc005f1c120?}, {0xc56f80, 0xc016538248}, ...) /home/runner/work/opencode/opencode/packages/sdk/go/internal/requestconfig/requestconfig.go:563 +0x85 github.com/sst/opencode-sdk-go.(*AppService).Log(_, {_, _}, {{{0x0, 0x0}, {0xd8b325, 0x4}, 0x0, 0x1, {0x0, ...}}, ...}, ...) /home/runner/work/opencode/opencode/packages/sdk/go/app.go:41 +0x2be github.com/sst/opencode/internal/util.NewAPILogHandler.func1() /home/runner/work/opencode/opencode/packages/tui/internal/util/apilogger.go:55 +0x136 created by github.com/sst/opencode/internal/util.NewAPILogHandler in goroutine 1 /home/runner/work/opencode/opencode/packages/tui/internal/util/apilogger.go:49 +0x145 ``` </details>
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Oct 26, 2025):

what version are you on?

@rekram1-node commented on GitHub (Oct 26, 2025): what version are you on?
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@melMass commented on GitHub (Oct 26, 2025):

latest: 0.15.18 on linux and macos

@melMass commented on GitHub (Oct 26, 2025): latest: 0.15.18 on linux and macos
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Oct 26, 2025):

hm okay Ill try to find cause so we can fix it

@rekram1-node commented on GitHub (Oct 26, 2025): hm okay Ill try to find cause so we can fix it
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@yudgnahk commented on GitHub (Oct 28, 2025):

hm okay Ill try to find cause so we can fix it

Hi @rekram1-node,
I already tried and made a PR to fix this bug.
I hope you can review my PR. Thanks!

@yudgnahk commented on GitHub (Oct 28, 2025): > hm okay Ill try to find cause so we can fix it Hi @rekram1-node, I already tried and made a PR to fix this bug. I hope you can review my PR. Thanks!
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Oct 28, 2025):

I checked it out, unfortunately editing the sdk directly wont' work since it is auto generated

@rekram1-node commented on GitHub (Oct 28, 2025): I checked it out, unfortunately editing the sdk directly wont' work since it is auto generated
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@ShadowArcanist commented on GitHub (Oct 29, 2025):

I am also experiencing the same issue on opencode v0.15.23 (macOS 13.7.8 (22H730))

@ShadowArcanist commented on GitHub (Oct 29, 2025): I am also experiencing the same issue on opencode v0.15.23 (macOS 13.7.8 (22H730))
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Oct 30, 2025):

should be fixed by: https://github.com/sst/opencode/pull/3531

Will be in next release

@rekram1-node commented on GitHub (Oct 30, 2025): should be fixed by: https://github.com/sst/opencode/pull/3531 Will be in next release
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@benceferdinandy-signifyd commented on GitHub (Nov 27, 2025):

I had a similar error "prompt is too long: 218083 tokens > 200000 maximum" but I think this is from Anthropic? Yet opencode stops completely instead of trying to resolve

@benceferdinandy-signifyd commented on GitHub (Nov 27, 2025): I had a similar error "prompt is too long: 218083 tokens > 200000 maximum" but I think this is from Anthropic? Yet opencode stops completely instead of trying to resolve
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@benceferdinandy-signifyd commented on GitHub (Nov 27, 2025):

Image

it's not possible to recover from here it seems

@benceferdinandy-signifyd commented on GitHub (Nov 27, 2025): <img width="811" height="295" alt="Image" src="https://github.com/user-attachments/assets/3a89d5e9-cb00-4eb3-8ccc-4812e9e2ce31" /> it's not possible to recover from here it seems
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Nov 30, 2025):

You can "recover" using /undo one or more times but we will fix this in a better way

@rekram1-node commented on GitHub (Nov 30, 2025): You can "recover" using /undo one or more times but we will fix this in a better way
yindo commented 2026-02-16 17:34:53 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Nov 30, 2025):

Also @benceferdinandy-signifyd this is about an error w/ bufio, not prompt lengths this was a scanner thingy.

Closing as done since we don't have Go as a dep anymore

@rekram1-node commented on GitHub (Nov 30, 2025): Also @benceferdinandy-signifyd this is about an error w/ bufio, not prompt lengths this was a scanner thingy. Closing as done since we don't have Go as a dep anymore
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#2260
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?