anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-22 18:25:32 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

[FEATURE]: Prompt + file edit logging for benchmarking #6648

New Issue
Open
opened 2026-02-16 18:04:51 -05:00 by yindo · 1 comment
yindo commented 2026-02-16 18:04:51 -05:00
Owner
Copy Link
Copy Source

Originally created by @0xrushi on GitHub (Jan 17, 2026).

Originally assigned to: @thdxr on GitHub.

Feature hasn't been suggested before.

  • I have verified this feature I'm about to request hasn't been suggested before.

Describe the enhancement you want to request

Hi! Would it be possible to add logging for:

  • the prompts sent to the model, and
  • the file edits/patches produced during execution

This would make it easier to replay the exact same prompt(s) and outputs for benchmarking across different models.

Optionally, we could also support an evaluation mode where an LLM acts as a judge to score/compare results for the same session.

Originally created by @0xrushi on GitHub (Jan 17, 2026). Originally assigned to: @thdxr on GitHub. ### Feature hasn't been suggested before. - [x] I have verified this feature I'm about to request hasn't been suggested before. ### Describe the enhancement you want to request Hi! Would it be possible to add logging for: * the prompts sent to the model, and * the file edits/patches produced during execution This would make it easier to replay the exact same prompt(s) and outputs for benchmarking across different models. Optionally, we could also support an evaluation mode where an LLM acts as a judge to score/compare results for the same session.
yindo added the discussion label 2026-02-16 18:04:51 -05:00
yindo commented 2026-02-16 18:04:51 -05:00
Author
Owner
Copy Link
Copy Source

@github-actions[bot] commented on GitHub (Jan 17, 2026):

This issue might be a duplicate of existing issues. Please check:

  • #9037: Feature Request: Add LLM API Call Duration Logging - Also requests logging of execution metrics for performance monitoring and debugging

Feel free to ignore if none of these address your specific case.

@github-actions[bot] commented on GitHub (Jan 17, 2026): This issue might be a duplicate of existing issues. Please check: - #9037: Feature Request: Add LLM API Call Duration Logging - Also requests logging of execution metrics for performance monitoring and debugging Feel free to ignore if none of these address your specific case.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label discussion
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#6648
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?