anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-22 02:05:26 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

[PR #9046] feat: use previous_response_id for Codex API optimization #12962

New Issue
Closed
opened 2026-02-16 18:17:50 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 18:17:50 -05:00
Owner
Copy Link
Copy Source

Original Pull Request: https://github.com/anomalyco/opencode/pull/9046

State: closed
Merged: No

Summary

Implements previous_response_id support to significantly reduce response latency when conversations grow long with Codex models.

Fixes #9045

Changes

  • Add responseId field to AssistantMessage schema to persist response IDs
  • Store responseId from providerMetadata.openai.responseId in processor.ts
  • Add previousResponseId to StreamInput type in llm.ts
  • Pass previousResponseId through providerOptions in transform.ts
  • Extract last assistant's responseId in prompt.ts and compaction.ts

How it works

Before: Every request sends the entire conversation history, causing O(n) or worse latency growth.

After: Subsequent requests reference the previous response via previous_response_id, allowing the API to skip re-processing the conversation history.

Request 1 → Full history → responseId saved
Request 2 → previousResponseId + new content → Fast response

Testing

  • Build passes successfully
  • The feature only activates for OpenAI providers that return responseId in metadata
**Original Pull Request:** https://github.com/anomalyco/opencode/pull/9046 **State:** closed **Merged:** No --- ## Summary Implements `previous_response_id` support to significantly reduce response latency when conversations grow long with Codex models. Fixes #9045 ## Changes - Add `responseId` field to `AssistantMessage` schema to persist response IDs - Store `responseId` from `providerMetadata.openai.responseId` in `processor.ts` - Add `previousResponseId` to `StreamInput` type in `llm.ts` - Pass `previousResponseId` through `providerOptions` in `transform.ts` - Extract last assistant's `responseId` in `prompt.ts` and `compaction.ts` ## How it works **Before:** Every request sends the entire conversation history, causing O(n) or worse latency growth. **After:** Subsequent requests reference the previous response via `previous_response_id`, allowing the API to skip re-processing the conversation history. ``` Request 1 → Full history → responseId saved Request 2 → previousResponseId + new content → Fast response ``` ## Testing - Build passes successfully - The feature only activates for OpenAI providers that return `responseId` in metadata
yindo added the pull-request label 2026-02-16 18:17:50 -05:00
yindo closed this issue 2026-02-16 18:17:50 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#12962
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?