anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-21 17:56:33 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

Feature Request: Configurable context limit and auto-compaction threshold #5183

New Issue
Open
opened 2026-02-16 17:49:40 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 17:49:40 -05:00
Owner
Copy Link
Copy Source

Originally created by @LeekJay on GitHub (Jan 13, 2026).

Originally assigned to: @thdxr on GitHub.

Problem

Currently:

  1. Auto-compaction only triggers when the context is nearly full (count > context - output)
  2. Context limit is determined by the model and cannot be customized

For users who want to optimize costs, there's no way to:

  • Trigger compaction earlier
  • Limit the maximum context usage (e.g., use only 100k of a 200k model)

Proposed Solution

Add configurable options for context management:

{
  "compaction": {
    "auto": true,
    "prune": true,
    "threshold": 0.7,
    "maxContext": 100000
  }
}
  • threshold: A percentage (0.0 - 1.0) of the context limit at which auto-compaction should trigger. Default: 1.0 (current behavior)
  • maxContext: Maximum context tokens to use, overriding the model's default limit. Default: model's context limit

Implementation Suggestion

In compaction.ts, modify the isOverflow function:

export async function isOverflow(input: { tokens: MessageV2.Assistant["tokens"]; model: Provider.Model }) {
  const config = await Config.get()
  if (config.compaction?.auto === false) return false
  
  // Allow user to override model's context limit
  const modelContext = input.model.limit.context
  const maxContext = config.compaction?.maxContext ?? modelContext
  const context = Math.min(modelContext, maxContext)
  
  if (context === 0) return false
  const count = input.tokens.input + input.tokens.cache.read + input.tokens.output
  const output = Math.min(input.model.limit.output, SessionPrompt.OUTPUT_TOKEN_MAX) || SessionPrompt.OUTPUT_TOKEN_MAX
  
  // Apply threshold (default to 1.0 for backward compatibility)
  const threshold = config.compaction?.threshold ?? 1.0
  const usable = (context * threshold) - output
  
  return count > usable
}

Use Cases

  • Cost optimization: Limit context to 100k even when using a 200k model
  • Earlier compaction: Trigger compaction at 60-80% context usage
  • Predictable behavior: Avoid hitting context limits unexpectedly
  • Budget control: Prevent unexpectedly large API bills from long sessions
Originally created by @LeekJay on GitHub (Jan 13, 2026). Originally assigned to: @thdxr on GitHub. ## Problem Currently: 1. Auto-compaction only triggers when the context is nearly full (`count > context - output`) 2. Context limit is determined by the model and cannot be customized For users who want to optimize costs, there's no way to: - Trigger compaction earlier - Limit the maximum context usage (e.g., use only 100k of a 200k model) ## Proposed Solution Add configurable options for context management: ```json { "compaction": { "auto": true, "prune": true, "threshold": 0.7, "maxContext": 100000 } } ``` - `threshold`: A percentage (0.0 - 1.0) of the context limit at which auto-compaction should trigger. Default: `1.0` (current behavior) - `maxContext`: Maximum context tokens to use, overriding the model's default limit. Default: model's context limit ## Implementation Suggestion In `compaction.ts`, modify the `isOverflow` function: ```typescript export async function isOverflow(input: { tokens: MessageV2.Assistant["tokens"]; model: Provider.Model }) { const config = await Config.get() if (config.compaction?.auto === false) return false // Allow user to override model's context limit const modelContext = input.model.limit.context const maxContext = config.compaction?.maxContext ?? modelContext const context = Math.min(modelContext, maxContext) if (context === 0) return false const count = input.tokens.input + input.tokens.cache.read + input.tokens.output const output = Math.min(input.model.limit.output, SessionPrompt.OUTPUT_TOKEN_MAX) || SessionPrompt.OUTPUT_TOKEN_MAX // Apply threshold (default to 1.0 for backward compatibility) const threshold = config.compaction?.threshold ?? 1.0 const usable = (context * threshold) - output return count > usable } ``` ## Use Cases - **Cost optimization**: Limit context to 100k even when using a 200k model - **Earlier compaction**: Trigger compaction at 60-80% context usage - **Predictable behavior**: Avoid hitting context limits unexpectedly - **Budget control**: Prevent unexpectedly large API bills from long sessions
yindo added the enhancement label 2026-02-16 17:49:40 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#5183
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?