Skip to content

feat: Context Mode v2 - Tiered Output Routing #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
effortprogrammer wants to merge 2 commits into
base: main
Choose a base branch
from
Open

feat: Context Mode v2 - Tiered Output Routing #9

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
df05c85
feat: add Context Mode v2 - tiered output routing
effortprogrammer Mar 2, 2026
42286bb
fix: address review feedback for context router
effortprogrammer Mar 2, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 34 additions & 0 deletions docs/configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,40 @@ npx mcpflow-router opencode uninstall
| `ROUTER_GATEWAY_BUDGET_TOKENS` | `4000` | Token budget for selected tools |
| `ROUTER_GATEWAY_LOG` | `$TMPDIR/mcpflow-gateway.log` | Gateway log file path |

## Context Mode v2 (Output Routing)

Context Mode reduces tool output bloat by routing outputs through tiers:

| Tier | Threshold | Action |
|---|---|---|
| L0 | < 1 KB | Pass through unchanged |
| L1 | 1-10 KB | Algorithmic summary + file link |
| L2 | > 10 KB | L1 summary (agent delegation planned) |

> **Note:** L2 currently uses the same algorithmic summary as L1. Agent-based intelligent summarization is planned for a future release when the agent interface is finalized.

### Context Mode Environment Variables

| Variable | Default | Description |
|---|---|---|
| `CONTEXT_MODE_DISABLED` | _(unset)_ | Set to any value to disable output routing |
| `CONTEXT_MODE_DIR` | `/tmp/ctx` | Storage directory for original outputs |
| `CONTEXT_MODE_MAX_MB` | `100` | Max storage size before LRU cleanup |
| `CONTEXT_MODE_L0_THRESHOLD` | `1024` | L0/L1 boundary in bytes |
| `CONTEXT_MODE_L1_THRESHOLD` | `10240` | L1/L2 boundary in bytes |
| `CONTEXT_MODE_TOOL_OVERRIDES` | _(empty)_ | Force tools to tiers, e.g. `glob:L0,playwright:L2` |

### How Context Mode Works

When a tool produces output larger than L0 threshold:

1. Original output is saved to `/tmp/ctx/{tool}_{hash}.txt`
2. A summary is generated showing first/last lines and file link
3. The summary replaces the full output in the LLM context
4. The model can still access full output via `cat /tmp/ctx/...`

This complements mcpflow-router's tool selection (input optimization) with output optimization.

## Other Environment Variables

| Variable | Default | Description |
Expand Down
Loading