Skip to content

Context-window validation, 2026-10-02

For the latest measured model capacity, latency and cost, see model performance. This page retains the October 2 client-profile validation and its configuration-specific limits.

These synthetic text probes ran through the authenticated local mayu gateway, with one configured target per public model. They do not qualify arbitrary tools/history, model quality, another deployment/region, or an exact maximum. No prompt, virtual key, account identifier or session identifier is recorded in the machine-readable evidence.

Public model Declared bound Observed accepted input Result
openai.gpt-6.1-sol 1,050,000 600,026 About 1,048,000 synthetic units returned an unclassified upstream 400; maximum unresolved.
qwen.qwen3-coder-next 256,000 254,029 Accepted; client usable window may increase from 204,800 to 243,200.
global.xai.grok-4.7 500,000 430,037 Accepted; client usable window may increase from 400,000 to 425,000. Maximum unresolved.

Sol 6.1 also rejected reasoning.effort: "none" on a short request. The same short request succeeded without that native option. Native probes therefore leave effort unset; bridge probes use the existing neutral sentinel. The long native request still returned 400 without the effort option. The gateway hides the upstream error body, so neither error is promoted to an exact context limit. Sol 6.1's existing client bound/headroom remains unchanged. Its operational native declaration differs from the separate Converse example/worktree.

Installed Codex 0.159.3 runtime tests against loopback fakes confirmed model switching resolves Grok to 425,000 usable tokens and Qwen to 243,200, even with an inherited model_context_window=1048576. The local installed launcher and icodex shell integration were updated after validation; a new shell/client loads the operator profile. The gateway and global Codex config were not changed.

The total campaign ceiling was $30. Configured-price estimates for successful usage and conservative reservations for unknown failures are kept separately in the artifact; they are not AWS bill reconciliation. Failed calls are not assumed free. Remaining budget was insufficient for the next near-window Astra/Sol 6 probe, so those models remain unqualified rather than guessed.

To use the reviewed Qwen/Grok client adjustments:

export INFERPLANE_CODEX_CONTEXT_PROFILES="$PWD/examples/codex/context-profiles.json"
icodex -m qwen.qwen3-coder-next

The launcher reads the profile at startup, keeps the gateway's declared cap, and changes only usable/compaction percentages. For Qwen these are 95%/90%; for Grok they are 85%/82%. A changed gateway bound refuses the stale profile. Restart the client after installing a profile. Explicit caller compaction settings can still affect runtime compaction.

The reusable probe prints a plan unless --execute is supplied:

python3 scripts/inferplane-context-probe \
  --config /path/to/gateway-config.json --model qwen.qwen3-coder-next \
  --units 254000 --max-spend-usd 30 --ledger /path/to/campaign.json

For execution, privately export INFERPLANE_API_KEY and append --execute. Use the same ledger for every model/call in a campaign. The command locks the ledger across calls, persists the worst input/cache-price reservation before sending, never retries, bypasses ambient proxies, and refuses redirects. Prices come from local overrides and must conservatively cover the deployment's actual tiers; hosted tools/search are not invoked. No provider-secret references are resolved. Unknown failures keep their full reservation. A success is recorded as a qualified observation only when the public model remains unchanged and no model-substitution header is present. This is operator evidence, not financial authority or a proof against an adversarial/stale backend declaration.