[tip] serving config: --model /mnt/k8scache/models/Qwen3.8-27B-exl3-4.0bpw --kv-cache-dtype tkv --mtp-n-draft 5 --max-batch 4 --chunk-prefill 2048 --max-batched-tokens 8192 --max-context auto --device 0
[tip] backends=('paged_kv:tkv-k4v4',) defaults=() max_context=auto max_batched_tokens=8192 cuda_graphs=True prefill_capture=eager
boot: this card's residency could NOT be split between this process and any other — neither NVML's per-process walk nor a pre-context mark was available — so driver.cuda_context is being booked from the DEVICE-WIDE reading (397 MiB). If anything else is resident on this device, its bytes are inside that number and the KV pool is sized that much smaller for the life of this boot.
exllamav3 REVISION MISMATCH — this environment was not built for this source tree.
  this arbi_serve source requires  cb76869b47eecb30a8ed788d9218c4bf2cb7f09e
      (from arbi_serve.weight_quant.exl3.shim.EXLLAMAV3_GIT_REV, which tests/test_exl3_dep_managed.py holds equal to pyproject.toml's pin)
  the installed exllamav3 is  7b428549a7cc976fcb68b27c22b8680349efbf29
      (read from its dist-info direct_url.json (PEP 610))
This is the STALE IMAGE signature: a current arbi_serve calls a backend surface the installed revision does not have, and without this guard the first call to reach it raises an opaque TypeError/AttributeError far later in the boot, with nothing pointing at the image.
This image was built from arbi-serve 4cb1e2aaccbabcd1868a9a4497fb8de9397cfc22 (/etc/arbi-build-sha).
Fix, in the order most likely to apply:
  * Pull an image built at or after the commit that moved this pin. Name the IMMUTABLE per-commit tag of a green main run (`arbi-serve:test-<short sha>`), not the moving `:test-latest`: that tag only advances when a main CI run reaches its publish step, so a stretch of superseded or GPU-blocked runs leaves it pointing at an old build with nothing to say so.
  * Rebuild the image from this tree: scripts/build-slim.sh
  * Repair a local environment: uv sync, or pip install --no-deps 'exllamav3 @ git+https://github.com/arbi-dev/exllamav3.git@cb76869b47eecb30a8ed788d9218c4bf2cb7f09e'
  * ARBI_ALLOW_BACKEND_DRIFT=1 to proceed anyway, for a deliberate A/B.
(ARBI_ALLOW_BACKEND_DRIFT set — continuing anyway.)
compile-cache MISS: xgrammar — xgrammar compiled grammars (re)compiles this boot [/cache/xgrammar]
KV calibration bundle '/cal/qwen3.8-27b-exl3-4.0bpw_k4v4_mtp_20260816.json' is UNVERIFIED: the bundle carries no 'fingerprint' block (it predates bundle stamping), so none of [architectures, dtype, head_dim, hidden_size, model_name, num_attention_heads, num_hidden_layers, num_key_value_heads, weight_bytes, weight_quant] could be compared against this engine. A bundle fitted for a different model or weight quantisation loads without error and degrades output quality silently. Re-generate it with `arbi-serve --model <X> --calibrate-only <out.json>` to get a stamped bundle, or set ARBI_KV_BUNDLE_REQUIRE_FINGERPRINT=1 to refuse unstamped bundles.
VRAM at profile: this card's residency could NOT be split between this process and any other — NVML's per-process walk did not identify us — so the whole 14.84 GiB resident on device 0 is being booked as driver.cuda_context. Any co-tenant's bytes are inside that number and KV is sized that much smaller for this boot.
[tkv bake d256 gqa6 k4v4] 4 worker(s) for 11 variant(s) [at ceiling; avail=72.6GiB ram_cap=14 cpu_cap=9 per_worker=3.6GiB]
[tkv bake d256 gqa6 k4v4] 1/11 compiled (0.1s elapsed)
[tkv bake d256 gqa6 k4v4] 2/11 compiled (0.1s elapsed)[tkv bake d256 gqa6 k4v4] 3/11 compiled (0.1s elapsed)

[tkv bake d256 gqa6 k4v4] 4/11 compiled (0.1s elapsed)
[tkv bake d256 gqa6 k4v4] 5/11 compiled (0.1s elapsed)
[tkv bake d256 gqa6 k4v4] 6/11 compiled (0.1s elapsed)[tkv bake d256 gqa6 k4v4] 7/11 compiled (0.1s elapsed)[tkv bake d256 gqa6 k4v4] 8/11 compiled (0.1s elapsed)

[tkv bake d256 gqa6 k4v4] 9/11 compiled (0.1s elapsed)

[tkv bake d256 gqa6 k4v4] 10/11 compiled (0.2s elapsed)
[tkv bake d256 gqa6 k4v4] 11/11 compiled (0.2s elapsed)
[TKV autotune-provenance] fp=7105db2e6156f0b1 regime=cache-hit cells=16 sweep_src=b5332b8dfc1c8389 tile_tokens=4,8,16 num_splits=16,32,64,128,256 min_blocks_per_sm=0,3 resolved=0 held=0 inherited=0
[tkv bake d256 gqa6 k4v4] 4 worker(s) for 11 variant(s) [at ceiling; avail=72.6GiB ram_cap=14 cpu_cap=9 per_worker=3.6GiB]
[tkv bake d256 gqa6 k4v4] 1/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 2/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 3/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 4/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 5/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 6/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 7/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 8/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 9/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 10/11 compiled (0.0s elapsed)
[tkv bake d256 gqa6 k4v4] 11/11 compiled (0.0s elapsed)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -4 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: FinishOut for unknown request -1 dropped
OutputApplier: FinishOut for unknown request -2 dropped
OutputApplier: FinishOut for unknown request -3 dropped
OutputApplier: FinishOut for unknown request -4 dropped
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -4 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -1 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -2 dropped (late batch after cancel/finish is legal)
OutputApplier: TokenOut for unknown request -3 dropped (late batch after cancel/finish is legal)
OutputApplier: FinishOut for unknown request -1 dropped
OutputApplier: FinishOut for unknown request -2 dropped
OutputApplier: FinishOut for unknown request -3 dropped
OutputApplier: FinishOut for unknown request -4 dropped
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
max_context=auto: served context NARROWED to 198656 tokens (from the 262144-token sizing bound). This is the REAL served-context statement — the KV pool is realized: 784 servable pages × 256 tokens/page, less the 7-page capture-sentinel prefix and a 0-page allocator margin. The earlier sizing bound was a forecast and came out high. Pin --max-context explicitly to refuse loud instead.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
  return isinstance(obj, torch.Tensor)
  if not _in_default_pool(obj.data_ptr()):
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
serving floor: the measured stochastic verify tail (119 MiB) is below the fresh SamplingParams-chain bound (136 MiB) that step provably allocates with no pool line — reserving the bound. The persistent VerifyBuffers scratch is NOT in it; that pool is budgeted as capture.io_buffers.
[tip] int8 pins: {'5120x10240xK4': 111, '5120x6144xK4': 111, '6144x5120xK4': 111, '5120x17408xK4': 111, '17408x5120xK4': 111, '5120x12288xK4': 111, '5120x1024xK4': 111, '10240x5120xK4': 111}
[tip] declined: {'5120x248320xK6': "widest call site is 24 rows, below shape 111's TILE_M of 128"}
[transformers] Token indices sequence length is longer than the specified maximum sequence length for this model (317092 > 262144). Running this sequence through the model will result in indexing errors
[transformers] Token indices sequence length is longer than the specified maximum sequence length for this model (317092 > 262144). Running this sequence through the model will result in indexing errors
serving floor OVERRUN: real traffic has taken 90 MiB out of the 169 MiB the KV grow left, past the 72 MiB the boot serving realization measured the widest step to take. A step is reaching a block size the realization did not present, so what is left of the floor is the only cover for it. The serving_floor_overrun counter carries it.
[tip] warmup done
[tip] basket: 5 prompts x 8192 target tokens
  [8192][0.0] code       OFF    8192tok ttft=  2359.2ms logits=4 fired=0     refused=1636 length
  [8192][0.0] code       REF2   8192tok ttft=  2365.9ms logits=4 fired=0     refused=1636 length
  [8192][0.0] code       STD    8192tok ttft=  2495.1ms logits=4 fired=0     refused=1636 length
  [8192][0.0] code       T      8192tok ttft=  2852.2ms logits=4 fired=1632  refused=4 length
  [8192][0.0] code       G      8192tok ttft=  2921.4ms logits=4 fired=1632  refused=4 length
  [8192][0.1] wiki       OFF    8192tok ttft=  2373.7ms logits=4 fired=0     refused=1636 length
  [8192][0.1] wiki       REF2   8192tok ttft=  2388.8ms logits=4 fired=0     refused=1636 length
  [8192][0.1] wiki       STD    8192tok ttft=  2506.3ms logits=4 fired=0     refused=1636 length
  [8192][0.1] wiki       T      8192tok ttft=  1496.8ms logits=4 fired=1632  refused=4 length
  [8192][0.1] wiki       G      8192tok ttft=  1601.3ms logits=4 fired=1632  refused=4 length
  [8192][0.2] math       OFF    8192tok ttft=  2383.6ms logits=4 fired=0     refused=1636 length
  [8192][0.2] math       REF2   8192tok ttft=  2384.7ms logits=4 fired=0     refused=1636 length
  [8192][0.2] math       STD    8192tok ttft=  2512.8ms logits=4 fired=0     refused=1636 length
  [8192][0.2] math       T      8192tok ttft=  1500.0ms logits=4 fired=1632  refused=4 length
  [8192][0.2] math       G      8192tok ttft=  1600.3ms logits=4 fired=1632  refused=4 length
  [8192][0.3] longctx    OFF    8192tok ttft=  2388.8ms logits=4 fired=0     refused=1636 length
  [8192][0.3] longctx    REF2   8192tok ttft=  2389.6ms logits=4 fired=0     refused=1636 length
  [8192][0.3] longctx    STD    8192tok ttft=  2514.4ms logits=4 fired=0     refused=1636 length
  [8192][0.3] longctx    T      8192tok ttft=  1500.8ms logits=4 fired=1632  refused=4 length
  [8192][0.3] longctx    G      8192tok ttft=  1602.5ms logits=4 fired=1632  refused=4 length
  [8192][0.4] sci        OFF    8192tok ttft=  2394.7ms logits=4 fired=0     refused=1636 length
  [8192][0.4] sci        REF2   8192tok ttft=  2396.0ms logits=4 fired=0     refused=1636 length
  [8192][0.4] sci        STD    8192tok ttft=  2520.8ms logits=4 fired=0     refused=1636 length
  [8192][0.4] sci        T      8192tok ttft=  1501.6ms logits=4 fired=1632  refused=4 length
  [8192][0.4] sci        G      8192tok ttft=  1601.9ms logits=4 fired=1632  refused=4 length
[tip] basket: 5 prompts x 129024 target tokens
  [129024][0.0] code       OFF  129024tok ttft= 63349.8ms logits=63 fired=0     refused=25767 length
  [129024][0.0] code       REF2 129024tok ttft= 63443.2ms logits=63 fired=0     refused=25767 length
  [129024][0.0] code       STD  129024tok ttft= 65427.1ms logits=63 fired=0     refused=25767 length
  [129024][0.0] code       T    129024tok ttft= 48376.8ms logits=63 fired=25704 refused=63 length
  [129024][0.0] code       G    129024tok ttft= 49968.2ms logits=63 fired=25704 refused=63 length
  [129024][0.1] wiki       OFF  129024tok ttft= 63327.9ms logits=63 fired=0     refused=25767 length
  [129024][0.1] wiki       REF2 129024tok ttft= 63223.6ms logits=63 fired=0     refused=25767 length
  [129024][0.1] wiki       STD  129024tok ttft= 65296.0ms logits=63 fired=0     refused=25767 length
  [129024][0.1] wiki       T    129024tok ttft= 48270.4ms logits=63 fired=25704 refused=63 length
  [129024][0.1] wiki       G    129024tok ttft= 49889.4ms logits=63 fired=25704 refused=63 length
  [129024][0.2] math       OFF  129024tok ttft= 63432.1ms logits=63 fired=0     refused=25767 length
  [129024][0.2] math       REF2 129024tok ttft= 63398.5ms logits=63 fired=0     refused=25767 length
  [129024][0.2] math       STD  129024tok ttft= 65191.6ms logits=63 fired=0     refused=25767 length
  [129024][0.2] math       T    129024tok ttft= 48304.9ms logits=63 fired=25704 refused=63 length
  [129024][0.2] math       G    129024tok ttft= 49859.2ms logits=63 fired=25704 refused=63 length
  [129024][0.3] longctx    OFF  129024tok ttft= 63515.7ms logits=63 fired=0     refused=25767 length
  [129024][0.3] longctx    REF2 129024tok ttft= 63461.6ms logits=63 fired=0     refused=25767 length
  [129024][0.3] longctx    STD  129024tok ttft= 65297.2ms logits=63 fired=0     refused=25767 length
  [129024][0.3] longctx    T    129024tok ttft= 48386.3ms logits=63 fired=25704 refused=63 length
  [129024][0.3] longctx    G    129024tok ttft= 49946.4ms logits=63 fired=25704 refused=63 length
  [129024][0.4] sci        OFF  129024tok ttft= 63543.9ms logits=63 fired=0     refused=25767 length
  [129024][0.4] sci        REF2 129024tok ttft= 63487.9ms logits=63 fired=0     refused=25767 length
  [129024][0.4] sci        STD  129024tok ttft= 65296.8ms logits=63 fired=0     refused=25767 length
  [129024][0.4] sci        T    129024tok ttft= 48304.9ms logits=63 fired=25704 refused=63 length
  [129024][0.4] sci        G    129024tok ttft= 49924.0ms logits=63 fired=25704 refused=63 length
  [decode] OFF  64 tokens    81.75 tok/s  fired=0 refused=1843 {'int8 leg disarmed after a class was declared': 1843}
  [decode] REF2 64 tokens    82.17 tok/s  fired=0 refused=1843 {'int8 leg disarmed after a class was declared': 1843}
  [decode] STD  64 tokens    86.28 tok/s  fired=0 refused=1834 {'int8 leg disarmed after a class was declared': 1834}
  [decode] T    64 tokens    99.68 tok/s  fired=1632 refused=175 {"widest call site is 24 rows, below shape 111's TILE_M of 128": 4, 'forward declared no step class': 171}
  [decode] G    64 tokens    94.69 tok/s  fired=1632 refused=184 {"widest call site is 24 rows, below shape 111's TILE_M of 128": 4, 'forward declared no step class': 180}
  [decode] OFF  64 tokens    82.16 tok/s  fired=0 refused=1843 {'int8 leg disarmed after a class was declared': 1843}
  [decode] REF2 64 tokens    81.79 tok/s  fired=0 refused=1843 {'int8 leg disarmed after a class was declared': 1843}
  [decode] STD  64 tokens    85.96 tok/s  fired=0 refused=1834 {'int8 leg disarmed after a class was declared': 1834}
  [decode] T    64 tokens    99.32 tok/s  fired=1632 refused=175 {"widest call site is 24 rows, below shape 111's TILE_M of 128": 4, 'forward declared no step class': 171}
  [decode] G    64 tokens    94.04 tok/s  fired=1632 refused=184 {"widest call site is 24 rows, below shape 111's TILE_M of 128": 4, 'forward declared no step class': 180}

=== CENSUS, from the production counter, per arm over every timed call ===
  OFF   fired=0       refused=137015  {'int8 leg disarmed after a class was declared': 137015}
  REF2  fired=0       refused=137015  {'int8 leg disarmed after a class was declared': 137015}
  STD   fired=0       refused=137015  {'int8 leg disarmed after a class was declared': 137015}
  T     fired=136680  refused=335     {"widest call site is 24 rows, below shape 111's TILE_M of 128": 335}
  G     fired=136680  refused=335     {"widest call site is 24 rows, below shape 111's TILE_M of 128": 335}

=== 8192 target tokens: TTFT (median over prompts x reps), paired vs OFF ===
  OFF   ttft median   2383.6 ms   OFF/OFF per-prompt median 1.0000x [1.0000-1.0000]  fired/prompt 0
  REF2  ttft median   2388.8 ms   OFF/REF2 per-prompt median 0.9995x [0.9936-0.9996]  fired/prompt 0
  STD   ttft median   2512.8 ms   OFF/STD per-prompt median 0.9486x [0.9455-0.9500]  fired/prompt 0
  T     ttft median   1500.8 ms   OFF/T per-prompt median 1.5891x [0.8271-1.5948]  fired/prompt 1632
  G     ttft median   1601.9 ms   OFF/G per-prompt median 1.4894x [0.8076-1.4949]  fired/prompt 1632

=== 8192 target tokens: full-vocab KL vs OFF at PREFILL positions ===
  OFF   n=20   median 0.000e+00  p95 0.000e+00  max 0.000e+00  argmax flips 0/20
  REF2  n=20   median 0.000e+00  p95 0.000e+00  max 0.000e+00  argmax flips 0/20
  STD   n=20   median 2.768e-04  p95 1.252e+00  max 1.252e+00  argmax flips 1/20
  T     n=20   median 9.386e-04  p95 4.217e+00  max 4.217e+00  argmax flips 1/20
  G     n=20   median 8.900e-04  p95 1.803e+00  max 1.803e+00  argmax flips 2/20

=== 129024 target tokens: TTFT (median over prompts x reps), paired vs OFF ===
  OFF   ttft median  63432.1 ms   OFF/OFF per-prompt median 1.0000x [1.0000-1.0000]  fired/prompt 0
  REF2  ttft median  63443.2 ms   OFF/REF2 per-prompt median 1.0009x [0.9985-1.0016]  fired/prompt 0
  STD   ttft median  65296.8 ms   OFF/STD per-prompt median 0.9727x [0.9682-0.9732]  fired/prompt 0
  T     ttft median  48304.9 ms   OFF/T per-prompt median 1.3127x [1.3095-1.3155]  fired/prompt 25704
  G     ttft median  49924.0 ms   OFF/G per-prompt median 1.2717x [1.2678-1.2728]  fired/prompt 25704

=== 129024 target tokens: full-vocab KL vs OFF at PREFILL positions ===
  OFF   n=315  median 0.000e+00  p95 0.000e+00  max 0.000e+00  argmax flips 0/315
  REF2  n=315  median 0.000e+00  p95 0.000e+00  max 0.000e+00  argmax flips 0/315
  STD   n=315  median 3.113e-04  p95 1.305e-02  max 2.866e+01  argmax flips 13/315
  T     n=315  median 9.516e-04  p95 2.730e-02  max 2.786e+01  argmax flips 10/315
  G     n=315  median 8.009e-04  p95 4.159e-02  max 2.352e+01  argmax flips 10/315

=== decode tok/s after an 8k prefill (the leg serves prefill only) ===
  OFF      81.95 tok/s  (reps [81.75, 82.16])
  REF2     81.98 tok/s  (reps [82.17, 81.79])
  STD      86.12 tok/s  (reps [86.28, 85.96])
  T        99.50 tok/s  (reps [99.68, 99.32])
  G        94.36 tok/s  (reps [94.69, 94.04])

=== OP-LEVEL error vs an fp32 oracle, per linear class, on each arm's own call ===
  arm   classes  median int8 vs fp32  legB vs fp32  ratio to T  better/worse
  G         408           8.4708e-03    1.9134e-03      0.6938    407/1     
  T         408           1.1899e-02    1.9124e-03      1.0000      0/408   

TIP RUN: OK
EXIT=0
