Runs on this setup
Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.
History and measured sweep
| Date | Shape | Each person · median | Machine total | First word · median | Result | Run |
|---|---|---|---|---|---|---|
2026-10-07 | 5 people | not recorded | not recorded | not recorded | Passed | |
2026-10-07 | 5 people | not recorded | not recorded | not recorded | Failed |
Answer checks
105/105 turns
Rolling-chat turn checks
| Person · turn | Filled input | First word | Recent · pinned · old | Result | Run |
|---|---|---|---|---|---|
1 · 1 | 20208 | 3.96 s | true · true · recalled | Passed | |
1 · 2 | 40333 | 5.72 s | true · true · recalled | Passed | |
1 · 3 | 60459 | 6.98 s | true · true · recalled | Passed | |
1 · 4 | 40509 | 9.56 s | true · true · recalled | Passed | |
1 · 5 | 60637 | 7.03 s | true · true · recalled | Passed | |
1 · 6 | 40502 | 9.60 s | true · true · recalled | Passed | |
1 · 7 | 60630 | 7.01 s | true · true · recalled | Passed | |
1 · 8 | 40507 | 12.69 s | true · true · recalled | Passed | |
1 · 9 | 60636 | 11.32 s | true · true · recalled | Passed | |
1 · 10 | 40513 | 15.26 s | true · true · recalled | Passed | |
1 · 11 | 60634 | 10.74 s | true · true · recalled | Passed | |
1 · 12 | 40511 | 15.73 s | true · true · recalled | Passed | |
1 · 13 | 60635 | 10.88 s | true · true · recalled | Passed | |
1 · 14 | 40509 | 15.78 s | true · true · recalled | Passed | |
1 · 15 | 60631 | 11.51 s | true · true · recalled | Passed | |
1 · 16 | 40507 | 20.70 s | true · true · recalled | Passed | |
1 · 17 | 60630 | 15.95 s | true · true · recalled | Passed | |
1 · 18 | 40506 | 22.93 s | true · true · recalled | Passed | |
1 · 19 | 60631 | 16.85 s | true · true · recalled | Passed | |
1 · 20 | 40505 | 22.99 s | true · true · recalled | Passed | |
1 · 21 | 60624 | 16.55 s | true · true · recalled | Passed | |
2 · 1 | 20215 | 7.81 s | true · true · recalled | Passed | |
2 · 2 | 40338 | 11.43 s | true · true · recalled | Passed | |
2 · 3 | 60465 | 9.74 s | true · true · recalled | Passed | |
2 · 4 | 40511 | 15.70 s | true · true · recalled | Passed | |
2 · 5 | 60634 | 10.78 s | true · true · recalled | Passed | |
2 · 6 | 40506 | 15.83 s | true · true · recalled | Passed | |
2 · 7 | 60633 | 10.77 s | true · true · recalled | Passed | |
2 · 8 | 40508 | 18.82 s | true · true · recalled | Passed | |
2 · 9 | 60639 | 15.85 s | true · true · recalled | Passed | |
2 · 10 | 40509 | 21.28 s | true · true · recalled | Passed | |
2 · 11 | 60637 | 14.36 s | true · true · recalled | Passed | |
2 · 12 | 40516 | 21.67 s | true · true · recalled | Passed | |
2 · 13 | 60643 | 14.10 s | true · true · recalled | Passed | |
2 · 14 | 40506 | 21.77 s | true · true · recalled | Passed | |
2 · 15 | 60632 | 10.91 s | true · true · recalled | Passed | |
2 · 16 | 40510 | 18.77 s | true · true · recalled | Passed | |
2 · 17 | 60639 | 15.65 s | true · true · recalled | Passed | |
2 · 18 | 40509 | 21.94 s | true · true · recalled | Passed | |
2 · 19 | 60641 | 17.63 s | true · true · recalled | Passed | |
2 · 20 | 40513 | 25.99 s | true · true · recalled | Passed | |
2 · 21 | 60643 | 19.27 s | true · true · recalled | Passed | |
3 · 1 | 20213 | 10.14 s | true · true · recalled | Passed | |
3 · 2 | 40341 | 15.88 s | true · true · recalled | Passed | |
3 · 3 | 60467 | 14.95 s | true · true · recalled | Passed | |
3 · 4 | 40504 | 22.34 s | true · true · recalled | Passed | |
3 · 5 | 60634 | 16.57 s | true · true · recalled | Passed | |
3 · 6 | 40511 | 23.31 s | true · true · recalled | Passed | |
3 · 7 | 60641 | 16.77 s | true · true · recalled | Passed | |
3 · 8 | 40508 | 15.87 s | true · true · recalled | Passed | |
3 · 9 | 60637 | 11.40 s | true · true · recalled | Passed | |
3 · 10 | 40508 | 20.47 s | true · true · recalled | Passed | |
3 · 11 | 60633 | 16.38 s | true · true · recalled | Passed | |
3 · 12 | 40503 | 26.69 s | true · true · recalled | Passed | |
3 · 13 | 60630 | 20.32 s | true · true · recalled | Passed | |
3 · 14 | 40509 | 29.17 s | true · true · recalled | Passed | |
3 · 15 | 60636 | 16.70 s | true · true · recalled | Passed | |
3 · 16 | 40506 | 22.98 s | true · true · recalled | Passed | |
3 · 17 | 60631 | 16.70 s | true · true · recalled | Passed | |
3 · 18 | 40508 | 23.22 s | true · true · recalled | Passed | |
3 · 19 | 60636 | 16.71 s | true · true · recalled | Passed | |
3 · 20 | 40506 | 23.04 s | true · true · recalled | Passed | |
3 · 21 | 60632 | 16.72 s | true · true · recalled | Passed | |
4 · 1 | 20214 | 10.40 s | true · true · recalled | Passed | |
4 · 2 | 40342 | 15.73 s | true · true · recalled | Passed | |
4 · 3 | 60472 | 15.67 s | true · true · recalled | Passed | |
4 · 4 | 40502 | 26.38 s | true · true · recalled | Passed | |
4 · 5 | 60629 | 20.29 s | true · true · recalled | Passed | |
4 · 6 | 40508 | 29.24 s | true · true · recalled | Passed | |
4 · 7 | 60634 | 17.00 s | true · true · recalled | Passed | |
4 · 8 | 40513 | 23.04 s | true · true · recalled | Passed | |
4 · 9 | 60640 | 16.99 s | true · true · recalled | Passed | |
4 · 10 | 40519 | 22.89 s | true · true · recalled | Passed | |
4 · 11 | 60648 | 17.02 s | true · true · recalled | Passed | |
4 · 12 | 40510 | 22.88 s | true · true · recalled | Passed | |
4 · 13 | 60643 | 17.02 s | true · true · recalled | Passed | |
4 · 14 | 40512 | 15.64 s | true · true · recalled | Passed | |
4 · 15 | 60642 | 10.81 s | true · true · recalled | Passed | |
4 · 16 | 40513 | 15.77 s | true · true · recalled | Passed | |
4 · 17 | 60642 | 10.91 s | true · true · recalled | Passed | |
4 · 18 | 40513 | 15.84 s | true · true · recalled | Passed | |
4 · 19 | 60642 | 10.93 s | true · true · recalled | Passed | |
4 · 20 | 40510 | 15.85 s | true · true · recalled | Passed | |
4 · 21 | 60644 | 10.92 s | true · true · recalled | Passed | |
5 · 1 | 20213 | 17.15 s | true · true · recalled | Passed | |
5 · 2 | 40340 | 18.72 s | true · true · recalled | Passed | |
5 · 3 | 60467 | 18.58 s | true · true · recalled | Passed | |
5 · 4 | 40515 | 21.66 s | true · true · recalled | Passed | |
5 · 5 | 60641 | 14.03 s | true · true · recalled | Passed | |
5 · 6 | 40515 | 21.59 s | true · true · recalled | Passed | |
5 · 7 | 60645 | 14.07 s | true · true · recalled | Passed | |
5 · 8 | 40511 | 21.67 s | true · true · recalled | Passed | |
5 · 9 | 60640 | 14.03 s | true · true · recalled | Passed | |
5 · 10 | 40512 | 21.64 s | true · true · recalled | Passed | |
5 · 11 | 60639 | 10.91 s | true · true · recalled | Passed | |
5 · 12 | 40509 | 15.79 s | true · true · recalled | Passed | |
5 · 13 | 60635 | 10.80 s | true · true · recalled | Passed | |
5 · 14 | 40511 | 15.85 s | true · true · recalled | Passed | |
5 · 15 | 60642 | 10.90 s | true · true · recalled | Passed | |
5 · 16 | 40519 | 15.88 s | true · true · recalled | Passed | |
5 · 17 | 60648 | 10.91 s | true · true · recalled | Passed | |
5 · 18 | 40515 | 15.87 s | true · true · recalled | Passed | |
5 · 19 | 60645 | 7.11 s | true · true · recalled | Passed | |
5 · 20 | 40512 | 9.64 s | true · true · recalled | Passed | |
5 · 21 | 60639 | 7.10 s | true · true · recalled | Passed |
Method
Staggered multi-turn fictional archive, exact engine-tokenized rolling gateway; independent recent, pinned and old probes each turn.
Limits
Lab retrieval and rolling-history evidence only. Bounded literal user-source excerpts, with verified source hashes; details outside them remain unavailable. Shared engine cache intervals include overlapping users and are not per-user hits. Gateway path, not authenticated document ingestion or customer acceptance.
What ran
Exact identity
- Original publisher model
- Qwen3.6-35B-A3B
- Publisher revision
995ad96eacd98c81ed38be0c5b274b04031597b0- Variant · format · precision
- NVFP4 variant · safetensors · NVFP4
- Weights SHA-256
- not recorded
- Engine · version · feature
- NVIDIA NGC vLLM ·
0.29.0+5013de39.dev· plain - Hardware
- NVIDIA GB10, 128 GB unified memory
- Harness / workload
keep-rolling-context-v1 · 1- Workload suite · version
not recorded- Harness SHA-256
not recorded- Fixture SHA-256
not recorded
Workload shape
- People in this run
- 5
- Configured window (tokens)
- 262144
- Configured window (tokens)
- 262144
- Output token ceiling
- 256
Full reproduction pack available to customers and evaluators on request
All recorded numbers
Metric definitions, scope and statistics
| Metric | Value | Scope | Statistic | Sample count | Basis / source field | Run |
|---|---|---|---|---|---|---|
roll ttft max seconds | 29.24 s | per person | max | not recorded | roll_ttft_max_seconds | |
requests ok | 105.00 count | machine total | single | not recorded | requests_ok | |
roll ttft p50 seconds | 21.28 s | per person | median | not recorded | roll_ttft_p50_seconds | |
rolled off abstained | 0.00 count | machine total | single | not recorded | rolled_off_abstained | |
rolled off invalid | 0.00 count | machine total | single | not recorded | rolled_off_invalid | |
rolled off wrong | 0.00 count | machine total | single | not recorded | rolled_off_wrong | |
normal ttft max seconds | 20.32 s | per person | max | not recorded | normal_ttft_max_seconds | |
rolled off correct | 90.00 count | machine total | single | not recorded | rolled_off_correct | |
normal ttft p50 seconds | 14.05 s | per person | median | not recorded | normal_ttft_p50_seconds | |
rolled off total | 90.00 count | machine total | single | not recorded | rolled_off_total | |
requests total | 105.00 count | machine total | single | not recorded | requests_total |
Data and citation
Skilak Keep evidence, run 272292f28e714c4db98cd800, measured 2026-10-07T19:46:35.303920+00:00. https://skilak.ai/keep/resources/evidence/r/272292f28e714c4db98cd800
