Runs on this setup
Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.
History and measured sweep
| Date | Shape | Each person · median | Machine total | First word · median | Result | Run |
|---|---|---|---|---|---|---|
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Failed | |
2026-10-19 | 1 people | not recorded | not recorded | 0.06 s | Partial | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Partial | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Failed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-19 | 64 people · shared · warm | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 32 people · shared · warm | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 20 people · shared · warm | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 16 people · shared · warm | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 8 people · shared · warm | not recorded | not recorded | not recorded | Capacity limit — confirmed | |
2026-10-19 | 64 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 32 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 20 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 16 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 8 people · distinct · cold | not recorded | not recorded | not recorded | Capacity limit — confirmed | |
2026-10-19 | 64 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 32 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 20 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 16 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-19 | 8 people · distinct · cold | not recorded | not recorded | not recorded | Capacity limit — confirmed | |
2026-10-18 | 64 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-18 | 32 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-18 | 20 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-18 | 16 people · distinct · cold | not recorded | not recorded | not recorded | Capacity limit — confirmed | |
2026-10-18 | 64 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-18 | 32 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-18 | 20 people · distinct · cold | not recorded | not recorded | not recorded | Above confirmed limit — not attempted | |
2026-10-18 | 16 people · distinct · cold | not recorded | not recorded | not recorded | Capacity limit — confirmed | |
2026-10-18 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-18 | unknown people | not recorded | not recorded | not recorded | Passed |
Answer checks
26/32 tasks
Method
Synthetic structured-context tasks; no retries, no warmup; unchanged endpoint cache; all planned tasks remain in denominator.
Limits
Operator-supplied runtime manifest; the endpoint runner cannot attest hardware or model pins. Bounded task correctness is not customer acceptance.
What did not work
- 26/32 tasks passed.
What ran
Exact identity
- Original publisher model
- Qwen3.6-35B-A3B
- Publisher revision
995ad96eacd98c81ed38be0c5b274b04031597b0- Variant · format · precision
- NVFP4 variant · NVFP4
- Weights SHA-256
- not recorded
- Engine · version · feature
- NVIDIA NGC vLLM ·
version not recorded· with multi-token prediction - Hardware
- NVIDIA GB10, 128 GB unified memory
- Harness / workload
not recorded- Workload suite · version
not recorded- Harness SHA-256
not recorded- Fixture SHA-256
not recorded
Workload shape
- Configured window (tokens)
- 262144
- KV cache precision
- fp8
- Feature
- with multi-token prediction
Full reproduction pack available to customers and evaluators on request
All recorded numbers
Metric definitions, scope and statistics
| Metric | Value | Scope | Statistic | Sample count | Basis / source field | Run |
|---|---|---|---|---|---|---|
workload total | 32.00 count | machine total | single | not recorded | workload_total | |
workload passed | 26.00 count | machine total | single | not recorded | workload_passed |
Data and citation
Skilak Keep evidence, run 2161604163794ac4afe4dea4, measured 2026-10-19T08:00:08.965685+00:00. https://skilak.ai/keep/resources/evidence/r/2161604163794ac4afe4dea4
