- Writing speed, one personsingle_user_decode_tps · tok/s
- 13.67 tok/sper person · single · sample count not recorded
- First word afterttft_median_s · s
- 8.60 sper person · median · sample count not recorded
Runs on this setup
Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.
History and measured sweep
| Date | Shape | Each person · median | Machine total | First word · median | Result | Run |
|---|---|---|---|---|---|---|
2026-10-05 | 1 people | not recorded | not recorded | 0.81 s | Passed | |
2026-10-05 | 1 people | not recorded | not recorded | 8.60 s | Partial | |
2026-10-05 | unknown people | not recorded | not recorded | not recorded | Passed | |
2026-10-05 | 1 people | not recorded | not recorded | not recorded | Not graded | |
2026-10-04 | 1 people | not recorded | not recorded | not recorded | Not graded |
Answer checks
16/16 tasks
Method
Sixteen synthetic exact-output tasks at concurrency 1. Decode includes reasoning; TTFT is first final-answer content.
Limits
Configured 8K context only; no declared customer service targets. Workload passed 16/16, but the optional smoke failed.
What did not work
- Optional smoke exhausted its output budget before a final answer.
What ran
Exact identity
- Original publisher model
- Qwen3.8-27B
- Publisher revision
1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0- Variant · format · precision
- INT4 variant · safetensors · INT4
- Weights SHA-256
- not recorded
- Engine · version · feature
- NVIDIA NGC vLLM ·
0.29.0+5013de39.dev· plain - Hardware
- NVIDIA GB10, 128 GB unified memory
- Harness / workload
not recorded- Workload suite · version
not recorded- Harness SHA-256
not recorded- Fixture SHA-256
not recorded
Workload shape
- People in this run
- 1
- Configured window (tokens)
- 8192
- KV cache precision
- bf16
- Feature
- plain
Full reproduction pack available to customers and evaluators on request
All recorded numbers
Metric definitions, scope and statistics
| Metric | Value | Scope | Statistic | Sample count | Basis / source field | Run |
|---|---|---|---|---|---|---|
ttft median s | 8.60 s | per person | median | not recorded | ttft_median_s | |
workload total | 16.00 count | machine total | single | not recorded | workload_total | |
workload passed | 16.00 count | machine total | single | not recorded | workload_passed | |
ttft p95 s | 11.44 s | per person | p95 | not recorded | ttft_p95_s | |
single user decode tps | 13.67 tok/s | per person | single | not recorded | single_user_decode_tps |
Data and citation
Skilak Keep evidence, run f4c10f9c358d36fba0d11619, measured 2026-10-05T04:54:24.359517+00:00. https://skilak.ai/keep/resources/evidence/r/f4c10f9c358d36fba0d11619
