Answer checks
No answer-quality suite was graded for this run.
Method
KTS-1. Greedy deterministic requests through a verified Keep release. Three cold repeats per grid cell, five when spread exceeds ten percent; shared warm results are separate.
Limits
Labelled lab evidence for the recorded setup and standard. Completion is coverage, not customer or general answer-quality qualification.
What did not work
- Standard check failed; the retained internal record contains the failure reason.
What ran
Exact identity
- Original publisher model
- Qwen3.6-35B-A3B
- Publisher revision
not recorded- Variant · format · precision
- NVFP4 variant · NVFP4
- Weights SHA-256
- not recorded
- Engine · version · feature
- NVIDIA NGC vLLM ·
0.29.0+5013de39.dev· plain - Hardware
- NVIDIA GB10, 128 GB unified memory
- Harness / workload
not recorded- Workload suite · version
not recorded- Harness SHA-256
not recorded- Fixture SHA-256
not recorded
Workload shape
Full reproduction pack available to customers and evaluators on request
All recorded numbers
Metric definitions, scope and statistics
| Metric | Value | Scope | Statistic | Sample count | Basis / source field | Run |
|---|---|---|---|---|---|---|
cold decode tps | 104.02 tok/s | per person | single | not recorded | standard_result.cold_decode_tps |
Data and citation
Skilak Keep evidence, run bf13ac82f9944651b180398a, measured 2026-10-10T20:30:57.890273+00:00. https://skilak.ai/keep/resources/evidence/r/bf13ac82f9944651b180398a
