Runs on this setup
Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.
History and measured sweep
| Date | Shape | Each person · median | Machine total | First word · median | Result | Run |
|---|---|---|---|---|---|---|
2026-10-09 | 1 people | not recorded | not recorded | not recorded | Passed | |
2026-10-09 | 1 people | not recorded | not recorded | not recorded | Not graded |
Answer checks
16/16 tasks
Method
Synthetic structured-context tasks; no retries, no warmup; unchanged endpoint cache; all planned tasks remain in denominator.
Limits
Operator-supplied runtime manifest; the endpoint runner cannot attest hardware or model pins. Bounded task correctness is not customer acceptance.
What ran
Exact identity
- Original publisher model
- Qwen3.8-27B
- Publisher revision
1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0- Variant · format · precision
- Mirai S trellis with Q8_0 MTP GGUF variant · GGUF · Mirai S trellis with Q8_0 MTP
- Weights SHA-256
- not recorded
- Engine · version · feature
- Mirai S CUDA ·
version not recorded· with multi-token prediction - Hardware
- NVIDIA GeForce RTX 3060, 12 GB VRAM
- Harness / workload
not recorded- Workload suite · version
not recorded- Harness SHA-256
not recorded- Fixture SHA-256
not recorded
Workload shape
- People in this run
- 1
- Configured window (tokens)
- 262144
- KV cache precision
- q8_0
- Feature
- with multi-token prediction
Full reproduction pack available to customers and evaluators on request
All recorded numbers
Metric definitions, scope and statistics
| Metric | Value | Scope | Statistic | Sample count | Basis / source field | Run |
|---|---|---|---|---|---|---|
workload total | 16.00 count | machine total | single | not recorded | workload_total | |
workload passed | 16.00 count | machine total | single | not recorded | workload_passed |
Data and citation
Skilak Keep evidence, run 858a9f7677b74eb184c298f1, measured 2026-10-09T13:55:12.337873+00:00. https://skilak.ai/keep/resources/evidence/r/858a9f7677b74eb184c298f1
