Report · resources

Structured tasks

Qwen3.8-27B · GSQ-RCO IQ3_S GGUF variant · llama.cpp · with multi-token prediction

Measured results / Structured tasks / Run e07e13bacf97b8d0559da6be

Measured time not recorded · Record date 2026-10-05

Failed.

Runs on this setup

Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.

History and measured sweep
History of this setup, newest first
DateShapeEach person · medianMachine totalFirst word · medianResultRun
2026-10-05
2 people
not recorded
53.59 tok/s
not recorded
Partial
2026-10-05
2 people
not recorded
53.59 tok/s
not recorded
Not graded
2026-10-05
1 people
not recorded
not recorded
not recorded
Not graded
2026-10-05
unknown people
not recorded
not recorded
not recorded
Failed
2026-10-05
unknown people
not recorded
not recorded
not recorded
Failed

Answer checks

No answer-quality suite was graded for this run.

Method

Initial attempt retained from the completed-run notes; no inference measurement completed.

Limits

Tooling failure; the corrected startup and subsequent strict workload score are retained separately.

What did not work

  • The initial workload attempt was refused before tasks because authentication was missing.

What ran

Exact identity

Original publisher model
Qwen3.8-27B
Publisher revision
1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
Variant · format · precision
GSQ-RCO IQ3_S GGUF variant · GGUF · GSQ-RCO IQ3_S
Weights SHA-256
not recorded
Engine · version · feature
llama.cpp · native CUDA 13, sm_121a · with multi-token prediction
Hardware
NVIDIA GB10, 128 GB unified memory
Harness / workload
not recorded
Workload suite · version
not recorded
Harness SHA-256
not recorded
Fixture SHA-256
not recorded

Workload shape

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics
All aggregate numeric result fields in this run
MetricValueScopeStatisticSample countBasis / source field

Data and citation

Skilak Keep evidence, run e07e13bacf97b8d0559da6be, measured 2026-10-05.
https://skilak.ai/keep/resources/evidence/r/e07e13bacf97b8d0559da6be

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.