SkilakKeep
Request a pilot

Report · resources

Structured tasks

Qwen3.8-27B · Mirai S trellis with Q8_0 MTP GGUF variant · Mirai S CUDA dev · with multi-token prediction

Measured results / Structured tasks / Run 8c806d70a9584a5ea4c955cb

Measured 2026-10-08 03:06 UTC · Record date 2026-10-08

Passed. 16/16 tasks16/16 request checks

Runs on this setup

Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.

History and measured sweep
History of this setup, newest first
DateShapeEach person · medianMachine totalFirst word · medianResultRun
2026-10-08
1 people
not recorded
not recorded
not recorded
Passed
2026-10-08
1 people
not recorded
not recorded
not recorded
Passed

Answer checks

16/16 tasks16/16 request checks

Method

Unchanged structured-context-v1 profile, concurrency 1, one repetition, temperature zero, thinking off, strict JSON; no inference retries.

Limits

Native file/binary/library provenance checked separately; no OCI identity invented. Synthetic task pass is not broader intelligence or customer acceptance.

What ran

Exact identity

Original publisher model
Qwen3.8-27B
Publisher revision
not recorded
Variant · format · precision
Mirai S trellis with Q8_0 MTP GGUF variant · GGUF · Mirai S trellis with Q8_0 MTP
Weights SHA-256
not recorded
Engine · version · feature
Mirai S CUDA · 0.2.0-dev-vector-disabled · with multi-token prediction
Hardware
NVIDIA RTX 3060, nominal 12 GB, one GPU
Harness / workload
not recorded
Workload suite · version
not recorded
Harness SHA-256
not recorded
Fixture SHA-256
not recorded

Workload shape

People in this run
1
Configured window (tokens)
262144
KV cache precision
Q8_0
Output token ceiling
512
Feature
with multi-token prediction

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics
All aggregate numeric result fields in this run
MetricValueScopeStatisticSample countBasis / source fieldRun
workload total
16.00 count
machine total
single
not recorded
workload_total
requests ok
16.00 count
machine total
single
not recorded
requests_ok
workload passed
16.00 count
machine total
single
not recorded
workload_passed
requests total
16.00 count
machine total
single
not recorded
requests_total

Data and citation

Download this run · OLIR JSONAll numbers · CSVOLIR schema
Skilak Keep evidence, run 8c806d70a9584a5ea4c955cb, measured 2026-10-08T03:06:37.238561+00:00.
https://skilak.ai/keep/resources/evidence/r/8c806d70a9584a5ea4c955cb

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.

Request a pilot