SkilakKeep
Request a pilot

Report · resources

Long documents

Qwen3.8-27B · Mirai S CUDA dev

Measured results / Long documents / Run 8fd6f651a14c40f7b6700dad

Measured time not recorded · Record date 2026-10-09

Did not start. 0/0 Hidden facts found0/0 request checks

Answer checks

0/0 Hidden facts found0/0 request checks

Method

Managed startup or workload preflight attempt; no completed long-context inference is asserted by this record.

Limits

Startup, inference completion, concurrent decode and retrieval correctness are separate gates.

What did not work

  • Startup, inference completion, concurrent decode and retrieval correctness are separate gates.

What ran

Exact identity

Original publisher model
Qwen3.8-27B
Publisher revision
1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
Variant · format · precision
not recorded
Weights SHA-256
not recorded
Engine · version · feature
Mirai S CUDA · 0.2.0-dev-vector-disabled · plain
Hardware
not recorded
Harness / workload
not recorded
Workload suite · version
not recorded
Harness SHA-256
not recorded
Fixture SHA-256
not recorded

Workload shape

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics
All aggregate numeric result fields in this run
MetricValueScopeStatisticSample countBasis / source fieldRun
hidden facts total
0.00 count
machine total
single
not recorded
needle_total
requests ok
0.00 count
machine total
single
not recorded
requests_ok
hidden facts correct
0.00 count
machine total
single
not recorded
needle_correct
requests total
0.00 count
machine total
single
not recorded
requests_total

Data and citation

Download this run · OLIR JSONAll numbers · CSVOLIR schema
Skilak Keep evidence, run 8fd6f651a14c40f7b6700dad, measured 2026-10-09.
https://skilak.ai/keep/resources/evidence/r/8fd6f651a14c40f7b6700dad

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.

Request a pilot