Report · resources

Long documents

Qwen3.8-27B · INT4 variant · NVIDIA NGC vLLM

Measured results / Long documents / Run 893f89d85d0a42efaa1f8a11

Measured 2026-10-07 08:48 UTC · Record date 2026-10-07

Did not start. 0/0 Hidden facts found0/0 request checks

Runs on this setup

Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.

History and measured sweep
History of this setup, newest first
DateShapeEach person · medianMachine totalFirst word · medianResultRun
2026-10-07
unknown people
not recorded
not recorded
not recorded
Did not start
2026-10-07
unknown people
not recorded
not recorded
not recorded
Did not start
2026-10-06
unknown people
not recorded
not recorded
not recorded
Did not start
2026-10-06
unknown people
not recorded
not recorded
not recorded
Did not start
2026-10-06
unknown people
not recorded
not recorded
not recorded
Did not start

Answer checks

0/0 Hidden facts found0/0 request checks

Method

Managed startup or workload preflight attempt; no completed long-context inference is asserted by this record.

Limits

Startup, inference completion, concurrent decode and retrieval correctness are separate gates.

What ran

Exact identity

Original publisher model
Qwen3.8-27B
Publisher revision
1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
Variant · format · precision
INT4 variant · INT4
Weights SHA-256
not recorded
Engine · version · feature
NVIDIA NGC vLLM · version not recorded · plain
Hardware
not recorded
Harness / workload
not recorded
Workload suite · version
not recorded
Harness SHA-256
not recorded
Fixture SHA-256
not recorded

Workload shape

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics
All aggregate numeric result fields in this run
MetricValueScopeStatisticSample countBasis / source fieldRun
hidden facts total
0.00 count
machine total
single
not recorded
needle_total
requests ok
0.00 count
machine total
single
not recorded
requests_ok
hidden facts correct
0.00 count
machine total
single
not recorded
needle_correct
requests total
0.00 count
machine total
single
not recorded
requests_total

Data and citation

Skilak Keep evidence, run 893f89d85d0a42efaa1f8a11, measured 2026-10-07T08:48:23.100755+00:00.
https://skilak.ai/keep/resources/evidence/r/893f89d85d0a42efaa1f8a11

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.