Report · resources

Chat and code

Qwen3.8-27B · Mirai S trellis with Q8_0 MTP GGUF variant · Mirai S CUDA dev · with multi-token prediction

Measured results / Chat and code / Run c499ad73eb964222820e5320

Measured 2026-10-08 04:28 UTC · Record date 2026-10-08

Passed. 6/6 request checks

Code writing speedcode_decode_tps · tok/s: 41.48 tok/sper person · mean · sample count not recorded
Prose writing speedchat_decode_tps · tok/s: 37.35 tok/sper person · mean · sample count not recorded
Peak memory, whole hostpeak_host_unavailable_gib · GiB: 13.39 GiBmachine total · max · sample count not recorded

Runs on this setup

Earlier runs keep their own engine versions and outcomes. Workload shapes stay separate.

History and measured sweep

History of this setup, newest first
Date	Shape	Each person · median	Machine total	First word · median	Result	Run
2026-10-08	1 people	not recorded	not recorded	not recorded	Passed	Run c499ad73 →
2026-10-08	1 people	not recorded	not recorded	not recorded	Passed	Run 8c806d70 →

Answer checks

6/6 request checks

Method

Unchanged FAST prompts: one warmup then three measured 512-token requests per prompt; N divided by first-content-to-DONE; temperature zero, thinking off.

Limits

Measured short throughput only; output hits the ceiling and is not answer completeness. Different quantization/runtime from compared unified-memory baselines.

What ran

Exact identity

Original publisher model: Qwen3.8-27B
Publisher revision: not recorded
Variant · format · precision: Mirai S trellis with Q8_0 MTP GGUF variant · GGUF · Mirai S trellis with Q8_0 MTP
Weights SHA-256: not recorded
Engine · version · feature: Mirai S CUDA · 0.2.0-dev-vector-disabled · with multi-token prediction
Hardware: NVIDIA RTX 3060, nominal 12 GB, one GPU
Harness / workload: not recorded
Workload suite · version: not recorded
Harness SHA-256: not recorded
Fixture SHA-256: not recorded

Workload shape

People in this run: 1
Configured window (tokens): 262144
KV cache precision: Q8_0
Output token ceiling: 512
Feature: with multi-token prediction

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics

All aggregate numeric result fields in this run
Metric	Value	Scope	Statistic	Sample count	Basis / source field	Run
chat decode tps	37.35 tok/s	per person	mean	not recorded	chat_decode_tps	Run c499ad73 →
requests ok	6.00 count	machine total	single	not recorded	requests_ok	Run c499ad73 →
code ttft mean s	0.30 s	per person	mean	not recorded	code_ttft_mean_s	Run c499ad73 →
requests total	6.00 count	machine total	single	not recorded	requests_total	Run c499ad73 →
code decode tps	41.48 tok/s	per person	mean	not recorded	code_decode_tps	Run c499ad73 →
chat ttft mean s	0.31 s	per person	mean	not recorded	chat_ttft_mean_s	Run c499ad73 →
peak host unavailable gib	13.39 GiB	machine total	max	not recorded	peak_host_unavailable_gib	Run c499ad73 →

Data and citation

Download this run · OLIR JSON All numbers · CSV OLIR schema

Skilak Keep evidence, run c499ad73eb964222820e5320, measured 2026-10-08T04:28:10.783648+00:00.
https://skilak.ai/keep/resources/evidence/r/c499ad73eb964222820e5320

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.

Request a pilot