SkilakKeep
Request a pilot

Report · resources

Chat and code

Qwen3.8-27B · GSQ-RCO IQ3_S GGUF variant · llama.cpp

Measured results / Chat and code / Run 878d422a9fda08591057e990

Measured 2026-10-05 17:59 UTC · Record date 2026-10-05

Not graded. 6/6 request checks

Code writing speedcode_decode_tps · tok/s
15.96 tok/sper person · mean · sample count not recorded
Prose writing speedchat_decode_tps · tok/s
16.05 tok/sper person · mean · sample count not recorded
Peak memory, whole hostpeak_host_unavailable_gib · GiB
20.37 GiBmachine total · max · sample count not recorded

Answer checks

6/6 request checks

Method

One warmup then three measured requests each for code and chat; first-content-to-DONE decode; aggregate uses actual paired request windows including TTFT.

Limits

Short repeated prompts; prefix-slot reuse may improve TTFT. Task correctness and long-context quality unassessed; whole-host memory includes baseline.

What ran

Exact identity

Original publisher model
Qwen3.8-27B
Publisher revision
1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
Variant · format · precision
GSQ-RCO IQ3_S GGUF variant · GGUF · GSQ-RCO IQ3_S
Weights SHA-256
not recorded
Engine · version · feature
llama.cpp · native CUDA 13, sm_121a · plain
Hardware
NVIDIA GB10, 128 GB unified memory
Harness / workload
not recorded
Workload suite · version
not recorded
Harness SHA-256
not recorded
Fixture SHA-256
not recorded

Workload shape

People in this run
1
Configured window (tokens)
65536
Output token ceiling
512

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics
All aggregate numeric result fields in this run
MetricValueScopeStatisticSample countBasis / source fieldRun
chat decode tps
16.05 tok/s
per person
mean
not recorded
chat_decode_tps
requests ok
6.00 count
machine total
single
not recorded
requests_ok
code ttft mean s
0.13 s
per person
mean
not recorded
code_ttft_mean_s
requests total
6.00 count
machine total
single
not recorded
requests_total
code decode tps
15.96 tok/s
per person
mean
not recorded
code_decode_tps
chat ttft mean s
0.13 s
per person
mean
not recorded
chat_ttft_mean_s
peak host unavailable gib
20.37 GiB
machine total
max
not recorded
peak_host_unavailable_gib

Data and citation

Download this run · OLIR JSONAll numbers · CSVOLIR schema
Skilak Keep evidence, run 878d422a9fda08591057e990, measured 2026-10-05T17:59:29.228107+00:00.
https://skilak.ai/keep/resources/evidence/r/878d422a9fda08591057e990

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.

Request a pilot