SkilakKeep
Request a pilot

Report · resources

Chat and code

Qwen2.5-72B-Instruct-AWQ · AWQ variant · vLLM

Measured results / Chat and code / Run 6ccd93b0e0d9a814c44d74b6

Measured time not recorded · Record date 2026-07-17

Passed. 168/168 request checks

Writing speed, one personsingle_user_decode_tps · tok/s
43.80 tok/sper person · median · sample count not recorded
Machine totalaggregate_e2e_tps · tok/s
1,261.90 tok/smachine total · single · sample count not recorded

Answer checks

168/168 request checks

Method

Streaming load sweep, concurrency 1 through 32, 256-token ceiling; per-request median decode excludes first token; aggregate includes the request window.

Limits

Rented single-GPU class; model and engine pins were not retained. Historical TTFT p95 withdrawn because raw samples cannot reconstruct corrected percentiles.

What ran

Exact identity

Original publisher model
Qwen2.5-72B-Instruct-AWQ
Publisher revision
not recorded
Variant · format · precision
AWQ variant · safetensors · AWQ
Weights SHA-256
not recorded
Engine · version · feature
vLLM · version not recorded · plain
Hardware
NVIDIA H100, 80 GB
Harness / workload
not recorded
Workload suite · version
not recorded
Harness SHA-256
not recorded
Fixture SHA-256
not recorded

Workload shape

People in this run
1
Configured window (tokens)
8192
Output token ceiling
256

Full reproduction pack available to customers and evaluators on request

All recorded numbers

Metric definitions, scope and statistics
All aggregate numeric result fields in this run
MetricValueScopeStatisticSample countBasis / source fieldRun
requests ok
168.00 count
machine total
single
not recorded
requests_ok
aggregate concurrency
32.00 count
machine total
single
not recorded
aggregate_concurrency
requests total
168.00 count
machine total
single
not recorded
requests_total
aggregate e2e tps
1,261.90 tok/s
machine total
single
not recorded
aggregate_tps
single user decode tps
43.80 tok/s
per person
median
not recorded
single_user_decode_tps

Data and citation

Download this run · OLIR JSONAll numbers · CSVOLIR schema
Skilak Keep evidence, run 6ccd93b0e0d9a814c44d74b6, measured 2026-07-17.
https://skilak.ai/keep/resources/evidence/r/6ccd93b0e0d9a814c44d74b6

Ready to scope it?

Start with one workload.

Tell us who uses it, what it can read, and what must stay inside. We will map the build.

Request a pilot