Configs › Mistral-Small-3.1-24B-Instruct-2503 on Strix Halo: 14.7 tok/s measured
Mistral-Small-3.1-24B-Instruct-2503 on Strix Halo: 14.7 tok/s measured
Measured Mistral-Small-3.1-24B-Instruct-2503 speeds: 14.7 tok/s on Strix Halo. 1 config, each linked to its source, snapshot 2026-10-16.
Snapshot 2026-10-16 · 394 configs on AI boxes and 423 on GPU cards · 123 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.
Quick answers
- How fast is Mistral-Small-3.1-24B-Instruct-2503 on Strix Halo?
- 14.7 tok/s single-stream decode (UD-Q4_K_XL, llama.cpp/rocm), the only measured config on AMD Strix Halo (Ryzen AI Max+ 395), measured by lhl, source last checked 2026-10-16. source
Measured configs for Mistral-Small-3.1-24B-Instruct-2503
| Model | Hardware | Quant | Backend | Decode | Context | Trust | Source |
|---|---|---|---|---|---|---|---|
| Mistral-Small-3.1-24B-Instruct-2503 | Strix Halo | UD-Q4_K_XL | llama.cpp/rocm | 14.7 tok/s (prefill 368.5) | Structured table | source |
More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.