Configs › llm-jp-4.1-32b-a3b-thinking on Strix Halo: 81 tok/s measured
llm-jp-4.1-32b-a3b-thinking on Strix Halo: 81 tok/s measured
Measured llm-jp-4.1-32b-a3b-thinking speeds: 81 tok/s on Strix Halo. 4 configs, each linked to its source, snapshot 2026-10-15.
Snapshot 2026-10-15 · 394 configs on AI boxes and 423 on GPU cards · 123 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.
Quick answers
- How fast is llm-jp-4.1-32b-a3b-thinking on Strix Halo?
- 81 tok/s single-stream decode (Q4_K_M, llama.cpp/vulkan (depth-0)), the fastest of 4 measured configs on AMD Strix Halo (Ryzen AI Max+ 395), measured by sypherin, source last checked 2026-10-15. source
Measured configs for llm-jp-4.1-32b-a3b-thinking
| Model | Hardware | Quant | Backend | Decode | Context | Trust | Source |
|---|---|---|---|---|---|---|---|
| llm-jp-4.1-32b-a3b-thinking | Strix Halo | Q4_K_M | llama.cpp/vulkan (depth-0) | 81 tok/s (prefill 1980.2) | Verified (ran it) | source | |
| llm-jp-4.1-32b-a3b-thinking | Strix Halo | Q4_K_M | llama.cpp/rocm (depth-0) | 73.6 tok/s (prefill 1416.6) | Verified (ran it) | source | |
| llm-jp-4.1-32b-a3b-thinking | Strix Halo | Q4_K_M | llama.cpp/vulkan (depth-4096) | 72.6 tok/s (prefill 943.6) | 4096 | Verified (ran it) | source |
| llm-jp-4.1-32b-a3b-thinking | Strix Halo | Q4_K_M | llama.cpp/rocm (depth-4096) | 64.8 tok/s (prefill 1021.1) | 4096 | Verified (ran it) | source |
More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.