Configs › Nemotron-3-Nano-30B-A3B tok/s: Strix Halo 76
Nemotron-3-Nano-30B-A3B tok/s: Strix Halo 76
Measured Nemotron-3-Nano-30B-A3B speeds: 76 tok/s on Strix Halo (IQ4_XS, llama.cpp/vulkan). 3 configs, each linked to its source, snapshot 2026-10-16.
Snapshot 2026-10-16 · 394 configs on AI boxes and 423 on GPU cards · 123 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.
Quick answers
- How fast is Nemotron-3-Nano-30B-A3B on Strix Halo?
- 76 tok/s single-stream decode (IQ4_XS, llama.cpp/vulkan), the only measured config on AMD Strix Halo (Ryzen AI Max+ 395), measured by hogeheer, source last checked 2026-10-14. source
- How fast is Nemotron-3-Nano-30B-A3B on DGX Spark?
- 47.9 tok/s single-stream decode (llama.cpp), the fastest of 2 measured configs on NVIDIA DGX Spark (GB10), measured by jvr0x, source last checked 2026-10-16. source
Measured configs for Nemotron-3-Nano-30B-A3B
| Model | Hardware | Quant | Backend | Decode | Context | Trust | Source |
|---|---|---|---|---|---|---|---|
| Nemotron-3-Nano-30B-A3B | Strix Halo | IQ4_XS | llama.cpp/vulkan | 76 tok/s (prefill 1312.5) | 512 | Structured table | source |
| Nemotron-3-Nano-30B-A3B | DGX Spark | llama.cpp | 47.9 tok/s | Structured table | source | ||
| Nemotron-3-Nano-30B-A3B | DGX Spark | FP8 | vllm | 40.7 tok/s | Structured table | source |
More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.