Configs › Nemotron-3-Super-120B-A12B tok/s: DGX Spark 24.5

Nemotron-3-Super-120B-A12B tok/s: DGX Spark 24.5

Measured Nemotron-3-Super-120B-A12B speeds: 24.5 tok/s on DGX Spark (NVFP4, vllm). 2 configs, each linked to its source, snapshot 2026-10-16.

Snapshot 2026-10-16 · 394 configs on AI boxes and 423 on GPU cards · 123 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.

Quick answers

How fast is Nemotron-3-Super-120B-A12B on DGX Spark?
24.5 tok/s single-stream decode (NVFP4, vllm), the only measured config on NVIDIA DGX Spark (GB10), measured by jvr0x, source last checked 2026-10-16. source
How fast is Nemotron-3-Super-120B-A12B on Strix Halo?
18.9 tok/s single-stream decode (IQ4_XS, llama.cpp/vulkan), the only measured config on AMD Strix Halo (Ryzen AI Max+ 395), measured by hogeheer, source last checked 2026-10-14. source

Measured configs for Nemotron-3-Super-120B-A12B

ModelHardwareQuantBackendDecodeContextTrustSource
Nemotron-3-Super-120B-A12BDGX SparkNVFP4vllm24.5 tok/sStructured tablesource
Nemotron-3-Super-120B-A12BStrix HaloIQ4_XSllama.cpp/vulkan18.9 tok/s (prefill 297.1)512Structured tablesource

More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.