Contributors › inferencerlabs's local-LLM benchmark configs
inferencerlabs's local-LLM benchmark configs
Every tracked benchmark config measured by inferencerlabs: model, quant, backend, tokens per second, source-linked and trust-tiered.
Snapshot 2026-10-15 · 394 configs on AI boxes and 423 on GPU cards · 123 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.
1 configs · 1 models · 57.5 tok/s best single-stream · inferencerlabs on huggingface.
Configs measured by inferencerlabs
| Model | Hardware | Quant | Backend | Decode | Context | Trust | Source |
|---|---|---|---|---|---|---|---|
| Qwen3.8-Flash-Next | Mac Max | Q4-INF | mlx | 57.5 tok/s | Extracted, source-linked | source |
More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.