Contributors › 0rvar's local-LLM benchmark configs

0rvar's local-LLM benchmark configs

Every tracked benchmark config measured by 0rvar: model, quant, backend, tokens per second, source-linked and trust-tiered.

Snapshot 2026-10-15 · 394 configs on AI boxes and 423 on GPU cards · 123 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.

2 configs · 2 models · 55.9 tok/s best single-stream · 0rvar on github.

Configs measured by 0rvar

ModelHardwareQuantBackendDecodeContextTrustSource
Qwen3-4BMac MaxBF16xwen55.9 tok/s (prefill 3416)3890Extracted, source-linkedsource
Qwen3.8-Flash-NextMac MaxUD-Q4_K_XLllama.cpp41.4 tok/s (prefill 789)530Extracted, source-linkedsource

More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.