Contributors › Jiunsong's local-LLM benchmark configs

Jiunsong's local-LLM benchmark configs

Every tracked benchmark config measured by Jiunsong: model, quant, backend, tokens per second, source-linked and trust-tiered.

Snapshot 2026-10-29 · 413 configs on AI boxes and 288 on GPU cards · 121 models. Every number is generated from the tracker snapshot and linked to where it was measured; nothing here is typed by hand.

2 configs · 2 models · 25.8 tok/s best single-stream · Jiunsong on huggingface.

Configs measured by Jiunsong

ModelHardwareQuantBackendDecodeContextTrustSource
SuperQwen3.8-27B-abliteratedDGX SparkNVFP4vllm (speculative decode, spec-k5)25.8 tok/s262043Extracted, source-linkedsource

More: all configs · hardware · news · contributors · methodology · llms.txt · llms-full.txt · API (OpenAPI) · JSON snapshot. Built by Altronis, private on-prem AI, Singapore.