⚡
Performance benchmark
How fast is the model?
Raw throughput on real hardware – how many tokens a model generates per second, how quickly it processes the prompt and how short the time to first token is. Higher is better.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 43,17 tok/s TG Prefill 281 · TTFT 8.805 ms | 1× | AMD Liverpool (PlayStation 4)AMD Jaguar 8-Core (PlayStation 4) · 5 GB RAM | llama.cppgodclawQ4_K_M | Details → |