🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 323,81 tok/s TG Prefill 6.071 · TTFT 3.506 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 322,89 tok/s TG Prefill 27.208 · TTFT 972 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 3 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 212,46 tok/s TG Prefill 5.449 · TTFT 1.783 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 4 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 187,26 tok/s TG Prefill 21.013 · TTFT 558 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 5 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 110,95 tok/s TG Prefill 3.119 · TTFT 639 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,77 tok/s TG Prefill 8.388 · TTFT 218 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 7 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,94 tok/s TG Prefill 52 · TTFT 404.593 ms | 10× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 8 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,49 tok/s TG Prefill 35 · TTFT 283.919 ms | 5× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 9 | gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,76 tok/s TG Prefill 31 · TTFT 59.057 ms | 1× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |

