Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🏆
Rankings

LLM Leaderboard

Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.

⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
Reset
Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,30 tok/s TG
Prefill 1.816 · TTFT 1.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
2gemma-4-E2B-it5BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,49 tok/s TG
Prefill 1.763 · TTFT 1.123 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
3gemma-4-E2B-it5BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,45 tok/s TG
Prefill 1.249 · TTFT 8.044 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
4gemma-4-E2B-it5BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,43 tok/s TG
Prefill 1.220 · TTFT 8.133 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
5gemma-4-E2B-it5BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,73 tok/s TG
Prefill 1.306 · TTFT 16.890 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
6gemma-4-E2B-it5BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,84 tok/s TG
Prefill 1.286 · TTFT 17.461 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli