Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🏆
Rankings

LLM Leaderboard

Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.

⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
Reset
Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E4B-it8BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
133,73 tok/s TG
Prefill 1.652 · TTFT 12.206 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
2gemma-4-E4B-it8BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,06 tok/s TG
Prefill 1.687 · TTFT 12.063 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
3gemma-4-E4B-it8BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
95,22 tok/s TG
Prefill 1.480 · TTFT 6.689 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
4gemma-4-E4B-it8BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
93,25 tok/s TG
Prefill 1.437 · TTFT 6.874 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
5gemma-4-E4B-it8BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
53,35 tok/s TG
Prefill 1.366 · TTFT 1.447 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli
6gemma-4-E4B-it8BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
38,32 tok/s TG
Prefill 1.088 · TTFT 1.818 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cli