🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2.263,71 tok/s TG Prefill 9.016 · TTFT 21.818 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmNVFP4 | Details → | |
| 2 | Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.134,97 tok/s TG Prefill 8.757 · TTFT 9.812 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmNVFP4 | Details → | |
| 3 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.132,67 tok/s TG Prefill 1.930 · TTFT 47.978 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 4 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 830,46 tok/s TG Prefill 3.771 · TTFT 14.928 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | hermes_cli | Details → | |
| 5 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 829,45 tok/s TG Prefill 3.778 · TTFT 14.891 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | hermes_cli | Details → | |
| 6 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 828,36 tok/s TG Prefill 3.763 · TTFT 14.940 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliQ4_K_M | Details → | |
| 7 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 638,58 tok/s TG Prefill 306 · TTFT 145.278 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 8 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 572,23 tok/s TG Prefill 1.826 · TTFT 21.491 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 9 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 572,10 tok/s TG Prefill 10.901 · TTFT 1.915 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 10 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 467,09 tok/s TG Prefill 3.349 · TTFT 5.143 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliQ4_K_M | Details → | |
| 11 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 451,05 tok/s TG Prefill 32.005 · TTFT 864 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllm | Details → | |
| 12 | Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 404,72 tok/s TG Prefill 4.793 · TTFT 5.226 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliIQ4_NL | Details → | |
| 13 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 397,18 tok/s TG Prefill 3.476 · TTFT 5.916 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 14 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 372,40 tok/s TG Prefill 1.508 · TTFT 13.832 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 15 | glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 349,28 tok/s TG Prefill 7.891 · TTFT 3.899 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliAWQ | Details → | |
| 16 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 346,29 tok/s TG Prefill 16.028 · TTFT 1.776 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 17 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 319,40 tok/s TG Prefill 254 · TTFT 73.516 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 18 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 308,36 tok/s TG Prefill 9.336 · TTFT 1.062 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 19 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 306,80 tok/s TG Prefill 9.358 · TTFT 1.060 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 20 | Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,10 tok/s TG Prefill 3.941 · TTFT 2.860 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliIQ4_NL | Details → | |
| 21 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 287,13 tok/s TG Prefill 3.082 · TTFT 3.211 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 22 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 277,86 tok/s TG Prefill 3.781 · TTFT 10.183 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmAWQ | Details → | |
| 23 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 247,69 tok/s TG Prefill 5.149 · TTFT 6.214 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 24 | glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 233,82 tok/s TG Prefill 6.284 · TTFT 2.148 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliAWQ | Details → | |
| 25 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 228,02 tok/s TG Prefill 11.489 · TTFT 2.605 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllm | Details → | |
| 26 | Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 227,41 tok/s TG Prefill 6.536 · TTFT 346 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmNVFP4 | Details → | |
| 27 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 214,10 tok/s TG Prefill 4.633 · TTFT 8.462 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 28 | glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,45 tok/s TG Prefill 14.193 · TTFT 1.973 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 29 | Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 196,02 tok/s TG Prefill 3.211 · TTFT 670 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliIQ4_NL | Details → | |
| 30 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 184,33 tok/s TG Prefill 2.857 · TTFT 5.676 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmAWQ | Details → | |
| 31 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,69 tok/s TG Prefill 2.125 · TTFT 4.654 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 32 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 177,40 tok/s TG Prefill 11.718 · TTFT 941 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 33 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 174,07 tok/s TG Prefill 1.206 · TTFT 16.925 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 34 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 162,37 tok/s TG Prefill 2.928 · TTFT 659 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | hermes_cli | Details → | |
| 35 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 162,17 tok/s TG Prefill 2.928 · TTFT 660 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliQ4_K_M | Details → | |
| 36 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,49 tok/s TG Prefill 182 · TTFT 97.092 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 37 | glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 144,63 tok/s TG Prefill 3.247 · TTFT 656 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cliAWQ | Details → | |
| 38 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 125,87 tok/s TG Prefill 3.206 · TTFT 618 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 39 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 125,21 tok/s TG Prefill 3.410 · TTFT 4.809 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 40 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 123,94 tok/s TG Prefill 3.957 · TTFT 3.439 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 41 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,39 tok/s TG Prefill 1.389 · TTFT 1.421 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 42 | glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,50 tok/s TG Prefill 10.352 · TTFT 1.169 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 43 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 83,56 tok/s TG Prefill 2.303 · TTFT 859 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 44 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,35 tok/s TG Prefill 998 · TTFT 9.924 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 45 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Harness benchmarkDecision-Benchmark V 1.0 | 159 Pkt 79,5% · 159/200 Aufg. · 21,0 s | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | vLLMvllm | Details → | |
| 46 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,79 tok/s TG Prefill 1.062 · TTFT 9.322 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 47 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,64 tok/s TG Prefill 5.671 · TTFT 366 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 48 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,55 tok/s TG Prefill 1.941 · TTFT 1.402 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 49 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,12 tok/s TG Prefill 3.392 · TTFT 922 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 50 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,53 tok/s TG Prefill 106 · TTFT 20.413 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 51 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,58 tok/s TG Prefill 10.520 · TTFT 189 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmBF16 | Details → | |
| 52 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,20 tok/s TG Prefill 11.058 · TTFT 180 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllm | Details → | |
| 53 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,01 tok/s TG Prefill 11.757 · TTFT 169 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMvllmBF16 | Details → | |
| 54 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,38 tok/s TG Prefill 1.437 · TTFT 1.875 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vllm | Details → | |
| 55 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,86 tok/s TG Prefill 6.286 · TTFT 315 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cli | Details → | |
| 56 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,10 tok/s TG Prefill 1.020 · TTFT 1.964 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 57 | gemma-4-31B-it31BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,74 tok/s TG Prefill 938 · TTFT 2.110 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | openclaw_cli | Details → | |
| 58 | glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,28 tok/s TG Prefill 6.200 · TTFT 346 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → |