🏆 Rangliste
Highscore
Die besten Läufe im direkten Ranking – umschaltbar zwischen Performance (Token/s) und Harness (Aufgabenpunkte).
| # | Modell / Hersteller | Grafikkarte | CPU / RAM | Prefill | Prefill | TG | TTFT | Parallel | Runtime | |
|---|---|---|---|---|---|---|---|---|---|---|
| 🥇 | Qwen3-0.6B0.6BQwen (Alibaba) | NVIDIA GeForce RTX 4090 | AMD Ryzen 3 3100 4-Core Processor 61 GB | 112.346,4 tok/s |
112.346 | 503,3 | 241 ms | 10× | vLLMopenclaw_cliFP8 | Details → |
| 🥈 | Qwen3-0.6B0.6BQwen (Alibaba) | NVIDIA GeForce RTX 4090 | AMD Ryzen 3 3100 4-Core Processor 61 GB | 81.661,4 tok/s |
81.661 | 258,2 | 158 ms | 5× | vLLMopenclaw_cliFP8 | Details → |
| 🥉 | gemma-4-E2B-it5BGoogle | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 55.259,6 tok/s |
55.260 | 1.568,0 | 492 ms | 10× | vLLMgodclawFP8 | Details → |
| 4 | Llama-3.2-1B-Instruct1BMeta | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 52.503,3 tok/s |
52.503 | 717,6 | 1021 ms | 10× | vLLMgodclaw | Details → |
| 5 | Qwen3-0.6B0.6BQwen (Alibaba) | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 49.305,8 tok/s |
49.306 | 384,2 | 1938 ms | 10× | vLLMgodclaw | Details → |
| 6 | gemma-4-E2B-it5BGoogle | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 47.158,4 tok/s |
47.158 | 1.359,1 | 587 ms | 10× | vLLMgodclawFP8 | Details → |
| 7 | Nemotron-3-Nano-4B4BNVIDIA | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 44.171,1 tok/s |
44.171 | 1.485,1 | 716 ms | 10× | vLLMgodclawFP8 | Details → |
| 8 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 44.141,4 tok/s |
44.141 | 531,7 | 1001 ms | 10× | vLLMgodclaw | Details → |
| 9 | Kolibri-178.1BAleph Alpha | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | AMD Ryzen 9 7945HX with Radeon Graphics 60 GB | 43.711,3 tok/s |
43.711 | 589,6 | 223 ms | 5× | serverphasetimingNVFP4 | Details → |
| 10 | gemma-4-E2B-it5BGoogle | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 43.093,1 tok/s |
43.093 | 909,0 | 287 ms | 5× | vLLMgodclawFP8 | Details → |
| 11 | Llama-3.2-1B-Instruct1BMeta | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 41.361,8 tok/s |
41.362 | 696,8 | 722 ms | 10× | llama.cppgodclawQ4_K_M | Details → |
| 12 | Llama-3.2-1B-Instruct1BMeta | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 40.759,8 tok/s |
40.760 | 479,2 | 355 ms | 5× | vLLMgodclaw | Details → |
| 13 | Laguna-XS-2.1Poolside | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 39.157,1 tok/s |
39.157 | 836,4 | 1032 ms | 10× | vLLMgodclawAWQ | Details → |
| 14 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 39.028,9 tok/s |
39.029 | 906,0 | 1192 ms | 10× | vLLMgodclawAWQ | Details → |
| 15 | Qwen3-0.6B0.6BQwen (Alibaba) | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 38.946,4 tok/s |
38.946 | 260,2 | 371 ms | 5× | vLLMgodclaw | Details → |
| 16 | Kolibri-178.1BAleph Alpha | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition | AMD Ryzen 9 7945HX with Radeon Graphics 60 GB | 38.865,9 tok/s |
38.866 | 1.044,4 | 388 ms | 10× | serverphasetimingNVFP4 | Details → |
| 17 | gemma-4-E2B-it5BGoogle | NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 38.712,2 tok/s |
38.712 | 1.122,5 | 690 ms | 10× | vLLMopenclaw_cliFP8 | Details → |
| 18 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 37.675,6 tok/s |
37.676 | 789,2 | 952 ms | 10× | vLLMgodclawAWQ | Details → |
| 19 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) | NVIDIA GeForce RTX 5090 | AMD Ryzen 7 5800X3D 8-Core Processor 126 GB | 37.116,1 tok/s |
37.116 | 909,3 | 1783 ms | 10× | vLLMcodex_cliAWQ | Details → |
| 20 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 36.884,1 tok/s |
36.884 | 1.028,5 | 915 ms | 10× | vLLMgodclawAWQ | Details → |
| 21 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 35.900,1 tok/s |
35.900 | 763,5 | 986 ms | 10× | vLLMgodclawAWQ | Details → |
| 22 | gemma-4-E2B-it5BGoogle | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 35.757,2 tok/s |
35.757 | 803,2 | 347 ms | 5× | vLLMgodclawFP8 | Details → |
| 23 | Nemotron-3.5-Lightning-30B-A3B30BNVIDIA | 4x AMD Radeon AI PRO R9700 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 35.719,4 tok/s |
35.719 | 290,3 | 1014 ms | 10× | vLLMgodclawBF16 | Details → |
| 24 | gpt-oss-20b20BOpenAI | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 35.347,7 tok/s |
35.348 | 1.443,9 | 560 ms | 10× | vLLMgodclaw | Details → |
| 25 | Laguna-XS-2.1Poolside | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 35.143,3 tok/s |
35.143 | 712,0 | 1137 ms | 10× | vLLMgodclawFP8 | Details → |
| 26 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 34.912,8 tok/s |
34.913 | 758,7 | 991 ms | 10× | vLLMgodclawAWQ | Details → |
| 27 | Laguna-XS-2.1Poolside | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 34.194,0 tok/s |
34.194 | 771,8 | 1183 ms | 10× | vLLMgodclawAWQ | Details → |
| 28 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 33.906,7 tok/s |
33.907 | 910,7 | 1527 ms | 10× | vLLMgodclawAWQ | Details → |
| 29 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) | NVIDIA GeForce RTX 5090 | AMD Ryzen 7 5800X3D 8-Core Processor 126 GB | 33.767,8 tok/s |
33.768 | 966,2 | 1792 ms | 10× | vLLMcodex_cliAWQ | Details → |
| 30 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 33.740,5 tok/s |
33.741 | 1.070,6 | 975 ms | 10× | vLLMgodclawAWQ | Details → |
| 31 | North-Mini-Code-1.0Cohere | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 33.281,4 tok/s |
33.281 | 518,1 | 869 ms | 10× | vLLMgodclawFP8 | Details → |
| 32 | SmolLM2-1.7B-Instruct1.7BHuggingFaceTB | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 33.135,0 tok/s |
33.135 | 338,7 | 574 ms | 5× | vLLMgodclaw | Details → |
| 33 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) | NVIDIA GeForce RTX 5090 | AMD Ryzen 7 5800X3D 8-Core Processor 126 GB | 33.022,6 tok/s |
33.023 | 873,7 | 1834 ms | 10× | vLLMcodex_cliAWQ | Details → |
| 34 | Qwen3-1.7B1.7BQwen (Alibaba) | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 32.764,1 tok/s |
32.764 | 387,7 | 2280 ms | 10× | vLLMgodclaw | Details → |
| 35 | Qwen3.5-35B-A3B35BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 32.522,1 tok/s |
32.522 | 787,3 | 826 ms | 10× | vLLMgodclawAWQ | Details → |
| 36 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 32.339,6 tok/s |
32.340 | 751,7 | 1270 ms | 10× | vLLMgodclawAWQ | Details → |
| 37 | Qwen3.6-35B-A3B35BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 32.313,4 tok/s |
32.313 | 800,4 | 826 ms | 10× | vLLMgodclawAWQ | Details → |
| 38 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 32.304,9 tok/s |
32.305 | 961,5 | 1633 ms | 10× | vLLMgodclawAWQ | Details → |
| 39 | Gemma-4-26B-A4B-it26BGoogle | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 32.027,3 tok/s |
32.027 | 841,8 | 922 ms | 10× | vLLMgodclawAWQ | Details → |
| 40 | gemma-4-E2B-it5BGoogle | NVIDIA GeForce RTX 3090 Ti | AMD Ryzen 5 5600X 6-Core Processor 30 GB | 32.005,2 tok/s |
32.005 | 451,1 | 864 ms | 10× | vLLMvllm | Details → |
| 41 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 31.954,3 tok/s |
31.954 | 799,7 | 833 ms | 10× | vLLMgodclawAWQ | Details → |
| 42 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 31.909,7 tok/s |
31.910 | 515,3 | 1106 ms | 10× | vLLMgodclawFP8 | Details → |
| 43 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 31.732,8 tok/s |
31.733 | 554,2 | 1123 ms | 10× | vLLMgodclawFP8 | Details → |
| 44 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 31.724,4 tok/s |
31.724 | 625,7 | 395 ms | 5× | vLLMgodclawAWQ | Details → |
| 45 | Llama-3.2-1B-Instruct1BMeta | 2x AMD Radeon RX 7900 XTX | 4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 504 GB | 31.648,4 tok/s |
31.648 | 609,5 | 961 ms | 10× | llama.cppgodclawQ4_K_M | Details → |
| 46 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 31.646,6 tok/s |
31.647 | 582,7 | 1123 ms | 10× | vLLMgodclawFP8 | Details → |
| 47 | gemma-4-E2B-it5BGoogle | NVIDIA GeForce RTX 5070 Ti | AMD Ryzen Threadripper PRO 5975WX 32-Cores 247 GB | 31.451,6 tok/s |
31.452 | 1.608,5 | 1632 ms | 10× | vLLMgodclaw | Details → |
| 48 | gpt-oss-20b20BOpenAI | NVIDIA RTX PRO 6000 Blackwell Workstation Edition | AMD Ryzen 9 9950X 16-Core Processor 92 GB | 31.097,5 tok/s |
31.098 | 842,9 | 318 ms | 5× | vLLMgodclaw | Details → |
| 49 | Llama-3.2-1B-Instruct1BMeta | 2x AMD Radeon RX 7900 XTX | AMD Ryzen Threadripper PRO 3955WX 16-Cores 63 GB | 31.085,4 tok/s |
31.085 | 443,7 | 444 ms | 5× | llama.cppgodclawQ4_K_M | Details → |
| 50 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) | 2x NVIDIA RTX A6000 | AMD Ryzen Threadripper PRO 7955WX 16-Cores 184 GB | 31.043,0 tok/s |
31.043 | 573,6 | 1133 ms | 10× | vLLMgodclawFP8 | Details → |
Ranking aus veröffentlichten Benchmarks. Sortiert nach Prefill-Durchsatz. Wie wird gemessen?