Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.564,61 tok/s TG
Prefill 2.600 · TTFT 34.894 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
2NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.562,27 tok/s TG
Prefill 2.593 · TTFT 34.854 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
3Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.555,31 tok/s TG
Prefill 2.655 · TTFT 34.751 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
4Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.100,69 tok/s TG
Prefill 27.110 · TTFT 739 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
5Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
1.044,38 tok/s TG
Prefill 38.866 · TTFT 388 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
6Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
902,92 tok/s TG
Prefill - · TTFT 227 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
7gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
861,40 tok/s TG
Prefill 15.615 · TTFT 1.677 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
8Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
846,62 tok/s TG
Prefill - · TTFT 238 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
9Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
833,03 tok/s TG
Prefill - · TTFT 213 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
10gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
826,24 tok/s TG
Prefill 3.229 · TTFT 15.223 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
11Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
804,23 tok/s TG
Prefill 2.435 · TTFT 15.796 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
12NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
795,03 tok/s TG
Prefill 2.378 · TTFT 15.951 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
13Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
783,55 tok/s TG
Prefill 2.459 · TTFT 15.907 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
14Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,38 tok/s TG
Prefill 14.373 · TTFT 1.721 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
15Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,30 tok/s TG
Prefill - · TTFT 165 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
16Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
608,35 tok/s TG
Prefill 23.343 · TTFT 414 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
17Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
589,64 tok/s TG
Prefill 43.711 · TTFT 223 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
18Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
569,97 tok/s TG
Prefill - · TTFT 160 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
19gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
543,78 tok/s TG
Prefill 12.359 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
20Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
490,51 tok/s TG
Prefill - · TTFT 177 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
21gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
474,76 tok/s TG
Prefill 1.760 · TTFT 26.540 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
22gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
436,25 tok/s TG
Prefill 3.526 · TTFT 5.370 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
23Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
417,52 tok/s TG
Prefill 12.747 · TTFT 959 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
24Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
351,55 tok/s TG
Prefill 1.164 · TTFT 38.427 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
25Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
333,12 tok/s TG
Prefill 1.168 · TTFT 37.996 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
26gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
267,65 tok/s TG
Prefill 1.544 · TTFT 9.962 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
27Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
219,59 tok/s TG
Prefill 2.273 · TTFT 11.329 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
28Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,63 tok/s TG
Prefill 993 · TTFT 14.781 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
29Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,55 tok/s TG
Prefill 1.000 · TTFT 14.742 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
30Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
190,25 tok/s TG
Prefill 1.859 · TTFT 13.867 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
31Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
171,47 tok/s TG
Prefill - · TTFT 98 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
32Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,71 tok/s TG
Prefill - · TTFT 160 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
33Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,58 tok/s TG
Prefill 1.951 · TTFT 1.010 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
34NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,32 tok/s TG
Prefill 1.225 · TTFT 2.121 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
35Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,06 tok/s TG
Prefill 1.772 · TTFT 1.128 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
36Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
157,50 tok/s TG
Prefill 1.715 · TTFT 6.606 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
37Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,26 tok/s TG
Prefill 1.343 · TTFT 8.459 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
38Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,56 tok/s TG
Prefill 1.267 · TTFT 4.040 ms
10×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
39Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
140,06 tok/s TG
Prefill 1.284 · TTFT 1.994 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
40Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
138,75 tok/s TG
Prefill 1.439 · TTFT 1.508 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
41gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
134,26 tok/s TG
Prefill 1.113 · TTFT 2.031 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
42Kolibri-178.1BAleph Alpha PerformancebenchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1
133,13 tok/s TG
Prefill 20.590 · TTFT 106 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMserverphasetimingNVFP4
43Kolibri-178.1BAleph Alpha PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,86 tok/s TG
Prefill - · TTFT 155 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclaw
44Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
130,73 tok/s TG
Prefill 15.397 · TTFT 126 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
45Ling-3.0-flash127.5BinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 8.225 · TTFT 296 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawNVFP4
46gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
126,12 tok/s TG
Prefill 7.867 · TTFT 251 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawAWQ
47Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
124,52 tok/s TG
Prefill 1.096 · TTFT 2.336 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLUD-Q4_K_M
48Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
120,01 tok/s TG
Prefill 1.155 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XS
49gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
111,12 tok/s TG
Prefill 616 · TTFT 16.066 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliMXFP4
50gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,30 tok/s TG
Prefill 694 · TTFT 29.007 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliMXFP4
51Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,04 tok/s TG
Prefill 1.089 · TTFT 4.703 ms
10×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLUD-Q4_K_M
52Kolibri-178.1BAleph Alpha HarnessbenchmarkOffice Agentic Work 100 - Tool Usage V1
100 Pkt
100,0% · 100/100 Aufg. · 547,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMofficeagentic100NVFP4
53Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 57,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMBuzzwordTrainAWQ
54Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 36,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
55Open-Jev-27B-v1.127BZefan Cai / Open-Jev HarnessbenchmarkDecision-Benchmark V 1.0
200 Pkt
100,0% · 200/200 Aufg. · 75,5 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMpytorchpytorch
56Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
207 Pkt
98,6% · 207/210 Aufg. · 1.080,2 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210
57gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
97,08 tok/s TG
Prefill 757 · TTFT 13.077 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
58Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
193 Pkt
96,5% · 193/200 Aufg. · 3.667,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
59Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
289 Pkt
93,2% · 289/310 Aufg. · 2.504,7 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310FP8
60Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
283 Pkt
91,3% · 283/310 Aufg. · 2.384,4 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310NVFP4
61gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
84,70 tok/s TG
Prefill 1.022 · TTFT 2.264 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
62Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
82,07 tok/s TG
Prefill 383 · TTFT 4.502 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_M
63Nemotron-Cascade-2-30B-A3B30BNVIDIA HarnessbenchmarkDecision-Benchmark V 1.0
159 Pkt
79,5% · 159/200 Aufg. · 35,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllm
64Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
78,10 tok/s TG
Prefill 816 · TTFT 627 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ4_K_M
65Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,84 tok/s TG
Prefill 920 · TTFT 2.098 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
66Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,58 tok/s TG
Prefill 888 · TTFT 15.224 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
67Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
66,43 tok/s TG
Prefill 898 · TTFT 2.781 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
68Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,46 tok/s TG
Prefill 592 · TTFT 16.869 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
69gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,18 tok/s TG
Prefill 627 · TTFT 3.155 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliMXFP4
70Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,18 tok/s TG
Prefill 592 · TTFT 865 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLUD-Q4_K_M
71Laya0.4BConvai Innovations HarnessbenchmarkDecision-Benchmark V 1.0
122 Pkt
61,0% · 122/200 Aufg. · 14,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMpytorchpytorch
72gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
58,96 tok/s TG
Prefill 818 · TTFT 24.766 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
73Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,23 tok/s TG
Prefill 357 · TTFT 14.331 ms
10×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ8_0
74Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
51,58 tok/s TG
Prefill 348 · TTFT 7.358 ms
5×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ8_0
75Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 210 V1.0
108 Pkt
51,4% · 108/210 Aufg. · 72,1 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic210
76gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,75 tok/s TG
Prefill 305 · TTFT 32.520 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
77Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) HarnessbenchmarkDecision-Benchmark High V 1.0
87 Pkt
43,5% · 87/200 Aufg. · 19,0 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMvllmAWQ
78gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
43,23 tok/s TG
Prefill 758 · TTFT 2.613 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
79Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,11 tok/s TG
Prefill 821 · TTFT 2.298 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMopenclaw_cli
80Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
41,46 tok/s TG
Prefill 476 · TTFT 25.832 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
81Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
119 Pkt
38,4% · 119/310 Aufg. · 87,9 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310NVFP4
82Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,94 tok/s TG
Prefill 70 · TTFT 161.804 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
83Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,65 tok/s TG
Prefill 776 · TTFT 29.085 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
84Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,29 tok/s TG
Prefill 1.115 · TTFT 27.826 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
85Kolibri-178.1BAleph Alpha HarnessbenchmarkKolibri-Qwen Diverse Deterministic 310 V2.0
115 Pkt
37,1% · 115/310 Aufg. · 99,6 s
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMdeterministic310FP8
86Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,46 tok/s TG
Prefill 589 · TTFT 4.189 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
87Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,54 tok/s TG
Prefill 547 · TTFT 3.535 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
88gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,41 tok/s TG
Prefill 50 · TTFT 226.449 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
89gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
26,57 tok/s TG
Prefill 50 · TTFT 276.964 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
90Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,68 tok/s TG
Prefill 182 · TTFT 2.809 ms
1×Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli batched-bench SYCLQ8_0
91gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,04 tok/s TG
Prefill 333 · TTFT 61.247 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
92Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,74 tok/s TG
Prefill 212 · TTFT 57.889 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
93Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,84 tok/s TG
Prefill 277 · TTFT 48.247 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
94Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,64 tok/s TG
Prefill 281 · TTFT 6.718 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_M
95Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,29 tok/s TG
Prefill 273 · TTFT 55.104 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
96Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,18 tok/s TG
Prefill 319 · TTFT 8.542 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_M
97Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,15 tok/s TG
Prefill 308 · TTFT 64.768 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
98Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,11 tok/s TG
Prefill 639 · TTFT 44.373 ms
10×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
99Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,41 tok/s TG
Prefill 388 · TTFT 5.855 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
100gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,30 tok/s TG
Prefill 298 · TTFT 6.721 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
101Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,24 tok/s TG
Prefill 263 · TTFT 57.267 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
102GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,75 tok/s TG
Prefill 987 · TTFT 26.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
103Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,72 tok/s TG
Prefill 45 · TTFT 32.857 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
104Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,57 tok/s TG
Prefill 159 · TTFT 13.491 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
105Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,55 tok/s TG
Prefill 166 · TTFT 13.627 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
106Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,51 tok/s TG
Prefill 185 · TTFT 14.723 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
107Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,47 tok/s TG
Prefill 197 · TTFT 13.734 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
108Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,34 tok/s TG
Prefill 243 · TTFT 13.913 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_M
109gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,82 tok/s TG
Prefill 40 · TTFT 49.516 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
110GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
10,94 tok/s TG
Prefill 762 · TTFT 15.666 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
111GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,01 tok/s TG
Prefill 441 · TTFT 4.837 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMvLLMgodclawFP8
112Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,00 tok/s TG
Prefill 15 · TTFT 531 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
113command-a-reasoning-08-2025111BCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,02 tok/s TG
Prefill 5 · TTFT 485.856 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M