Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
736,95 tok/s TG
Prefill 152 · TTFT 9.120 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cli
2Magistral-Small-250924BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
726,94 tok/s TG
Prefill 10.204 · TTFT 2.619 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
3Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
724,52 tok/s TG
Prefill 181 · TTFT 7.226 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclaw
4Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
637,17 tok/s TG
Prefill 218 · TTFT 7.760 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
5Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
628,63 tok/s TG
Prefill 148 · TTFT 9.358 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
6Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
612,90 tok/s TG
Prefill 149 · TTFT 8.949 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
7Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
524,66 tok/s TG
Prefill 239 · TTFT 10.174 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
8Magistral-Small-250924BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
411,83 tok/s TG
Prefill 7.172 · TTFT 1.728 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
9Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
392,12 tok/s TG
Prefill 125 · TTFT 981 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclaw
10Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,97 tok/s TG
Prefill 164 · TTFT 1.829 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cli
11Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
353,84 tok/s TG
Prefill 924 · TTFT 13.139 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocket
12Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,04 tok/s TG
Prefill 103 · TTFT 2.521 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
13Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
332,52 tok/s TG
Prefill 146 · TTFT 1.828 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
14Magistral-Small-250924BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
330,94 tok/s TG
Prefill 4.379 · TTFT 7.353 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
15Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
323,37 tok/s TG
Prefill 186 · TTFT 2.106 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
16Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
258,91 tok/s TG
Prefill 357 · TTFT 2.070 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
17Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
229,95 tok/s TG
Prefill 655 · TTFT 21.862 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
18Magistral-Small-250924BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,20 tok/s TG
Prefill 2.929 · TTFT 4.189 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
19Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
224,79 tok/s TG
Prefill 606 · TTFT 26.540 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
20Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
210,79 tok/s TG
Prefill 606 · TTFT 28.206 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
21Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
183,68 tok/s TG
Prefill 853 · TTFT 1.050 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocket
22Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
159,03 tok/s TG
Prefill 110 · TTFT 25.408 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
23Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
141,74 tok/s TG
Prefill 3.097 · TTFT 9.194 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
24Magistral-Small-250924BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
134,63 tok/s TG
Prefill 2.084 · TTFT 13.635 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
25Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,27 tok/s TG
Prefill 1.947 · TTFT 14.530 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
26Magistral-Small-250924BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
119,81 tok/s TG
Prefill 1.314 · TTFT 21.514 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
27Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
118,51 tok/s TG
Prefill 482 · TTFT 2.854 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
28Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
112,02 tok/s TG
Prefill 553 · TTFT 3.143 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
29Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
111,95 tok/s TG
Prefill 473 · TTFT 3.796 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
30Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,48 tok/s TG
Prefill 68 · TTFT 119 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cli
31Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
100,09 tok/s TG
Prefill 36 · TTFT 233 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclaw
32Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,97 tok/s TG
Prefill 28 · TTFT 287 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
33Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,10 tok/s TG
Prefill 30 · TTFT 268 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
34Magistral-Small-250924BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,03 tok/s TG
Prefill 5.629 · TTFT 380 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw
35Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
95,86 tok/s TG
Prefill 54 · TTFT 196 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
36Magistral-Small-250924BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
92,32 tok/s TG
Prefill 1.520 · TTFT 8.029 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
37Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
84,92 tok/s TG
Prefill 136 · TTFT 59 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
38Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
81,44 tok/s TG
Prefill 97 · TTFT 10.098 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
39Magistral-Small-250924BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
80,23 tok/s TG
Prefill 957 · TTFT 12.767 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
40Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,28 tok/s TG
Prefill 2.229 · TTFT 5.504 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
41Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,19 tok/s TG
Prefill 1.398 · TTFT 8.787 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
42Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
59,06 tok/s TG
Prefill 405 · TTFT 20 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocket
43Magistral-Small-250924BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
58,03 tok/s TG
Prefill 1.644 · TTFT 1.302 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
44Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
39,25 tok/s TG
Prefill 1.548 · TTFT 1.457 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
45Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
39,05 tok/s TG
Prefill 1.058 · TTFT 2.128 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
46Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,94 tok/s TG
Prefill 70 · TTFT 161.804 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cli
47Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,29 tok/s TG
Prefill 251 · TTFT 32 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
48Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,25 tok/s TG
Prefill 254 · TTFT 31 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
49Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,92 tok/s TG
Prefill 252 · TTFT 32 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
50Magistral-Small-250924BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,17 tok/s TG
Prefill 764 · TTFT 2.952 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
51Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i
28,90 tok/s TG
Prefill 1.318 · TTFT 2.246 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
52Magistral-Small-250924BQ4_K_MMistral AI Performancebenchmark i
28,90 tok/s TG
Prefill 1.318 · TTFT 2.246 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
53Magistral-Small-250924BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,80 tok/s TG
Prefill 1.167 · TTFT 1.929 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
54Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,74 tok/s TG
Prefill 212 · TTFT 57.889 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cli
55Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,57 tok/s TG
Prefill 29 · TTFT 286 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
56Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i
19,42 tok/s TG
Prefill 2.175 · TTFT 1.030 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
57Magistral-Small-250924BQ4_K_MMistral AI Performancebenchmark i
19,42 tok/s TG
Prefill 2.175 · TTFT 1.030 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
58Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i
18,46 tok/s TG
Prefill 1.263 · TTFT 1.741 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
59Magistral-Small-250924BQ4_K_MMistral AI Performancebenchmark i
18,46 tok/s TG
Prefill 1.263 · TTFT 1.741 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
60Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,72 tok/s TG
Prefill 45 · TTFT 32.857 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cli
61Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,55 tok/s TG
Prefill 166 · TTFT 13.627 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cli
62Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,00 tok/s TG
Prefill 15 · TTFT 531 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cli