Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🏆
Ranglisten

LLM Leaderboard

Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.

⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
Reset
Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
641,39 tok/s TG
Prefill 6.716 · TTFT 15.676 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cli
2Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,49 tok/s TG
Prefill 6.861 · TTFT 15.390 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclaw
3Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
559,41 tok/s TG
Prefill 9.986 · TTFT 16.664 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
4Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
547,92 tok/s TG
Prefill 8.153 · TTFT 16.930 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
5Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
455,34 tok/s TG
Prefill 5.365 · TTFT 21.481 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
6Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
350,14 tok/s TG
Prefill 6.541 · TTFT 4.589 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclaw
7Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
346,65 tok/s TG
Prefill 6.719 · TTFT 4.938 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cli
8Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
325,20 tok/s TG
Prefill 3.507 · TTFT 31.980 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocket
9Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
306,90 tok/s TG
Prefill 10.683 · TTFT 4.930 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
10Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
301,60 tok/s TG
Prefill 6.192 · TTFT 5.565 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
11Codestral-22B-v0.122BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
277,86 tok/s TG
Prefill 3.781 · TTFT 10.183 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
12Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
258,32 tok/s TG
Prefill 5.049 · TTFT 6.208 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
13Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
214,10 tok/s TG
Prefill 4.633 · TTFT 8.462 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacpp
14Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
201,46 tok/s TG
Prefill 3.877 · TTFT 48.219 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
15Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
198,80 tok/s TG
Prefill 5.019 · TTFT 46.235 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
16Codestral-22B-v0.122BAWQMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,33 tok/s TG
Prefill 2.857 · TTFT 5.676 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
17Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,91 tok/s TG
Prefill 2.336 · TTFT 55.212 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
18Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
178,38 tok/s TG
Prefill 3.257 · TTFT 10.368 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocket
19Codestral-22B-v0.122BIQ4_XSMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
147,45 tok/s TG
Prefill 1.813 · TTFT 17.552 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
20Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
134,52 tok/s TG
Prefill 1.360 · TTFT 24.430 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
21Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
133,11 tok/s TG
Prefill 1.768 · TTFT 18.406 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
22Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 3.410 · TTFT 4.809 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacpp
23Codestral-22B-v0.122BIQ4_XSMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,66 tok/s TG
Prefill 2.453 · TTFT 6.575 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
24Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,33 tok/s TG
Prefill 1.762 · TTFT 18.471 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
25Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
111,50 tok/s TG
Prefill 1.387 · TTFT 11.441 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
26Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,89 tok/s TG
Prefill 3.707 · TTFT 13.889 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
27Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,69 tok/s TG
Prefill 4.844 · TTFT 12.709 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
28Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,55 tok/s TG
Prefill 2.042 · TTFT 15.214 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
29Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
102,38 tok/s TG
Prefill 1.243 · TTFT 27.006 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
30Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
101,58 tok/s TG
Prefill 2.196 · TTFT 16.679 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
31Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
96,24 tok/s TG
Prefill 4.036 · TTFT 673 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cli
32Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
94,15 tok/s TG
Prefill 3.697 · TTFT 735 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclaw
33Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
88,16 tok/s TG
Prefill 5.077 · TTFT 543 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
34Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
88,03 tok/s TG
Prefill 4.755 · TTFT 577 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
35Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
86,63 tok/s TG
Prefill 1.851 · TTFT 8.111 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
36Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
84,31 tok/s TG
Prefill 2.202 · TTFT 7.548 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
37Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
81,08 tok/s TG
Prefill 2.880 · TTFT 951 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclaw
38Codestral-22B-v0.122BMistral AI Performancebenchmark
80,00 tok/s TG
Prefill 1.200 · TTFT 150 ms
8×NVIDIA GB10 (DGX Spark)AMD Ryzen 9 9950X 16-Core Processor · 128 GB RAMvLLMvllm
39Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
75,70 tok/s TG
Prefill 2.480 · TTFT 6.056 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
40Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
75,59 tok/s TG
Prefill 1.180 · TTFT 12.748 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
41Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,88 tok/s TG
Prefill 1.114 · TTFT 148.957 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
42Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,55 tok/s TG
Prefill 1.941 · TTFT 1.402 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacpp
43Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,45 tok/s TG
Prefill 1.958 · TTFT 1.391 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocket
44Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,38 tok/s TG
Prefill 1.437 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvllm
45Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,20 tok/s TG
Prefill 886 · TTFT 3.072 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
46Codestral-22B-v0.122BIQ4_XSMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
44,74 tok/s TG
Prefill 1.399 · TTFT 1.944 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
47Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
37,75 tok/s TG
Prefill 1.478 · TTFT 1.835 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
48Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,87 tok/s TG
Prefill 1.172 · TTFT 41.913 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
49Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i
33,47 tok/s TG
Prefill 810 · TTFT 3.810 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
50Codestral-22B-v0.122BQ4_K_MMistral AI Performancebenchmark i
33,47 tok/s TG
Prefill 810 · TTFT 3.810 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
51Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,21 tok/s TG
Prefill 1.329 · TTFT 2.051 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
52Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,14 tok/s TG
Prefill 2.208 · TTFT 1.231 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
53Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,94 tok/s TG
Prefill 2.803 · TTFT 969 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
54Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,18 tok/s TG
Prefill 791 · TTFT 3.443 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
55Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
27,75 tok/s TG
Prefill 1.266 · TTFT 2.148 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
56Codestral-22B-v0.122BQ8_0Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
27,69 tok/s TG
Prefill 1.241 · TTFT 2.193 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw
57Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i
27,68 tok/s TG
Prefill 1.289 · TTFT 3.106 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
58Codestral-22B-v0.122BQ4_K_MMistral AI Performancebenchmark i
27,68 tok/s TG
Prefill 1.289 · TTFT 3.106 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
59Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i
25,47 tok/s TG
Prefill 1.170 · TTFT 2.158 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw
60Codestral-22B-v0.122BQ4_K_MMistral AI Performancebenchmark i
25,47 tok/s TG
Prefill 1.170 · TTFT 2.158 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
61Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,64 tok/s TG
Prefill 281 · TTFT 6.718 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli
62Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,18 tok/s TG
Prefill 319 · TTFT 8.542 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cli
63Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,24 tok/s TG
Prefill 263 · TTFT 57.267 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cli
64Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,51 tok/s TG
Prefill 185 · TTFT 14.723 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cli
65Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,98 tok/s TG
Prefill 695 · TTFT 3.957 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclaw