Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Mistral AI

Codestral-22B-v0.122B

Benchmark profile and published results.

Dense22B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA GeForce RTX 5090All GPUs
Generation641,4 tok/s
Min 0,1Ø 429,9Max 2.491,2
Ueber dem Durchschnitt · 218 Systeme im Feld
Prefill6.719 tok/s
Min 7Ø 4.548Max 37.116
Ueber dem Durchschnitt · 218 Systeme im Feld
Time to First Token673 ms
Min 119Ø 65.147Max 328.995
Ueber dem Durchschnitt · 218 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

8296224152070,002.6575.3147.970Prefill (tok/s)Generation (tok/s)NVIDIA GeForce RTX 5090 - 641,4 tok/s Generation, 5.824 tok/s Prefill, TTFT 7.096 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 629,5 tok/s Generation, 5.700 tok/s Prefill, TTFT 6.905 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 559,4 tok/s Generation, 6.460 tok/s Prefill, TTFT 8.205 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 3090 Ti - 325,2 tok/s Generation, 2.975 tok/s Prefill, TTFT 8.460 ms (9 Laufe)NVIDIA GeForce RTX 30...AMD Radeon AI PRO R9700 - 201,5 tok/s Generation, 2.324 tok/s Prefill, TTFT 14.356 ms (15 Laufe)AMD Radeon AI PRO R97...NVIDIA RTX A6000 - 187,0 tok/s Generation, 2.823 tok/s Prefill, TTFT 7.615 ms (18 Laufe)NVIDIA RTX A6000AMD Radeon PRO W7900 Dual Slot - 147,5 tok/s Generation, 1.589 tok/s Prefill, TTFT 10.455 ms (18 Laufe)AMD Radeon PRO W7900 ...AMD Radeon PRO W7800 48GB - 127,7 tok/s Generation, 1.065 tok/s Prefill, TTFT 13.671 ms (6 Laufe)AMD Radeon PRO W7800 ...NVIDIA GB10 - 80,0 tok/s Generation, 1.200 tok/s Prefill, TTFT 150 ms (1 Lauf)NVIDIA GB10NVIDIA GeForce RTX 5070 Ti - 62,9 tok/s Generation, 994 tok/s Prefill, TTFT 64.942 ms (3 Laufe)NVIDIA GeForce RTX 50...Intel Arc Pro B70 - 23,6 tok/s Generation, 300 tok/s Prefill, TTFT 7.630 ms (2 Laufe)Intel Arc Pro B70NVIDIA Tesla P100 PCIe 16GB - 22,2 tok/s Generation, 224 tok/s Prefill, TTFT 35.995 ms (2 Laufe)NVIDIA Tesla P100 PCI...
NVIDIA GeForce RTX 5090 641,4 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 629,5 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 559,4 tok/sNVIDIA GeForce RTX 3090 Ti 325,2 tok/sAMD Radeon AI PRO R9700 201,5 tok/sNVIDIA RTX A6000 187,0 tok/sAMD Radeon PRO W7900 Dual Slot 147,5 tok/sAMD Radeon PRO W7800 48GB 127,7 tok/sNVIDIA GB10 80,0 tok/sNVIDIA GeForce RTX 5070 Ti 62,9 tok/sIntel Arc Pro B70 23,6 tok/sNVIDIA Tesla P100 PCIe 16GB 22,2 tok/s

CPUby processor

8296224152070,002.6545.3097.963Prefill (tok/s)Generation (tok/s)AMD Ryzen 7 5800X3D 8-Core Processor - 641,4 tok/s Generation, 5.824 tok/s Prefill, TTFT 7.096 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 9950X 16-Core Processor - 629,5 tok/s Generation, 4.575 tok/s Prefill, TTFT 5.216 ms (4 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 559,4 tok/s Generation, 6.460 tok/s Prefill, TTFT 8.205 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 325,2 tok/s Generation, 2.907 tok/s Prefill, TTFT 14.580 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 5 5600X 6-Core Processor - 277,9 tok/s Generation, 3.010 tok/s Prefill, TTFT 5.401 ms (6 Laufe)AMD Ryzen 5 5600X 6-C...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 201,5 tok/s Generation, 2.596 tok/s Prefill, TTFT 10.679 ms (33 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 147,5 tok/s Generation, 1.406 tok/s Prefill, TTFT 17.224 ms (27 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 7945HX with Radeon Graphics - 23,6 tok/s Generation, 262 tok/s Prefill, TTFT 21.813 ms (4 Laufe)AMD Ryzen 9 7945HX wi...
AMD Ryzen 7 5800X3D 8-Core Processor 641,4 tok/sAMD Ryzen 9 9950X 16-Core Processor 629,5 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 559,4 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 325,2 tok/sAMD Ryzen 5 5600X 6-Core Processor 277,9 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 201,5 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 147,5 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 23,6 tok/s

ENGby engine

79160942824664,51.7992.2402.6803.120Prefill (tok/s)Generation (tok/s)llama.cpp - 641,4 tok/s Generation, 2.821 tok/s Prefill, TTFT 13.357 ms (79 Laufe)llama.cppvLLM - 277,9 tok/s Generation, 2.613 tok/s Prefill, TTFT 5.336 ms (3 Laufe)vLLMunbekannt - 214,1 tok/s Generation, 2.099 tok/s Prefill, TTFT 3.660 ms (7 Laufe)unbekannt
llama.cpp 641,4 tok/svLLM 277,9 tok/sunbekannt 214,1 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
641,39 tok/s TG
Prefill 6.716 · TTFT 15.676 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
2Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
629,49 tok/s TG
Prefill 6.861 · TTFT 15.390 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
3Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
559,41 tok/s TG
Prefill 9.986 · TTFT 16.664 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
4Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
547,92 tok/s TG
Prefill 8.153 · TTFT 16.930 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
5Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
455,34 tok/s TG
Prefill 5.365 · TTFT 21.481 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
6Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
350,14 tok/s TG
Prefill 6.541 · TTFT 4.589 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
7Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
346,65 tok/s TG
Prefill 6.719 · TTFT 4.938 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
8Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
325,20 tok/s TG
Prefill 3.507 · TTFT 31.980 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
9Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
306,90 tok/s TG
Prefill 10.683 · TTFT 4.930 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
10Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
301,60 tok/s TG
Prefill 6.192 · TTFT 5.565 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
11Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
277,86 tok/s TG
Prefill 3.781 · TTFT 10.183 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmAWQDetails →
12Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,32 tok/s TG
Prefill 5.049 · TTFT 6.208 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
13Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
214,10 tok/s TG
Prefill 4.633 · TTFT 8.462 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacppDetails →
14Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,46 tok/s TG
Prefill 3.877 · TTFT 48.219 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
15Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,80 tok/s TG
Prefill 5.019 · TTFT 46.235 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
16Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,04 tok/s TG
Prefill 4.177 · TTFT 15.498 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
17Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,33 tok/s TG
Prefill 2.857 · TTFT 5.676 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmAWQDetails →
18Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
182,92 tok/s TG
Prefill 4.049 · TTFT 17.792 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
19Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,91 tok/s TG
Prefill 2.336 · TTFT 55.212 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
20Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,88 tok/s TG
Prefill 4.310 · TTFT 15.943 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
21Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
180,91 tok/s TG
Prefill 4.113 · TTFT 19.821 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
22Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,38 tok/s TG
Prefill 3.257 · TTFT 10.368 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
23Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
169,10 tok/s TG
Prefill 2.088 · TTFT 14.428 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
24Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
147,45 tok/s TG
Prefill 1.813 · TTFT 17.552 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawIQ4_XSDetails →
25Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
134,52 tok/s TG
Prefill 1.360 · TTFT 24.430 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
26Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
133,11 tok/s TG
Prefill 1.768 · TTFT 18.406 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
27Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,71 tok/s TG
Prefill 1.369 · TTFT 22.194 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
28Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 1.097 · TTFT 28.208 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
29Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 3.410 · TTFT 4.809 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacppDetails →
30Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
123,66 tok/s TG
Prefill 2.453 · TTFT 6.575 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawIQ4_XSDetails →
31Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
123,33 tok/s TG
Prefill 1.762 · TTFT 18.471 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
32Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
111,50 tok/s TG
Prefill 1.387 · TTFT 11.441 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
33Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
110,27 tok/s TG
Prefill 3.206 · TTFT 4.680 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
34Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,89 tok/s TG
Prefill 3.707 · TTFT 13.889 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
35Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,79 tok/s TG
Prefill 2.159 · TTFT 13.896 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
36Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,69 tok/s TG
Prefill 4.844 · TTFT 12.709 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
37Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,24 tok/s TG
Prefill 3.566 · TTFT 4.706 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
38Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
102,55 tok/s TG
Prefill 2.042 · TTFT 15.214 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
39Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
102,38 tok/s TG
Prefill 1.243 · TTFT 27.006 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
40Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,58 tok/s TG
Prefill 2.196 · TTFT 16.679 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
41Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
96,24 tok/s TG
Prefill 4.036 · TTFT 673 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
42Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,15 tok/s TG
Prefill 3.697 · TTFT 735 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
43Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
92,09 tok/s TG
Prefill 2.810 · TTFT 6.013 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
44Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,16 tok/s TG
Prefill 5.077 · TTFT 543 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
45Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
88,03 tok/s TG
Prefill 4.755 · TTFT 577 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
46Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
86,63 tok/s TG
Prefill 1.851 · TTFT 8.111 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
47Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
84,31 tok/s TG
Prefill 2.202 · TTFT 7.548 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
48Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
81,08 tok/s TG
Prefill 2.880 · TTFT 951 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
49Codestral-22B-v0.122BMistral AI Performance benchmark
80,00 tok/s TG
Prefill 1.200 · TTFT 150 ms
8×NVIDIA GB10 (DGX Spark)AMD Ryzen 9 9950X 16-Core Processor · 128 GB RAMvLLMvllmDetails →
50Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
79,07 tok/s TG
Prefill 3.492 · TTFT 4.570 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
51Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
78,52 tok/s TG
Prefill 1.067 · TTFT 13.620 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
52Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
78,13 tok/s TG
Prefill 3.562 · TTFT 4.610 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
53Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
75,70 tok/s TG
Prefill 2.480 · TTFT 6.056 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
54Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
75,59 tok/s TG
Prefill 1.180 · TTFT 12.748 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
55Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,35 tok/s TG
Prefill 2.444 · TTFT 6.039 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
56Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,88 tok/s TG
Prefill 1.114 · TTFT 148.957 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
57Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
61,43 tok/s TG
Prefill 1.440 · TTFT 10.139 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
58Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
57,55 tok/s TG
Prefill 1.941 · TTFT 1.402 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacppDetails →
59Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
57,45 tok/s TG
Prefill 1.958 · TTFT 1.391 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
60Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
45,38 tok/s TG
Prefill 1.437 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvllmDetails →
61Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
45,20 tok/s TG
Prefill 886 · TTFT 3.072 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
62Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,74 tok/s TG
Prefill 1.399 · TTFT 1.944 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawIQ4_XSDetails →
63Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,54 tok/s TG
Prefill 1.774 · TTFT 1.537 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
64Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,46 tok/s TG
Prefill 1.769 · TTFT 1.542 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
65Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
38,80 tok/s TG
Prefill 1.733 · TTFT 1.574 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
66Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
37,75 tok/s TG
Prefill 1.478 · TTFT 1.835 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
67Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
34,87 tok/s TG
Prefill 1.172 · TTFT 41.913 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
68Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,47 tok/s TG
Prefill 810 · TTFT 3.810 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
69Codestral-22B-v0.122BMistral AI Performance benchmark
33,47 tok/s TG
Prefill 810 · TTFT 3.810 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_MDetails →
70Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,21 tok/s TG
Prefill 1.329 · TTFT 2.051 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
71Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
33,14 tok/s TG
Prefill 2.208 · TTFT 1.231 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
72Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,94 tok/s TG
Prefill 2.803 · TTFT 969 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
73Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,54 tok/s TG
Prefill 806 · TTFT 3.373 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
74Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
28,18 tok/s TG
Prefill 791 · TTFT 3.443 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
75Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,75 tok/s TG
Prefill 1.266 · TTFT 2.148 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
76Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,69 tok/s TG
Prefill 1.241 · TTFT 2.193 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
77Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,68 tok/s TG
Prefill 1.289 · TTFT 3.106 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
78Codestral-22B-v0.122BMistral AI Performance benchmark
27,68 tok/s TG
Prefill 1.289 · TTFT 3.106 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_MDetails →
79Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,55 tok/s TG
Prefill 607 · TTFT 4.493 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
80Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,31 tok/s TG
Prefill 1.876 · TTFT 1.453 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
81Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,30 tok/s TG
Prefill 1.859 · TTFT 1.467 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
82Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,47 tok/s TG
Prefill 1.170 · TTFT 2.158 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
83Codestral-22B-v0.122BMistral AI Performance benchmark
25,47 tok/s TG
Prefill 1.170 · TTFT 2.158 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_MDetails →
84Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,95 tok/s TG
Prefill 1.821 · TTFT 1.498 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
85Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,64 tok/s TG
Prefill 281 · TTFT 6.718 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
86Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,18 tok/s TG
Prefill 319 · TTFT 8.542 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
87Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
22,24 tok/s TG
Prefill 263 · TTFT 57.267 ms
5×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
88Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
13,51 tok/s TG
Prefill 185 · TTFT 14.723 ms
1×NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
89Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,98 tok/s TG
Prefill 695 · TTFT 3.957 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.