Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Mistral AI

Mistral-Small-4-119B-2603119B

Benchmark profile and published results.

Dense119B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX PRO 6000 Blackwell Workstation EditionAll GPUs
Generation959,6 tok/s
Min 0,0Ø 248,3Max 2.491,2
Ueber dem Durchschnitt · 3969 Systeme im Feld
Prefill8.078 tok/s
Min 4Ø 4.741Max 55.260
Ueber dem Durchschnitt · 3969 Systeme im Feld
Time to First Token667 ms
Min 20Ø 33.962Max 535.235
Ueber dem Durchschnitt · 3967 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

1.2439326223110,002.6185.2367.854Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 959,6 tok/s Generation, 6.363 tok/s Prefill, TTFT 5.653 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5070 Ti - 62,3 tok/s Generation, 213 tok/s Prefill, TTFT 120.533 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 58,5 tok/s Generation, 258 tok/s Prefill, TTFT 109.712 ms (3 Laufe)NVIDIA GeForce RTX 30...AMD Radeon AI PRO R9700 - 58,5 tok/s Generation, 510 tok/s Prefill, TTFT 107.602 ms (11 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 5090 - 21,7 tok/s Generation, 198 tok/s Prefill, TTFT 150.089 ms (6 Laufe)NVIDIA GeForce RTX 50...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 959,6 tok/sNVIDIA GeForce RTX 5070 Ti 62,3 tok/sNVIDIA GeForce RTX 3090 Ti 58,5 tok/sAMD Radeon AI PRO R9700 58,5 tok/sNVIDIA GeForce RTX 5090 21,7 tok/s

CPUby processor

1.2439326223110,002.6185.2367.854Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 959,6 tok/s Generation, 6.363 tok/s Prefill, TTFT 5.653 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 62,3 tok/s Generation, 213 tok/s Prefill, TTFT 120.533 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 58,5 tok/s Generation, 258 tok/s Prefill, TTFT 109.712 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 58,5 tok/s Generation, 510 tok/s Prefill, TTFT 107.602 ms (11 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 7 5800X3D 8-Core Processor - 21,7 tok/s Generation, 198 tok/s Prefill, TTFT 150.089 ms (6 Laufe)AMD Ryzen 7 5800X3D 8...
AMD Ryzen 9 9950X 16-Core Processor 959,6 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 62,3 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 58,5 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 58,5 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 21,7 tok/s

ENGby engine

1.2469356233120,008291.6582.487Prefill (tok/s)Generation (tok/s)llama.cpp - 959,6 tok/s Generation, 1.038 tok/s Prefill, TTFT 116.027 ms (24 Laufe)llama.cppunbekannt - 58,5 tok/s Generation, 2.053 tok/s Prefill, TTFT 1.304 ms (1 Lauf)unbekanntvLLM - 5,8 tok/s Generation, 325 tok/s Prefill, TTFT 5.900 ms (1 Lauf)vLLM
llama.cpp 959,6 tok/sunbekannt 58,5 tok/svLLM 5,8 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
959,57 tok/s TG
Prefill 8.078 · TTFT 11.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
2Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
544,25 tok/s TG
Prefill 6.975 · TTFT 4.321 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
3Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,78 tok/s TG
Prefill 4.035 · TTFT 667 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
4Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,26 tok/s TG
Prefill 284 · TTFT 238.161 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
5Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
58,52 tok/s TG
Prefill 351 · TTFT 222.335 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
6Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
58,52 tok/s TG
Prefill 2.053 · TTFT 1.304 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
7Mistral-Small-4-119B-2603119BMistral AI Performance benchmark
58,52 tok/s TG
Prefill 2.053 · TTFT 1.304 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_MDetails →
8Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,18 tok/s TG
Prefill 234 · TTFT 253.628 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
9Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,16 tok/s TG
Prefill 233 · TTFT 253.701 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
10Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,98 tok/s TG
Prefill 229 · TTFT 232.955 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
11Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
39,36 tok/s TG
Prefill 221 · TTFT 103.372 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
12Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
35,54 tok/s TG
Prefill 233 · TTFT 92.559 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
13Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
35,27 tok/s TG
Prefill 151 · TTFT 124.312 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
14Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
35,14 tok/s TG
Prefill 155 · TTFT 122.915 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
15Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
34,65 tok/s TG
Prefill 166 · TTFT 119.631 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
16Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,66 tok/s TG
Prefill 203 · TTFT 281.308 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_MDetails →
17Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,61 tok/s TG
Prefill 202 · TTFT 281.424 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_MDetails →
18Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,00 tok/s TG
Prefill 149 · TTFT 156.524 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_MDetails →
19Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
18,68 tok/s TG
Prefill 190 · TTFT 152.266 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_MDetails →
20Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
16,70 tok/s TG
Prefill 135 · TTFT 20.068 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
21Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,23 tok/s TG
Prefill 111 · TTFT 24.534 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
22Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,20 tok/s TG
Prefill 112 · TTFT 24.250 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
23Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,13 tok/s TG
Prefill 108 · TTFT 25.093 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
24Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,47 tok/s TG
Prefill 190 · TTFT 14.242 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_MDetails →
25Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,71 tok/s TG
Prefill 117 · TTFT 23.115 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_MDetails →
26Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,77 tok/s TG
Prefill 325 · TTFT 5.900 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cliAWQDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.