Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Mistral AI

Mistral-Medium-3.5-128B128B

Benchmark profile and published results.

Dense128B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX PRO 6000 Blackwell Workstation EditionAll GPUs
Generation141,6 tok/s
Min 0,0Ø 518,2Max 2.414,4
Unter dem Durchschnitt · 244 Systeme im Feld
Prefill2.054 tok/s
Min 7Ø 6.972Max 39.029
Unter dem Durchschnitt · 244 Systeme im Feld
Time to First Token2.148 ms
Min 114Ø 27.182Max 354.674
Ueber dem Durchschnitt · 244 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

18413891,845,90,006991.3992.098Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 141,6 tok/s Generation, 1.700 tok/s Prefill, TTFT 31.951 ms (3 Laufe)NVIDIA RTX PRO 6000 B...AMD Radeon AI PRO R9700 - 5,8 tok/s Generation, 56 tok/s Prefill, TTFT 189.596 ms (14 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 5070 Ti - 4,2 tok/s Generation, 131 tok/s Prefill, TTFT 53.481 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 2,8 tok/s Generation, 116 tok/s Prefill, TTFT 59.662 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA GeForce RTX 5090 - 1,9 tok/s Generation, 113 tok/s Prefill, TTFT 72.453 ms (5 Laufe)NVIDIA GeForce RTX 50...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 141,6 tok/sAMD Radeon AI PRO R9700 5,8 tok/sNVIDIA GeForce RTX 5070 Ti 4,2 tok/sNVIDIA GeForce RTX 3090 Ti 2,8 tok/sNVIDIA GeForce RTX 5090 1,9 tok/s

CPUby processor

18413891,845,90,006991.3992.098Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 141,6 tok/s Generation, 1.700 tok/s Prefill, TTFT 31.951 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 5,8 tok/s Generation, 56 tok/s Prefill, TTFT 189.596 ms (14 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 4,2 tok/s Generation, 131 tok/s Prefill, TTFT 53.481 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 2,8 tok/s Generation, 116 tok/s Prefill, TTFT 59.662 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 7 5800X3D 8-Core Processor - 1,9 tok/s Generation, 113 tok/s Prefill, TTFT 72.453 ms (5 Laufe)AMD Ryzen 7 5800X3D 8...
AMD Ryzen 9 9950X 16-Core Processor 141,6 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 5,8 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 4,2 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 2,8 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 1,9 tok/s

ENGby engine

18313791,445,70,0220269319369Prefill (tok/s)Generation (tok/s)llama.cpp - 141,6 tok/s Generation, 254 tok/s Prefill, TTFT 127.639 ms (27 Laufe)llama.cppunbekannt - 5,8 tok/s Generation, 334 tok/s Prefill, TTFT 5.648 ms (1 Lauf)unbekannt
llama.cpp 141,6 tok/sunbekannt 5,8 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
141,57 tok/s TG
Prefill 2.054 · TTFT 71.488 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
2Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,58 tok/s TG
Prefill 1.877 · TTFT 22.218 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
3Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,65 tok/s TG
Prefill 1.170 · TTFT 2.148 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
4Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,77 tok/s TG
Prefill 334 · TTFT 5.648 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawDetails →
5Mistral-Medium-3.5-128B128BMistral AI Performance benchmark
5,77 tok/s TG
Prefill 334 · TTFT 5.648 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawDetails →
6Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,16 tok/s TG
Prefill 149 · TTFT 69.107 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
7Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,14 tok/s TG
Prefill 150 · TTFT 68.889 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
8Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,83 tok/s TG
Prefill 109 · TTFT 85.257 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
9Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,74 tok/s TG
Prefill 145 · TTFT 71.210 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
10Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,93 tok/s TG
Prefill 128 · TTFT 80.836 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
11Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,93 tok/s TG
Prefill 127 · TTFT 81.345 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
12Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,90 tok/s TG
Prefill 128 · TTFT 80.794 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
13Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,86 tok/s TG
Prefill 99 · TTFT 93.863 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
14Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,71 tok/s TG
Prefill 95 · TTFT 22.448 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
15Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,37 tok/s TG
Prefill 10 · TTFT 221.876 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
16Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,35 tok/s TG
Prefill 10 · TTFT 215.803 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
17Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,34 tok/s TG
Prefill 10 · TTFT 222.230 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
18Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,34 tok/s TG
Prefill 10 · TTFT 222.874 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
19Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,33 tok/s TG
Prefill 10 · TTFT 221.753 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
20Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,33 tok/s TG
Prefill 10 · TTFT 222.221 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
21Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,32 tok/s TG
Prefill 10 · TTFT 221.650 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
22Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,32 tok/s TG
Prefill 9 · TTFT 224.878 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
23Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,31 tok/s TG
Prefill 10 · TTFT 216.429 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
24Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,29 tok/s TG
Prefill 10 · TTFT 219.851 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
25Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,28 tok/s TG
Prefill 10 · TTFT 216.526 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
26Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,27 tok/s TG
Prefill 10 · TTFT 216.964 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
27Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,88 tok/s TG
Prefill 94 · TTFT 22.520 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
28Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,56 tok/s TG
Prefill 84 · TTFT 25.429 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.