Mistral AI
Mistral-Small-3.1-24B-Instruct-250324B
Benchmarkprofil und veröffentlichte Ergebnisse.
Dense24B
Einordnung im Feld
Bestwerte im Vergleich
Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.
Generation214,9 tok/s
Min 5,0Ø 249,4Max 1.568,0
Unter dem Durchschnitt · 1028 Systeme im Feld
Prefill9.684 tok/s
Min 94Ø 8.413Max 55.260
Ueber dem Durchschnitt · 1028 Systeme im Feld
Time to First Token655 ms
Min 117Ø 5.305Max 124.920
Ueber dem Durchschnitt · 1028 Systeme im Feld
Performanceprofil
Durchsatz nach Hardware & Engine
Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.
GPUnach Grafikkarte
NVIDIA RTX A6000 214,9 tok/sAMD Radeon RX 7900 XTX 170,1 tok/sAMD Radeon PRO W7900 Dual Slot 150,4 tok/sAMD Radeon PRO W7800 48GB 141,9 tok/sAMD Radeon AI PRO R9700 133,1 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 88,3 tok/sAMD Radeon 8060S Graphics 31,3 tok/sNVIDIA Tesla P100 PCIe 16GB 23,8 tok/s
CPUnach Prozessor
AMD Ryzen Threadripper PRO 7955WX 16-Cores 214,9 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 170,1 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 151,5 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 150,4 tok/sAMD Ryzen 3 3100 4-Core Processor 133,1 tok/sAMD Ryzen 9 9950X 16-Core Processor 88,3 tok/sAMD RYZEN AI MAX+ 395 w/ Radeon 8060S 31,3 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 23,8 tok/s
Durchsatz & Latenz
Performancebenchmark
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 214,87 tok/s TG Prefill 3.898 · TTFT 18.332 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,54 tok/s TG Prefill 4.003 · TTFT 15.863 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 3 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,73 tok/s TG Prefill 4.210 · TTFT 15.755 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 4 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 202,30 tok/s TG Prefill 4.589 · TTFT 17.666 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 170,07 tok/s TG Prefill 4.885 · TTFT 6.913 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,85 tok/s TG Prefill 3.304 · TTFT 8.318 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 7 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,50 tok/s TG Prefill 3.183 · TTFT 10.690 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 8 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 150,36 tok/s TG Prefill 1.880 · TTFT 17.241 ms | 10× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 9 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 141,93 tok/s TG Prefill 1.385 · TTFT 19.489 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 10 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,94 tok/s TG Prefill 4.212 · TTFT 8.113 ms | 10× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 11 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 133,08 tok/s TG Prefill 3.434 · TTFT 9.975 ms | 10× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 12 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,99 tok/s TG Prefill 2.572 · TTFT 12.677 ms | 10× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 13 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,95 tok/s TG Prefill 3.286 · TTFT 8.287 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 14 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,65 tok/s TG Prefill 1.469 · TTFT 9.597 ms | 5× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 15 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,54 tok/s TG Prefill 1.812 · TTFT 19.077 ms | 10× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 16 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 110,65 tok/s TG Prefill 3.146 · TTFT 3.814 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 110,55 tok/s TG Prefill 3.087 · TTFT 3.813 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 18 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,92 tok/s TG Prefill 3.632 · TTFT 3.888 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,29 tok/s TG Prefill 9.684 · TTFT 3.553 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 20 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,04 tok/s TG Prefill 2.389 · TTFT 6.000 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 21 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,26 tok/s TG Prefill 9.468 · TTFT 3.791 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 22 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,61 tok/s TG Prefill 2.657 · TTFT 4.592 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 23 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,49 tok/s TG Prefill 2.131 · TTFT 6.932 ms | 5× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 24 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,30 tok/s TG Prefill 4.368 · TTFT 9.029 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 25 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,25 tok/s TG Prefill 12.250 · TTFT 2.840 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 26 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,95 tok/s TG Prefill 3.318 · TTFT 3.548 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 27 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,86 tok/s TG Prefill 3.277 · TTFT 3.594 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 28 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,21 tok/s TG Prefill 1.020 · TTFT 11.554 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 29 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 78,06 tok/s TG Prefill 2.578 · TTFT 5.626 ms | 5× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 30 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,59 tok/s TG Prefill 2.675 · TTFT 5.037 ms | 5× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,55 tok/s TG Prefill 2.405 · TTFT 4.874 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 32 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,55 tok/s TG Prefill 1.346 · TTFT 10.549 ms | 5× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 33 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,37 tok/s TG Prefill 7.945 · TTFT 1.984 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 34 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,15 tok/s TG Prefill 7.311 · TTFT 2.155 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 35 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,09 tok/s TG Prefill 883 · TTFT 2.603 ms | 1× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,24 tok/s TG Prefill 3.416 · TTFT 5.086 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 37 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,72 tok/s TG Prefill 5.554 · TTFT 6.192 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 38 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,65 tok/s TG Prefill 1.245 · TTFT 1.845 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,80 tok/s TG Prefill 1.823 · TTFT 1.259 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 8.091 · TTFT 1.621 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 41 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,40 tok/s TG Prefill 1.773 · TTFT 1.295 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 42 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,39 tok/s TG Prefill 1.817 · TTFT 1.263 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,97 tok/s TG Prefill 1.640 · TTFT 1.400 ms | 1× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 44 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,44 tok/s TG Prefill 1.790 · TTFT 1.199 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 45 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,50 tok/s TG Prefill 1.317 · TTFT 1.755 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 46 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,10 tok/s TG Prefill 1.265 · TTFT 1.767 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 47 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 33,10 tok/s TG Prefill 1.265 · TTFT 1.767 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 48 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,98 tok/s TG Prefill 2.592 · TTFT 790 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 49 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 32,98 tok/s TG Prefill 2.592 · TTFT 790 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 50 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,27 tok/s TG Prefill 1.563 · TTFT 1.699 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 51 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 31,27 tok/s TG Prefill 1.563 · TTFT 1.699 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 52 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,25 tok/s TG Prefill 939 · TTFT 14.944 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 53 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,97 tok/s TG Prefill 1.536 · TTFT 2.083 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 54 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 29,97 tok/s TG Prefill 1.536 · TTFT 2.083 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 55 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,63 tok/s TG Prefill 582 · TTFT 3.807 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 56 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,14 tok/s TG Prefill 784 · TTFT 2.931 ms | 1× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 57 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,79 tok/s TG Prefill 1.195 · TTFT 1.920 ms | 1× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 58 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,76 tok/s TG Prefill 1.407 · TTFT 1.945 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 59 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 28,76 tok/s TG Prefill 1.407 · TTFT 1.945 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 60 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,04 tok/s TG Prefill 604 · TTFT 3.801 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 61 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 27,18 tok/s TG Prefill 1.937 · TTFT 1.185 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 62 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 27,16 tok/s TG Prefill 1.921 · TTFT 1.196 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 63 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,03 tok/s TG Prefill 1.200 · TTFT 27.883 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 64 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,14 tok/s TG Prefill 4.232 · TTFT 3.475 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 65 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,84 tok/s TG Prefill 277 · TTFT 48.247 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 66 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,78 tok/s TG Prefill 1.882 · TTFT 1.220 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 67 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,00 tok/s TG Prefill 9.072 · TTFT 245 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 68 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 15,00 tok/s TG Prefill 9.072 · TTFT 245 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 69 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,57 tok/s TG Prefill 159 · TTFT 13.491 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 70 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,64 tok/s TG Prefill 3.337 · TTFT 704 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 71 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,63 tok/s TG Prefill 3.580 · TTFT 655 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 72 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,00 tok/s TG Prefill 1.583 · TTFT 1.597 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 73 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,99 tok/s TG Prefill 4.687 · TTFT 495 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 74 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,98 tok/s TG Prefill 4.076 · TTFT 559 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 75 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 6,98 tok/s TG Prefill 4.076 · TTFT 559 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 76 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,13 tok/s TG Prefill 2.944 · TTFT 763 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 77 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performancebenchmark | 6,13 tok/s TG Prefill 2.944 · TTFT 763 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 78 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,01 tok/s TG Prefill 2.028 · TTFT 1.155 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → |
Agent- & Chat-Bewertung
Harnessbenchmark
Noch keine Harnessbenchmarks fuer dieses Modell.