Mistral AI
Mistral-Small-3.1-24B-Instruct-250324B
Benchmark profile and published results.
Dense24B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation214,9 tok/s
Min 5,0Ø 249,4Max 1.568,0
Unter dem Durchschnitt · 1028 Systeme im Feld
Prefill9.684 tok/s
Min 94Ø 8.413Max 55.260
Ueber dem Durchschnitt · 1028 Systeme im Feld
Time to First Token655 ms
Min 117Ø 5.305Max 124.920
Ueber dem Durchschnitt · 1028 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
GPUby graphics card
NVIDIA RTX A6000 214,9 tok/sAMD Radeon RX 7900 XTX 170,1 tok/sAMD Radeon PRO W7900 Dual Slot 150,4 tok/sAMD Radeon PRO W7800 48GB 141,9 tok/sAMD Radeon AI PRO R9700 133,1 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 88,3 tok/sAMD Radeon 8060S Graphics 31,3 tok/sNVIDIA Tesla P100 PCIe 16GB 23,8 tok/s
CPUby processor
AMD Ryzen Threadripper PRO 7955WX 16-Cores 214,9 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 170,1 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 151,5 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 150,4 tok/sAMD Ryzen 3 3100 4-Core Processor 133,1 tok/sAMD Ryzen 9 9950X 16-Core Processor 88,3 tok/sAMD RYZEN AI MAX+ 395 w/ Radeon 8060S 31,3 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 23,8 tok/s
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 214,87 tok/s TG Prefill 3.898 · TTFT 18.332 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,54 tok/s TG Prefill 4.003 · TTFT 15.863 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 3 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,73 tok/s TG Prefill 4.210 · TTFT 15.755 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 4 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 202,30 tok/s TG Prefill 4.589 · TTFT 17.666 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 170,07 tok/s TG Prefill 4.885 · TTFT 6.913 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,85 tok/s TG Prefill 3.304 · TTFT 8.318 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 7 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,50 tok/s TG Prefill 3.183 · TTFT 10.690 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 8 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 150,36 tok/s TG Prefill 1.880 · TTFT 17.241 ms | 10× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 9 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 141,93 tok/s TG Prefill 1.385 · TTFT 19.489 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 10 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,94 tok/s TG Prefill 4.212 · TTFT 8.113 ms | 10× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 11 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 133,08 tok/s TG Prefill 3.434 · TTFT 9.975 ms | 10× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 12 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,99 tok/s TG Prefill 2.572 · TTFT 12.677 ms | 10× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 13 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,95 tok/s TG Prefill 3.286 · TTFT 8.287 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 14 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 119,65 tok/s TG Prefill 1.469 · TTFT 9.597 ms | 5× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 15 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,54 tok/s TG Prefill 1.812 · TTFT 19.077 ms | 10× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 16 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 110,65 tok/s TG Prefill 3.146 · TTFT 3.814 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 110,55 tok/s TG Prefill 3.087 · TTFT 3.813 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 18 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,92 tok/s TG Prefill 3.632 · TTFT 3.888 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,29 tok/s TG Prefill 9.684 · TTFT 3.553 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 20 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,04 tok/s TG Prefill 2.389 · TTFT 6.000 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 21 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,26 tok/s TG Prefill 9.468 · TTFT 3.791 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 22 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,61 tok/s TG Prefill 2.657 · TTFT 4.592 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 23 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,49 tok/s TG Prefill 2.131 · TTFT 6.932 ms | 5× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 24 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,30 tok/s TG Prefill 4.368 · TTFT 9.029 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 25 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,25 tok/s TG Prefill 12.250 · TTFT 2.840 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 26 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,95 tok/s TG Prefill 3.318 · TTFT 3.548 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 27 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,86 tok/s TG Prefill 3.277 · TTFT 3.594 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 28 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,21 tok/s TG Prefill 1.020 · TTFT 11.554 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 29 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 78,06 tok/s TG Prefill 2.578 · TTFT 5.626 ms | 5× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 30 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,59 tok/s TG Prefill 2.675 · TTFT 5.037 ms | 5× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,55 tok/s TG Prefill 2.405 · TTFT 4.874 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 32 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,55 tok/s TG Prefill 1.346 · TTFT 10.549 ms | 5× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 33 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,37 tok/s TG Prefill 7.945 · TTFT 1.984 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 34 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,15 tok/s TG Prefill 7.311 · TTFT 2.155 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 35 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,09 tok/s TG Prefill 883 · TTFT 2.603 ms | 1× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,24 tok/s TG Prefill 3.416 · TTFT 5.086 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 37 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,72 tok/s TG Prefill 5.554 · TTFT 6.192 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 38 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,65 tok/s TG Prefill 1.245 · TTFT 1.845 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,80 tok/s TG Prefill 1.823 · TTFT 1.259 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 8.091 · TTFT 1.621 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 41 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,40 tok/s TG Prefill 1.773 · TTFT 1.295 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 42 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,39 tok/s TG Prefill 1.817 · TTFT 1.263 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,97 tok/s TG Prefill 1.640 · TTFT 1.400 ms | 1× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 44 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,44 tok/s TG Prefill 1.790 · TTFT 1.199 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 45 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,50 tok/s TG Prefill 1.317 · TTFT 1.755 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 46 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,10 tok/s TG Prefill 1.265 · TTFT 1.767 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 47 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 33,10 tok/s TG Prefill 1.265 · TTFT 1.767 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 48 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,98 tok/s TG Prefill 2.592 · TTFT 790 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 49 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 32,98 tok/s TG Prefill 2.592 · TTFT 790 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 50 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,27 tok/s TG Prefill 1.563 · TTFT 1.699 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 51 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 31,27 tok/s TG Prefill 1.563 · TTFT 1.699 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 52 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,25 tok/s TG Prefill 939 · TTFT 14.944 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 53 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,97 tok/s TG Prefill 1.536 · TTFT 2.083 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 54 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 29,97 tok/s TG Prefill 1.536 · TTFT 2.083 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 55 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,63 tok/s TG Prefill 582 · TTFT 3.807 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 56 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,14 tok/s TG Prefill 784 · TTFT 2.931 ms | 1× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 57 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,79 tok/s TG Prefill 1.195 · TTFT 1.920 ms | 1× | 2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 58 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,76 tok/s TG Prefill 1.407 · TTFT 1.945 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 59 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 28,76 tok/s TG Prefill 1.407 · TTFT 1.945 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawQ4_K_M | Details → | |
| 60 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,04 tok/s TG Prefill 604 · TTFT 3.801 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 61 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 27,18 tok/s TG Prefill 1.937 · TTFT 1.185 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 62 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 27,16 tok/s TG Prefill 1.921 · TTFT 1.196 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 63 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,03 tok/s TG Prefill 1.200 · TTFT 27.883 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 64 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,14 tok/s TG Prefill 4.232 · TTFT 3.475 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 65 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,84 tok/s TG Prefill 277 · TTFT 48.247 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 66 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,78 tok/s TG Prefill 1.882 · TTFT 1.220 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 67 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,00 tok/s TG Prefill 9.072 · TTFT 245 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 68 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 15,00 tok/s TG Prefill 9.072 · TTFT 245 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 69 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,57 tok/s TG Prefill 159 · TTFT 13.491 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 70 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,64 tok/s TG Prefill 3.337 · TTFT 704 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 71 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,63 tok/s TG Prefill 3.580 · TTFT 655 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 72 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,00 tok/s TG Prefill 1.583 · TTFT 1.597 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 73 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,99 tok/s TG Prefill 4.687 · TTFT 495 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 74 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,98 tok/s TG Prefill 4.076 · TTFT 559 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 75 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 6,98 tok/s TG Prefill 4.076 · TTFT 559 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 76 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,13 tok/s TG Prefill 2.944 · TTFT 763 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 77 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmark | 6,13 tok/s TG Prefill 2.944 · TTFT 763 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 78 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,01 tok/s TG Prefill 2.028 · TTFT 1.155 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.