Mistral AI
Mistral-Small-24B-Instruct-2501
Benchmark profile and published results.
Dense
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation153,1 tok/s
Min 0,0Ø 235,6Max 2.491,2
Unter dem Durchschnitt · 4705 Systeme im Feld
Prefill4.348 tok/s
Min 4Ø 4.785Max 112.346
Unter dem Durchschnitt · 4696 Systeme im Feld
Time to First Token1.390 ms
Min 20Ø 32.984Max 535.235
Ueber dem Durchschnitt · 4703 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Mistral-Small-24B-Instruct-2501Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,12 tok/s TG Prefill 4.348 · TTFT 7.017 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Mistral-Small-24B-Instruct-2501Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,87 tok/s TG Prefill 3.428 · TTFT 3.916 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Mistral-Small-24B-Instruct-2501Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,51 tok/s TG Prefill 1.549 · TTFT 1.390 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.