⚡
Performance-Benchmark
Wie schnell ist das Modell?
Roher Durchsatz auf echter Hardware – wie viele Token ein Modell pro Sekunde erzeugt, wie schnell es den Prompt verarbeitet und wie kurz die Zeit bis zum ersten Token ausfällt. Je höher, desto besser.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | MiniMax-M2.7-AWQ-4bitMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 174,20 tok/s TG Prefill 5.042 · TTFT 47.620 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 2 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,63 tok/s TG Prefill 4.568 · TTFT 13.673 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 3 | MiniMax-M2.7-AWQ-4bitMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,12 tok/s TG Prefill 5.634 · TTFT 12.854 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 4 | MiniMax-M2.5MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,57 tok/s TG Prefill 6.997 · TTFT 5.319 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 5 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,25 tok/s TG Prefill 6.620 · TTFT 5.066 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 6 | MiniMax-M2.5MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,74 tok/s TG Prefill 5.460 · TTFT 2.641 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 7 | MiniMax-M2.5MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 73,44 tok/s TG Prefill 5.550 · TTFT 2.628 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 8 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,75 tok/s TG Prefill 6.946 · TTFT 4.901 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 9 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,45 tok/s TG Prefill 7.167 · TTFT 4.743 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 10 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,46 tok/s TG Prefill 5.268 · TTFT 2.720 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 11 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,61 tok/s TG Prefill 5.448 · TTFT 2.676 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 12 | MiniMax-M2.7-AWQ-4bitMiniMax PerformancebenchmarkPerformancetest Small 1.0 | 34,37 tok/s TG Prefill 503 · TTFT 105 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 13 | MiniMax-M2.5MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,23 tok/s TG Prefill 2.184 · TTFT 1.050 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 14 | MiniMax-M2.5MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,93 tok/s TG Prefill 2.096 · TTFT 1.093 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 15 | MiniMax-M2.7-AWQ-4bitMiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,52 tok/s TG Prefill 2.328 · TTFT 991 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 16 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,35 tok/s TG Prefill 1.986 · TTFT 1.157 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 17 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,25 tok/s TG Prefill 2.437 · TTFT 960 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 18 | MiniMax-M2.7MiniMax PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,01 tok/s TG Prefill 2.068 · TTFT 1.108 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → |