Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
MiniMax

MiniMax-M2.7-AWQ-4bit230B

Benchmark profile and published results.

MoE230B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA DGX SPARK (GB10)All GPUs
Generation108,6 tok/s
Min 11,4Ø 143,9Max 903,3
Unter dem Durchschnitt · 112 Systeme im Feld
Prefill7.167 tok/s
Min 301Ø 3.173Max 7.470
Ueber dem Durchschnitt · 112 Systeme im Feld
Time to First Token105 ms
Min 105Ø 10.699Max 131.641
Spitzenwert im Feld · 112 Systeme im Feld
Harness-Quote61,1 %
Min 28,8Ø 54,3Max 70,7
Ueber dem Durchschnitt · 5 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

14110570,335,20,001.7693.5395.308Prefill (tok/s)Generation (tok/s)NVIDIA DGX SPARK (GB10) - 108,6 tok/s Generation, 4.301 tok/s Prefill, TTFT 3.711 ms (10 Laufe)NVIDIA DGX SPARK (GB1...AMD Radeon AI PRO R9700 - 3,0 tok/s Generation, 139 tok/s Prefill, TTFT 15.493 ms (2 Laufe)AMD Radeon AI PRO R97...
NVIDIA DGX SPARK (GB10) 108,6 tok/sAMD Radeon AI PRO R9700 3,0 tok/s

CPUby processor

14110570,335,20,001.7693.5395.308Prefill (tok/s)Generation (tok/s)NVIDIA Grace - 108,6 tok/s Generation, 4.301 tok/s Prefill, TTFT 3.711 ms (10 Laufe)NVIDIA GraceAMD Ryzen Threadripper PRO 7955WX 16-Cores - 3,0 tok/s Generation, 139 tok/s Prefill, TTFT 15.493 ms (2 Laufe)AMD Ryzen Threadrippe...
NVIDIA Grace 108,6 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 3,0 tok/s

ENGby engine

14110570,335,20,001.7693.5395.308Prefill (tok/s)Generation (tok/s)vLLM - 108,6 tok/s Generation, 4.301 tok/s Prefill, TTFT 3.711 ms (10 Laufe)vLLMllama.cpp - 3,0 tok/s Generation, 139 tok/s Prefill, TTFT 15.493 ms (1 Lauf)llama.cppunbekannt - 3,0 tok/s Generation, 139 tok/s Prefill, TTFT 15.493 ms (1 Lauf)unbekannt
vLLM 108,6 tok/sllama.cpp 3,0 tok/sunbekannt 3,0 tok/s
Throughput & latency

Performance benchmark

Metric:
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
108,63 tok/s TG
Prefill 4.568 · TTFT 13.673 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
2MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,25 tok/s TG
Prefill 6.620 · TTFT 5.066 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
3MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
66,75 tok/s TG
Prefill 6.946 · TTFT 4.901 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
4MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
64,45 tok/s TG
Prefill 7.167 · TTFT 4.743 ms
10×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
5MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
52,46 tok/s TG
Prefill 5.268 · TTFT 2.720 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
6MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
51,61 tok/s TG
Prefill 5.448 · TTFT 2.676 ms
5×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
7MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkPerformancetest Small 1.0
34,37 tok/s TG
Prefill 503 · TTFT 105 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
8MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,35 tok/s TG
Prefill 1.986 · TTFT 1.157 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
9MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,25 tok/s TG
Prefill 2.437 · TTFT 960 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
10MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,01 tok/s TG
Prefill 2.068 · TTFT 1.108 ms
1×NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
11MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,00 tok/s TG
Prefill 139 · TTFT 15.493 ms
1×3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
12MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmark
3,00 tok/s TG
Prefill 139 · TTFT 15.493 ms
1×3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_MDetails →
Agent & chat rating

Harness benchmark

Metric:
#Model / MakerMetricsGPU / CPU / RAMRuntime
1MiniMax-M2.7-AWQ-4bit230BMiniMax Harness benchmarkTool-Parcours Dossier 40 V1.0
3.641 Pkt
61,1% · 40/40 Aufg. · 8.209,0 s
NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →