Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
MiniMax

minimax-m2-awq230B

Benchmark profile and published results.

MoE230B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAll GPUs
Generation547,9 tok/s
Min 9,4Ø 555,4Max 2.143,6
Unter dem Durchschnitt · 512 Systeme im Feld
Prefill4.819 tok/s
Min 28Ø 6.219Max 21.843
Unter dem Durchschnitt · 512 Systeme im Feld
Time to First Token972 ms
Min 59Ø 9.221Max 168.314
Ueber dem Durchschnitt · 512 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

7115333551780,001.6053.2104.815Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 547,9 tok/s Generation, 3.894 tok/s Prefill, TTFT 9.312 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5070 Ti - 17,0 tok/s Generation, 100 tok/s Prefill, TTFT 162.821 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 8,7 tok/s Generation, 80 tok/s Prefill, TTFT 91.651 ms (3 Laufe)NVIDIA RTX PRO 6000 B...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 547,9 tok/sNVIDIA GeForce RTX 5070 Ti 17,0 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 8,7 tok/s

CPUby processor

7115333551780,001.6053.2104.815Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 9965WX 24-Cores - 547,9 tok/s Generation, 3.894 tok/s Prefill, TTFT 9.312 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 17,0 tok/s Generation, 100 tok/s Prefill, TTFT 162.821 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 9950X 16-Core Processor - 8,7 tok/s Generation, 80 tok/s Prefill, TTFT 91.651 ms (3 Laufe)AMD Ryzen 9 9950X 16-...
AMD Ryzen Threadripper PRO 9965WX 24-Cores 547,9 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 17,0 tok/sAMD Ryzen 9 9950X 16-Core Processor 8,7 tok/s

ENGby engine

6035755485204931.2761.3311.3851.439Prefill (tok/s)Generation (tok/s)llama.cpp - 547,9 tok/s Generation, 1.358 tok/s Prefill, TTFT 87.928 ms (9 Laufe)llama.cpp
llama.cpp 547,9 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
547,88 tok/s TG
Prefill 4.819 · TTFT 20.318 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
2minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
310,36 tok/s TG
Prefill 4.459 · TTFT 6.645 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
3minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
112,64 tok/s TG
Prefill 2.405 · TTFT 972 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
4minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
16,95 tok/s TG
Prefill 113 · TTFT 190.982 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
5minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
13,28 tok/s TG
Prefill 120 · TTFT 263.391 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
6minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
10,53 tok/s TG
Prefill 67 · TTFT 34.091 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
7minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,67 tok/s TG
Prefill 86 · TTFT 121.821 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
8minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,51 tok/s TG
Prefill 98 · TTFT 111.122 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
9minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,22 tok/s TG
Prefill 55 · TTFT 42.011 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.