Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Qwen (Alibaba)

Qwen3.5-122B-A10B122B

Benchmark profile and published results.

MoE122B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAll GPUs
Generation564,6 tok/s
Min 0,0Ø 373,1Max 2.491,2
Ueber dem Durchschnitt · 1740 Systeme im Feld
Prefill3.577 tok/s
Min 0Ø 4.541Max 39.029
Unter dem Durchschnitt · 1763 Systeme im Feld
Time to First Token883 ms
Min 20Ø 40.672Max 586.795
Ueber dem Durchschnitt · 1763 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

7335503661830,007971.5942.390Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 564,6 tok/s Generation, 1.935 tok/s Prefill, TTFT 40.743 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5070 Ti - 31,1 tok/s Generation, 94 tok/s Prefill, TTFT 168.001 ms (8 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 24,9 tok/s Generation, 129 tok/s Prefill, TTFT 137.609 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 12,1 tok/s Generation, 71 tok/s Prefill, TTFT 105.658 ms (5 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 6,3 tok/s Generation, 51 tok/s Prefill, TTFT 123.047 ms (3 Laufe)NVIDIA GeForce RTX 50...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 564,6 tok/sNVIDIA GeForce RTX 5070 Ti 31,1 tok/sNVIDIA GeForce RTX 3090 Ti 24,9 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 12,1 tok/sNVIDIA GeForce RTX 5090 6,3 tok/s

CPUby processor

7335503661830,007971.5942.390Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 9965WX 24-Cores - 564,6 tok/s Generation, 1.935 tok/s Prefill, TTFT 40.743 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 31,1 tok/s Generation, 94 tok/s Prefill, TTFT 168.001 ms (8 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 24,9 tok/s Generation, 129 tok/s Prefill, TTFT 137.609 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 9 9950X 16-Core Processor - 12,1 tok/s Generation, 71 tok/s Prefill, TTFT 105.658 ms (5 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 7 5800X3D 8-Core Processor - 6,3 tok/s Generation, 51 tok/s Prefill, TTFT 123.047 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...
AMD Ryzen Threadripper PRO 9965WX 24-Cores 564,6 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 31,1 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 24,9 tok/sAMD Ryzen 9 9950X 16-Core Processor 12,1 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 6,3 tok/s

ENGby engine

621593565536508640667694722Prefill (tok/s)Generation (tok/s)llama.cpp - 564,6 tok/s Generation, 681 tok/s Prefill, TTFT 107.891 ms (28 Laufe)llama.cpp
llama.cpp 564,6 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
564,60 tok/s TG
Prefill 3.577 · TTFT 19.963 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
2Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
557,10 tok/s TG
Prefill 3.042 · TTFT 20.906 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
3Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
308,32 tok/s TG
Prefill 3.271 · TTFT 6.567 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
4Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
307,65 tok/s TG
Prefill 2.768 · TTFT 7.045 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
5Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
104,28 tok/s TG
Prefill 2.209 · TTFT 883 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
6Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,61 tok/s TG
Prefill 2.040 · TTFT 951 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
7Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
61,88 tok/s TG
Prefill 204 · TTFT 212.012 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
8Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
36,17 tok/s TG
Prefill 173 · TTFT 83.272 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
9Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,14 tok/s TG
Prefill 118 · TTFT 246.235 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
10Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,60 tok/s TG
Prefill 119 · TTFT 251.486 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
11Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,87 tok/s TG
Prefill 138 · TTFT 262.075 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
12Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,62 tok/s TG
Prefill 80 · TTFT 331.679 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
13Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
23,19 tok/s TG
Prefill 102 · TTFT 136.966 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
14Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
22,55 tok/s TG
Prefill 103 · TTFT 138.591 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
15Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,05 tok/s TG
Prefill 68 · TTFT 189.332 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
16Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
18,77 tok/s TG
Prefill 126 · TTFT 135.104 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
17Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,73 tok/s TG
Prefill 134 · TTFT 15.087 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ8_0Details →
18Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,11 tok/s TG
Prefill 75 · TTFT 158.430 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0Details →
19Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,28 tok/s TG
Prefill 69 · TTFT 119.823 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0Details →
20Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,23 tok/s TG
Prefill 75 · TTFT 110.236 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0Details →
21Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,99 tok/s TG
Prefill 74 · TTFT 109.505 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0Details →
22Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,20 tok/s TG
Prefill 98 · TTFT 19.630 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
23Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,24 tok/s TG
Prefill 64 · TTFT 30.093 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0Details →
24Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,96 tok/s TG
Prefill 123 · TTFT 15.650 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
25Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,29 tok/s TG
Prefill 52 · TTFT 164.098 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0Details →
26Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,22 tok/s TG
Prefill 52 · TTFT 164.464 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0Details →
27Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,93 tok/s TG
Prefill 64 · TTFT 30.298 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ8_0Details →
28Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,38 tok/s TG
Prefill 48 · TTFT 40.581 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ8_0Details →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.