Qwen (Alibaba)
Qwen3.8-Flash-Next180B
Benchmark profile and published results.
MoE180B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation1.564,6 tok/s
Min 7,0Ø 556,8Max 2.143,6
Ueber dem Durchschnitt · 542 Systeme im Feld
Prefill2.655 tok/s
Min 28Ø 6.400Max 43.711
Unter dem Durchschnitt · 533 Systeme im Feld
Time to First Token1.010 ms
Min 59Ø 9.098Max 168.314
Ueber dem Durchschnitt · 542 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
GPUby graphics card
CPUby processor
AMD Ryzen 9 7945HX with Radeon Graphics 1.564,6 tok/sAMD Ryzen Threadripper PRO 3945WX 12-Cores 1.171,8 tok/sAMD Ryzen 5 5600X 6-Core Processor 1.132,7 tok/sNVIDIA Grace 492,8 tok/sAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics 196,2 tok/sAMD EPYC 7203P 8-Core Processor 79,2 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 63,2 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 18,7 tok/s
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.564,61 tok/s TG Prefill 2.600 · TTFT 34.894 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 2 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.555,31 tok/s TG Prefill 2.655 · TTFT 34.751 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 3 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.171,75 tok/s TG Prefill 2.132 · TTFT 45.396 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-Cores | strataIQ2_XS | Details → | |
| 4 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.132,67 tok/s TG Prefill 1.930 · TTFT 47.978 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 5 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 804,23 tok/s TG Prefill 2.435 · TTFT 15.796 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 6 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 783,55 tok/s TG Prefill 2.459 · TTFT 15.907 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 7 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 638,58 tok/s TG Prefill 306 · TTFT 145.278 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 8 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 589,46 tok/s TG Prefill 2.120 · TTFT 21.049 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-Cores | strataIQ2_XS | Details → | |
| 9 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 572,23 tok/s TG Prefill 1.826 · TTFT 21.491 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 10 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 492,83 tok/s TG Prefill 1.231 · TTFT 103.873 ms | 10× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 11 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 420,20 tok/s TG Prefill 656 · TTFT 131.641 ms | 10× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 12 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 319,40 tok/s TG Prefill 254 · TTFT 73.516 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 13 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 246,45 tok/s TG Prefill 1.171 · TTFT 47.068 ms | 5× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 14 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 242,41 tok/s TG Prefill 4.265 · TTFT 17.947 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-Cores | strataIQ2_XS | Details → | |
| 15 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,19 tok/s TG Prefill 592 · TTFT 60.940 ms | 5× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 16 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 196,16 tok/s TG Prefill 860 · TTFT 118.321 ms | 10× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 17 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,58 tok/s TG Prefill 1.951 · TTFT 1.010 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 18 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,06 tok/s TG Prefill 1.772 · TTFT 1.128 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 19 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,55 tok/s TG Prefill 3.687 · TTFT 3.821 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-Cores | strataIQ2_XS | Details → | |
| 20 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 137,92 tok/s TG Prefill 818 · TTFT 45.184 ms | 5× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 21 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 125,24 tok/s TG Prefill 1.458 · TTFT 1.399 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-Cores | strataIQ2_XS | Details → | |
| 22 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,39 tok/s TG Prefill 3.269 · TTFT 6.004 ms | 10× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 23 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,39 tok/s TG Prefill 1.389 · TTFT 1.421 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 24 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 115,48 tok/s TG Prefill 1.754 · TTFT 1.124 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-Cores | strataIQ2_XS | Details → | |
| 25 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,87 tok/s TG Prefill 1.120 · TTFT 20.453 ms | 10× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawIQ3_XXS | Details → | |
| 26 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,45 tok/s TG Prefill 2.547 · TTFT 3.826 ms | 5× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 27 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,19 tok/s TG Prefill 670 · TTFT 33.965 ms | 10× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 28 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 73,30 tok/s TG Prefill 487 · TTFT 20.813 ms | 5× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 29 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,73 tok/s TG Prefill 560 · TTFT 40.628 ms | 10× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 30 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,46 tok/s TG Prefill 568 · TTFT 39.939 ms | 10× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAM | llama.cppgodclaw | Details → | |
| 31 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,02 tok/s TG Prefill 838 · TTFT 12.155 ms | 5× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawIQ3_XXS | Details → | |
| 32 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,23 tok/s TG Prefill 904 · TTFT 15.542 ms | 5× | NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | strataIQ3_S | Details → | |
| 33 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,09 tok/s TG Prefill 1.023 · TTFT 43.363 ms | 10× | NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | strataIQ3_S | Details → | |
| 34 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,89 tok/s TG Prefill 409 · TTFT 24.788 ms | 5× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 35 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,28 tok/s TG Prefill 483 · TTFT 4.084 ms | 1× | NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | strataIQ3_S | Details → | |
| 36 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,02 tok/s TG Prefill 1.132 · TTFT 12.062 ms | 5× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 37 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 55,85 tok/s TG Prefill 415 · TTFT 24.406 ms | 5× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAM | llama.cppgodclaw | Details → | |
| 38 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,11 tok/s TG Prefill 510 · TTFT 3.869 ms | 1× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 39 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,53 tok/s TG Prefill 106 · TTFT 20.413 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 40 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,88 tok/s TG Prefill 909 · TTFT 2.194 ms | 1× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 41 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,60 tok/s TG Prefill 468 · TTFT 4.250 ms | 1× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 42 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,83 tok/s TG Prefill 301 · TTFT 8.495 ms | 1× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 43 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,84 tok/s TG Prefill 258 · TTFT 10.963 ms | 1× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 44 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,99 tok/s TG Prefill 221 · TTFT 12.961 ms | 1× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 45 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,38 tok/s TG Prefill 714 · TTFT 2.760 ms | 1× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawIQ3_XXS | Details → | |
| 46 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,58 tok/s TG Prefill 220 · TTFT 12.963 ms | 1× | 2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAM | llama.cppgodclaw | Details → | |
| 47 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,44 tok/s TG Prefill 249 · TTFT 90.371 ms | 10× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 48 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,77 tok/s TG Prefill 160 · TTFT 63.351 ms | 5× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 49 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,97 tok/s TG Prefill 204 · TTFT 110.341 ms | 10× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_XL | Details → | |
| 50 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,26 tok/s TG Prefill 1.798 · TTFT 1.074 ms | 1× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 51 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,67 tok/s TG Prefill 124 · TTFT 18.211 ms | 1× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 52 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,36 tok/s TG Prefill 158 · TTFT 64.302 ms | 5× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_XL | Details → | |
| 53 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,69 tok/s TG Prefill 245 · TTFT 92.959 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 54 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,75 tok/s TG Prefill 182 · TTFT 55.630 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 55 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,85 tok/s TG Prefill 114 · TTFT 19.280 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 56 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,95 tok/s TG Prefill 94 · TTFT 24.951 ms | 1× | 2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAM | llama.cppgodclawQ4_K_XL | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.