Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Qwen (Alibaba)

Qwen3.8-Flash-Next180B

Benchmarkprofil und veröffentlichte Ergebnisse.

MoE180B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation1.564,6 tok/s
Min 7,0Ø 556,8Max 2.143,6
Ueber dem Durchschnitt · 542 Systeme im Feld
Prefill2.655 tok/s
Min 28Ø 6.400Max 43.711
Unter dem Durchschnitt · 533 Systeme im Feld
Time to First Token1.010 ms
Min 59Ø 9.098Max 168.314
Ueber dem Durchschnitt · 542 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

2.0301.5231.0155080,009451.8902.835Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.564,6 tok/s Generation, 2.312 tok/s Prefill, TTFT 17.248 ms (6 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX A6000 - 1.171,8 tok/s Generation, 963 tok/s Prefill, TTFT 32.556 ms (21 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 3090 - 1.132,7 tok/s Generation, 968 tok/s Prefill, TTFT 51.682 ms (6 Laufe)NVIDIA GeForce RTX 30...NVIDIA GB10 - 492,8 tok/s Generation, 1.262 tok/s Prefill, TTFT 33.373 ms (12 Laufe)NVIDIA GB10NVIDIA Tesla V100 PCIe 32GB - 196,2 tok/s Generation, 775 tok/s Prefill, TTFT 30.834 ms (8 Laufe)NVIDIA Tesla V100 PCI...AMD Radeon RX 7900 XTX - 18,7 tok/s Generation, 180 tok/s Prefill, TTFT 55.956 ms (3 Laufe)AMD Radeon RX 7900 XTX
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.564,6 tok/sNVIDIA RTX A6000 1.171,8 tok/sNVIDIA GeForce RTX 3090 1.132,7 tok/sNVIDIA GB10 492,8 tok/sNVIDIA Tesla V100 PCIe 32GB 196,2 tok/sAMD Radeon RX 7900 XTX 18,7 tok/s

CPUnach Prozessor

2.0301.5231.0155080,001.0512.1023.153Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 7945HX with Radeon Graphics - 1.564,6 tok/s Generation, 2.312 tok/s Prefill, TTFT 17.248 ms (6 Laufe)AMD Ryzen 9 7945HX wi...AMD Ryzen Threadripper PRO 3945WX 12-Cores - 1.171,8 tok/s Generation, 2.569 tok/s Prefill, TTFT 15.123 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 5 5600X 6-Core Processor - 1.132,7 tok/s Generation, 968 tok/s Prefill, TTFT 51.682 ms (6 Laufe)AMD Ryzen 5 5600X 6-C...NVIDIA Grace - 492,8 tok/s Generation, 1.262 tok/s Prefill, TTFT 33.373 ms (12 Laufe)NVIDIA GraceAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics - 196,2 tok/s Generation, 757 tok/s Prefill, TTFT 36.737 ms (5 Laufe)AMD Ryzen 3 PRO 3200G...AMD EPYC 7203P 8-Core Processor - 79,2 tok/s Generation, 320 tok/s Prefill, TTFT 39.530 ms (15 Laufe)AMD EPYC 7203P 8-Core...Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 63,2 tok/s Generation, 803 tok/s Prefill, TTFT 20.996 ms (3 Laufe)Intel(R) Xeon(R) CPU ...AMD Ryzen Threadripper PRO 3955WX 16-Cores - 18,7 tok/s Generation, 180 tok/s Prefill, TTFT 55.956 ms (3 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen 9 7945HX with Radeon Graphics 1.564,6 tok/sAMD Ryzen Threadripper PRO 3945WX 12-Cores 1.171,8 tok/sAMD Ryzen 5 5600X 6-Core Processor 1.132,7 tok/sNVIDIA Grace 492,8 tok/sAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics 196,2 tok/sAMD EPYC 7203P 8-Core Processor 79,2 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 63,2 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 18,7 tok/s

ENGnach Engine

2.0101.5071.0055020,01311.0992.0663.034Prefill (tok/s)Generation (tok/s)strata - 1.564,6 tok/s Generation, 1.064 tok/s Prefill, TTFT 44.996 ms (20 Laufe)stratallama.cpp - 1.555,3 tok/s Generation, 627 tok/s Prefill, TTFT 35.323 ms (24 Laufe)llama.cppunbekannt - 1.171,8 tok/s Generation, 1.981 tok/s Prefill, TTFT 17.080 ms (9 Laufe)unbekanntvLLM - 122,4 tok/s Generation, 2.538 tok/s Prefill, TTFT 3.634 ms (3 Laufe)vLLM
strata 1.564,6 tok/sllama.cpp 1.555,3 tok/sunbekannt 1.171,8 tok/svLLM 122,4 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.564,61 tok/s TG
Prefill 2.600 · TTFT 34.894 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
2Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.555,31 tok/s TG
Prefill 2.655 · TTFT 34.751 ms
10×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
3Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.171,75 tok/s TG
Prefill 2.132 · TTFT 45.396 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
4Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.132,67 tok/s TG
Prefill 1.930 · TTFT 47.978 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
5Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
804,23 tok/s TG
Prefill 2.435 · TTFT 15.796 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
6Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
783,55 tok/s TG
Prefill 2.459 · TTFT 15.907 ms
5×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
7Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
638,58 tok/s TG
Prefill 306 · TTFT 145.278 ms
10×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
8Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
589,46 tok/s TG
Prefill 2.120 · TTFT 21.049 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
9Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
572,23 tok/s TG
Prefill 1.826 · TTFT 21.491 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
10Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
492,83 tok/s TG
Prefill 1.231 · TTFT 103.873 ms
10×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
11Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
420,20 tok/s TG
Prefill 656 · TTFT 131.641 ms
10×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
12Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
319,40 tok/s TG
Prefill 254 · TTFT 73.516 ms
5×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
13Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
246,45 tok/s TG
Prefill 1.171 · TTFT 47.068 ms
5×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
14Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
242,41 tok/s TG
Prefill 4.265 · TTFT 17.947 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
15Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
211,19 tok/s TG
Prefill 592 · TTFT 60.940 ms
5×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
16Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
196,16 tok/s TG
Prefill 860 · TTFT 118.321 ms
10×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
17Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
164,58 tok/s TG
Prefill 1.951 · TTFT 1.010 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMllama.cppgodclawUD-Q4_K_XL
18Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,06 tok/s TG
Prefill 1.772 · TTFT 1.128 ms
1×NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAMstratagodclawUD-Q4_K_XL
19Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
139,55 tok/s TG
Prefill 3.687 · TTFT 3.821 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
20Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
137,92 tok/s TG
Prefill 818 · TTFT 45.184 ms
5×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
21Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,24 tok/s TG
Prefill 1.458 · TTFT 1.399 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
22Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,39 tok/s TG
Prefill 3.269 · TTFT 6.004 ms
10×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
23Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,39 tok/s TG
Prefill 1.389 · TTFT 1.421 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ2_XS
24Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
115,48 tok/s TG
Prefill 1.754 · TTFT 1.124 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XS
25Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
88,87 tok/s TG
Prefill 1.120 · TTFT 20.453 ms
10×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
26Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
82,45 tok/s TG
Prefill 2.547 · TTFT 3.826 ms
5×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
27Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
79,19 tok/s TG
Prefill 670 · TTFT 33.965 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
28Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,30 tok/s TG
Prefill 487 · TTFT 20.813 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
29Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
71,73 tok/s TG
Prefill 560 · TTFT 40.628 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
30Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,46 tok/s TG
Prefill 568 · TTFT 39.939 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
31Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
66,02 tok/s TG
Prefill 838 · TTFT 12.155 ms
5×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
32Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,23 tok/s TG
Prefill 904 · TTFT 15.542 ms
5×NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMstrataIQ3_S
33Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,09 tok/s TG
Prefill 1.023 · TTFT 43.363 ms
10×NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMstrataIQ3_S
34Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,89 tok/s TG
Prefill 409 · TTFT 24.788 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
35Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
59,28 tok/s TG
Prefill 483 · TTFT 4.084 ms
1×NVIDIA Tesla V100 PCIe 32GB4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMstrataIQ3_S
36Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
59,02 tok/s TG
Prefill 1.132 · TTFT 12.062 ms
5×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
37Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
55,85 tok/s TG
Prefill 415 · TTFT 24.406 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
38Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
52,11 tok/s TG
Prefill 510 · TTFT 3.869 ms
1×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
39Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
50,53 tok/s TG
Prefill 106 · TTFT 20.413 ms
1×NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAMstratagodclawIQ3_XXS
40Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,88 tok/s TG
Prefill 909 · TTFT 2.194 ms
1×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMstratagodclawIQ3_XXS
41Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,60 tok/s TG
Prefill 468 · TTFT 4.250 ms
1×NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAMstratagodclawIQ3_XXS
42Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
41,83 tok/s TG
Prefill 301 · TTFT 8.495 ms
1×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMstratagodclawUD-IQ4_XS
43Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
38,84 tok/s TG
Prefill 258 · TTFT 10.963 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 126 GB RAMllama.cppgodclawUD-Q4_K_XL
44Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,99 tok/s TG
Prefill 221 · TTFT 12.961 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XL
45Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,38 tok/s TG
Prefill 714 · TTFT 2.760 ms
1×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMllama.cppgodclawIQ3_XXS
46Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,58 tok/s TG
Prefill 220 · TTFT 12.963 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclaw
47Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,44 tok/s TG
Prefill 249 · TTFT 90.371 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
48Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,77 tok/s TG
Prefill 160 · TTFT 63.351 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
49Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,97 tok/s TG
Prefill 204 · TTFT 110.341 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
50Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,26 tok/s TG
Prefill 1.798 · TTFT 1.074 ms
1×NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAMvLLMgodclawNVFP4
51Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,67 tok/s TG
Prefill 124 · TTFT 18.211 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XL
52Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,36 tok/s TG
Prefill 158 · TTFT 64.302 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
53Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,69 tok/s TG
Prefill 245 · TTFT 92.959 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawUD-Q4_K_XL
54Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,75 tok/s TG
Prefill 182 · TTFT 55.630 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawUD-Q4_K_XL
55Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,85 tok/s TG
Prefill 114 · TTFT 19.280 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawUD-Q4_K_XL
56Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,95 tok/s TG
Prefill 94 · TTFT 24.951 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XL
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.