⚡
Performance-Benchmark
Wie schnell ist das Modell?
Roher Durchsatz auf echter Hardware – wie viele Token ein Modell pro Sekunde erzeugt, wie schnell es den Prompt verarbeitet und wie kurz die Zeit bis zum ersten Token ausfällt. Je höher, desto besser.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.564,61 tok/s TG Prefill 2.600 · TTFT 34.894 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 2 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.132,67 tok/s TG Prefill 1.930 · TTFT 47.978 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 3 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 783,55 tok/s TG Prefill 2.459 · TTFT 15.907 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 4 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 638,58 tok/s TG Prefill 306 · TTFT 145.278 ms | 10× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 5 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 572,23 tok/s TG Prefill 1.826 · TTFT 21.491 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 6 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 492,83 tok/s TG Prefill 1.231 · TTFT 103.873 ms | 10× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 7 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 420,20 tok/s TG Prefill 656 · TTFT 131.641 ms | 10× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 8 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 319,40 tok/s TG Prefill 254 · TTFT 73.516 ms | 5× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 9 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 246,45 tok/s TG Prefill 1.171 · TTFT 47.068 ms | 5× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 10 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,19 tok/s TG Prefill 592 · TTFT 60.940 ms | 5× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 11 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 196,16 tok/s TG Prefill 860 · TTFT 118.321 ms | 10× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 12 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,06 tok/s TG Prefill 1.772 · TTFT 1.128 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 13 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 137,92 tok/s TG Prefill 818 · TTFT 45.184 ms | 5× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 14 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,39 tok/s TG Prefill 1.389 · TTFT 1.421 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ2_XS | Details → | |
| 15 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,02 tok/s TG Prefill 1.132 · TTFT 12.062 ms | 5× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 16 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,11 tok/s TG Prefill 510 · TTFT 3.869 ms | 1× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 17 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,53 tok/s TG Prefill 106 · TTFT 20.413 ms | 1× | NVIDIA GeForce RTX 3090 iAMD Ryzen 5 5600X 6-Core Processor · 31 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 18 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,88 tok/s TG Prefill 909 · TTFT 2.194 ms | 1× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 19 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,60 tok/s TG Prefill 468 · TTFT 4.250 ms | 1× | NVIDIA Tesla V100 PCIe 32GB iAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 29 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 20 | Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,83 tok/s TG Prefill 301 · TTFT 8.495 ms | 1× | NVIDIA GB10 (DGX Spark) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → |