⚡
Performance benchmark
How fast is the model?
Raw throughput on real hardware – how many tokens a model generates per second, how quickly it processes the prompt and how short the time to first token is. Higher is better.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 326,85 tok/s TG Prefill 125 · TTFT 210.255 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 2 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 158,18 tok/s TG Prefill 2.213 · TTFT 6.611 ms | 10× | AMD Radeon 8060S Graphics iAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | serverphasetimingQ4_K_M | Details → | |
| 3 | North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 131,91 tok/s TG Prefill 1.759 · TTFT 13.043 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 4 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 126,83 tok/s TG Prefill 1.426 · TTFT 3.664 ms | 5× | AMD Radeon 8060S Graphics iAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | serverphasetimingQ4_K_M | Details → | |
| 5 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,55 tok/s TG Prefill 2.558 · TTFT 11.357 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,82 tok/s TG Prefill 1.501 · TTFT 14.918 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 7 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,67 tok/s TG Prefill 1.142 · TTFT 8.725 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 8 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 98,28 tok/s TG Prefill 605 · TTFT 1.242 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 9 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 97,78 tok/s TG Prefill 1.899 · TTFT 6.568 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 10 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 95,41 tok/s TG Prefill 577 · TTFT 1.310 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 11 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,63 tok/s TG Prefill 1.463 · TTFT 15.382 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 12 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,88 tok/s TG Prefill 3.208 · TTFT 15.975 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 13 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 86,36 tok/s TG Prefill 322 · TTFT 2.945 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 14 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,04 tok/s TG Prefill 962 · TTFT 70.832 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 15 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,88 tok/s TG Prefill 1.307 · TTFT 29.066 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 16 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,45 tok/s TG Prefill 744 · TTFT 13.292 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_0 | Details → | |
| 17 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,67 tok/s TG Prefill 745 · TTFT 13.316 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_0 | Details → | |
| 18 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 76,33 tok/s TG Prefill 877 · TTFT 23.278 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_0 | Details → | |
| 19 | gemma-4-26B-A4B-it-assistant26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,51 tok/s TG Prefill 867 · TTFT 23.582 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 20 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,37 tok/s TG Prefill 1.241 · TTFT 16.358 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 21 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 73,65 tok/s TG Prefill 843 · TTFT 24.099 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_0 | Details → | |
| 22 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,92 tok/s TG Prefill 1.094 · TTFT 9.064 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 23 | gemma-4-26B-A4B-it-assistant26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,34 tok/s TG Prefill 795 · TTFT 12.430 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 24 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,26 tok/s TG Prefill 1.512 · TTFT 17.280 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 25 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 56,83 tok/s TG Prefill 1.123 · TTFT 10.037 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 26 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 55,83 tok/s TG Prefill 1.304 · TTFT 810 ms | 1× | AMD Radeon 8060S Graphics iAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | serverphasetimingQ4_K_M | Details → | |
| 27 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,72 tok/s TG Prefill 1.018 · TTFT 1.900 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkPerformancetest Small 1.0 | 42,22 tok/s TG Prefill 71 · TTFT 609 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 29 | Gemma-4-26B-A4B-it26BGoogle Performance benchmark | 42,22 tok/s TG Prefill 71 · TTFT 609 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | godclawQ8_0 | Details → | |
| 30 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,53 tok/s TG Prefill 282 · TTFT 6.994 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 31 | Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,06 tok/s TG Prefill 536 · TTFT 41.917 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 32 | gemma-4-26B-A4B-it-assistant26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,97 tok/s TG Prefill 777 · TTFT 2.545 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 33 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,81 tok/s TG Prefill 499 · TTFT 4.595 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_0 | Details → | |
| 34 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,39 tok/s TG Prefill 665 · TTFT 2.992 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_0 | Details → | |
| 35 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,25 tok/s TG Prefill 939 · TTFT 14.944 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 27,67 tok/s TG Prefill 211 · TTFT 194 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 37 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 27,60 tok/s TG Prefill 202 · TTFT 198 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 38 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 27,55 tok/s TG Prefill 84 · TTFT 513 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 39 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkPerformancetest Small 1.0 | 27,50 tok/s TG Prefill 299 · TTFT 224 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 40 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkPerformancetest Small 1.0 | 27,50 tok/s TG Prefill 109 · TTFT 604 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 41 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,92 tok/s TG Prefill 1.781 · TTFT 1.086 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 42 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,03 tok/s TG Prefill 1.200 · TTFT 27.883 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,47 tok/s TG Prefill 1.735 · TTFT 1.119 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 44 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,53 tok/s TG Prefill 691 · TTFT 41.832 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 45 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 16,15 tok/s TG Prefill 160 · TTFT 268 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 46 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0 | 16,14 tok/s TG Prefill 67 · TTFT 646 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclawBF16 | Details → | |
| 47 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,66 tok/s TG Prefill 160 · TTFT 61.556 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 48 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkPerformancetest Small 1.0 | 8,88 tok/s TG Prefill 22 · TTFT 906 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 49 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmark | 8,88 tok/s TG Prefill 22 · TTFT 906 ms | 1× | AMD Radeon 8060S Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | godclawQ8_0 | Details → | |
| 50 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,98 tok/s TG Prefill 159 · TTFT 12.016 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | llama.cppgodclawQ4_K_M | Details → |