⚡
Performance benchmark
How fast is the model?
Raw throughput on real hardware – how many tokens a model generates per second, how quickly it processes the prompt and how short the time to first token is. Higher is better.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 903,30 tok/s TG Prefill 6.960 · TTFT 11.382 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 860,88 tok/s TG Prefill 6.641 · TTFT 11.413 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 492,83 tok/s TG Prefill 1.231 · TTFT 103.873 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 4 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 488,18 tok/s TG Prefill 4.229 · TTFT 20.915 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 484,77 tok/s TG Prefill 4.124 · TTFT 21.088 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 478,55 tok/s TG Prefill 6.243 · TTFT 3.601 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 7 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 461,54 tok/s TG Prefill 5.838 · TTFT 3.795 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 8 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 455,06 tok/s TG Prefill 3.954 · TTFT 21.269 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 9 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 420,20 tok/s TG Prefill 656 · TTFT 131.641 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 10 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 367,75 tok/s TG Prefill 3.397 · TTFT 29.121 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 11 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 354,29 tok/s TG Prefill 3.544 · TTFT 30.045 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 12 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 253,67 tok/s TG Prefill 1.397 · TTFT 48.511 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 13 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 251,39 tok/s TG Prefill 3.708 · TTFT 6.599 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 14 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 250,66 tok/s TG Prefill 1.396 · TTFT 48.986 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 15 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 247,76 tok/s TG Prefill 1.399 · TTFT 49.349 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 16 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 246,68 tok/s TG Prefill 3.165 · TTFT 7.126 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 246,45 tok/s TG Prefill 1.171 · TTFT 47.068 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 18 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 245,62 tok/s TG Prefill 3.740 · TTFT 6.690 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 233,28 tok/s TG Prefill 4.282 · TTFT 4.702 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 20 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 211,19 tok/s TG Prefill 592 · TTFT 60.940 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 21 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,25 tok/s TG Prefill 3.483 · TTFT 8.798 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 22 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 202,30 tok/s TG Prefill 3.149 · TTFT 9.380 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 23 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 202,12 tok/s TG Prefill 4.412 · TTFT 4.498 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 24 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 182,87 tok/s TG Prefill 7.295 · TTFT 5.014 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 25 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 174,20 tok/s TG Prefill 5.042 · TTFT 47.620 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 26 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 169,89 tok/s TG Prefill 7.470 · TTFT 5.007 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 27 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 169,42 tok/s TG Prefill 2.873 · TTFT 7.817 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 167,11 tok/s TG Prefill 2.814 · TTFT 6.937 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 29 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 161,05 tok/s TG Prefill 5.256 · TTFT 6.170 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 30 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,02 tok/s TG Prefill 3.859 · TTFT 2.570 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 148,88 tok/s TG Prefill 4.312 · TTFT 2.296 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 32 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 148,79 tok/s TG Prefill 3.362 · TTFT 6.588 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 33 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,91 tok/s TG Prefill 4.736 · TTFT 2.900 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 34 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 142,76 tok/s TG Prefill 1.244 · TTFT 17.133 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 140,35 tok/s TG Prefill 1.237 · TTFT 17.315 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,82 tok/s TG Prefill 1.244 · TTFT 17.279 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 37 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,24 tok/s TG Prefill 5.091 · TTFT 2.946 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 38 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,96 tok/s TG Prefill 2.158 · TTFT 4.629 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 136,58 tok/s TG Prefill 2.934 · TTFT 8.734 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,61 tok/s TG Prefill 2.590 · TTFT 3.731 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 41 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,08 tok/s TG Prefill 1.548 · TTFT 12.948 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 42 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 129,46 tok/s TG Prefill 3.442 · TTFT 3.808 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 123,54 tok/s TG Prefill 2.897 · TTFT 3.743 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 44 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,39 tok/s TG Prefill 3.269 · TTFT 6.004 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 45 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,18 tok/s TG Prefill 2.075 · TTFT 5.320 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 46 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,98 tok/s TG Prefill 1.446 · TTFT 66.475 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 47 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,63 tok/s TG Prefill 4.568 · TTFT 13.673 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 48 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,12 tok/s TG Prefill 5.634 · TTFT 12.854 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 49 | minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,57 tok/s TG Prefill 6.997 · TTFT 5.319 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 50 | minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,49 tok/s TG Prefill 7.016 · TTFT 5.294 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 51 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,25 tok/s TG Prefill 6.620 · TTFT 5.066 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 52 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,36 tok/s TG Prefill 3.237 · TTFT 6.850 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 53 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,18 tok/s TG Prefill 6.144 · TTFT 314 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 54 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,67 tok/s TG Prefill 1.446 · TTFT 6.855 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 55 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,59 tok/s TG Prefill 6.798 · TTFT 285 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 56 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,96 tok/s TG Prefill 4.802 · TTFT 404 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 57 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 90,05 tok/s TG Prefill 1.600 · TTFT 43.239 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 58 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,87 tok/s TG Prefill 1.120 · TTFT 20.453 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawIQ3_XXS | Details → | |
| 59 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 86,23 tok/s TG Prefill 2.963 · TTFT 824 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 60 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,78 tok/s TG Prefill 3.326 · TTFT 594 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 61 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 84,61 tok/s TG Prefill 2.849 · TTFT 3.806 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 62 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 84,18 tok/s TG Prefill 2.987 · TTFT 816 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 63 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,45 tok/s TG Prefill 2.547 · TTFT 3.826 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 64 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,16 tok/s TG Prefill 3.589 · TTFT 550 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 65 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,15 tok/s TG Prefill 2.472 · TTFT 986 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 66 | NVIDIA-Nemotron-3.5-Lightning-30B-A3B31.6BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,10 tok/s TG Prefill 1.729 · TTFT 1.247 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 67 | Codestral-22B-v0.122BMistral AI Performance benchmark | 80,00 tok/s TG Prefill 1.200 · TTFT 150 ms | 8× | NVIDIA DGX SPARK (GB10)AMD Ryzen 9 9950X 16-Core Processor · 128 GB RAM | vLLMvllm | Details → | |
| 68 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,84 tok/s TG Prefill 3.760 · TTFT 5.878 ms | 10× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 69 | minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,74 tok/s TG Prefill 5.460 · TTFT 2.641 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 70 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 76,95 tok/s TG Prefill 2.356 · TTFT 929 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 71 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 76,87 tok/s TG Prefill 2.223 · TTFT 1.006 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 72 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 76,77 tok/s TG Prefill 1.830 · TTFT 1.055 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 73 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 74,19 tok/s TG Prefill 4.923 · TTFT 393 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 74 | minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 73,44 tok/s TG Prefill 5.550 · TTFT 2.628 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 75 | NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,70 tok/s TG Prefill 1.798 · TTFT 1.470 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 76 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,40 tok/s TG Prefill 2.292 · TTFT 842 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 77 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,75 tok/s TG Prefill 6.946 · TTFT 4.901 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 78 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,02 tok/s TG Prefill 838 · TTFT 12.155 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawIQ3_XXS | Details → | |
| 79 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,45 tok/s TG Prefill 7.167 · TTFT 4.743 ms | 10× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 80 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,50 tok/s TG Prefill 2.576 · TTFT 769 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 81 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,23 tok/s TG Prefill 1.354 · TTFT 1.459 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 82 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,04 tok/s TG Prefill 2.341 · TTFT 935 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 83 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,50 tok/s TG Prefill 1.862 · TTFT 1.599 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 84 | NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 58,25 tok/s TG Prefill 5.466 · TTFT 395 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 85 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,14 tok/s TG Prefill 3.027 · TTFT 3.561 ms | 5× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 86 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,46 tok/s TG Prefill 5.268 · TTFT 2.720 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 87 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,61 tok/s TG Prefill 5.448 · TTFT 2.676 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 88 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,88 tok/s TG Prefill 909 · TTFT 2.194 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawIQ3_XXS | Details → | |
| 89 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,10 tok/s TG Prefill 1.157 · TTFT 10.523 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 90 | glm-4.7-flash31.2BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,92 tok/s TG Prefill 4.055 · TTFT 536 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 91 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,48 tok/s TG Prefill 1.201 · TTFT 2.031 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 92 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,44 tok/s TG Prefill 1.189 · TTFT 2.051 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 93 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,20 tok/s TG Prefill 1.176 · TTFT 2.071 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 94 | Gemma-4-26B-A4B26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,06 tok/s TG Prefill 4.378 · TTFT 451 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 95 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,91 tok/s TG Prefill 3.713 · TTFT 537 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawFP8 | Details → | |
| 96 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,79 tok/s TG Prefill 3.315 · TTFT 589 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawFP8 | Details → | |
| 97 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,50 tok/s TG Prefill 1.156 · TTFT 10.550 ms | 5× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 98 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,83 tok/s TG Prefill 301 · TTFT 8.495 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | stratagodclawUD-IQ4_XS | Details → | |
| 99 | Qwen3-Coder-Next79.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,54 tok/s TG Prefill 2.124 · TTFT 1.146 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawFP8 | Details → | |
| 100 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,38 tok/s TG Prefill 714 · TTFT 2.760 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | llama.cppgodclawIQ3_XXS | Details → | |
| 101 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkPerformancetest Small 1.0 | 34,37 tok/s TG Prefill 503 · TTFT 105 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 102 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,12 tok/s TG Prefill 1.171 · TTFT 2.084 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 103 | minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,23 tok/s TG Prefill 2.184 · TTFT 1.050 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 104 | minimax-m2.5-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,93 tok/s TG Prefill 2.096 · TTFT 1.093 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 105 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,52 tok/s TG Prefill 2.328 · TTFT 991 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 106 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,35 tok/s TG Prefill 1.986 · TTFT 1.157 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 107 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,27 tok/s TG Prefill 1.151 · TTFT 2.118 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 108 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,26 tok/s TG Prefill 1.798 · TTFT 1.074 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 109 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,25 tok/s TG Prefill 2.437 · TTFT 960 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 110 | MiniMax-M2.7-AWQ-4bit230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,01 tok/s TG Prefill 2.068 · TTFT 1.108 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 111 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,44 tok/s TG Prefill 1.717 · TTFT 1.294 ms | 1× | NVIDIA DGX SPARK (GB10) iNVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 112 | NVIDIA-Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,39 tok/s TG Prefill 1.495 · TTFT 1.449 ms | 1× | NVIDIA DGX SPARK (GB10)NVIDIA Grace · 120 GB RAM | vLLMgodclawNVFP4 | Details → |