⚡
Performance benchmark
How fast is the model?
Raw throughput on real hardware – how many tokens a model generates per second, how quickly it processes the prompt and how short the time to first token is. Higher is better.
⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.743,96 tok/s TG Prefill 13.641 · TTFT 5.790 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.743,14 tok/s TG Prefill 12.148 · TTFT 5.881 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.608,46 tok/s TG Prefill 31.452 · TTFT 1.633 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 4 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.210,29 tok/s TG Prefill 9.745 · TTFT 8.399 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.196,98 tok/s TG Prefill 6.074 · TTFT 10.280 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.082,39 tok/s TG Prefill 6.941 · TTFT 9.659 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 7 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.022,79 tok/s TG Prefill 18.744 · TTFT 2.204 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 8 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.009,04 tok/s TG Prefill 4.090 · TTFT 12.734 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 9 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 973,54 tok/s TG Prefill 23.599 · TTFT 460 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 10 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 971,35 tok/s TG Prefill 9.983 · TTFT 2.015 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 11 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 969,62 tok/s TG Prefill 12.437 · TTFT 1.852 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 12 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 913,39 tok/s TG Prefill 8.119 · TTFT 11.247 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 13 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 883,39 tok/s TG Prefill 5.377 · TTFT 12.467 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 14 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 710,36 tok/s TG Prefill 8.954 · TTFT 2.695 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 15 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 677,50 tok/s TG Prefill 2.978 · TTFT 18.549 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 16 | Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 676,42 tok/s TG Prefill 5.367 · TTFT 3.579 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 616,01 tok/s TG Prefill 13.778 · TTFT 803 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 18 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 592,13 tok/s TG Prefill 5.662 · TTFT 3.385 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 590,01 tok/s TG Prefill 5.490 · TTFT 17.999 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 20 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 585,92 tok/s TG Prefill 3.535 · TTFT 4.487 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 21 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 497,64 tok/s TG Prefill 8.340 · TTFT 5.360 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 22 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 489,71 tok/s TG Prefill 8.631 · TTFT 3.252 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 23 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 486,20 tok/s TG Prefill 4.345 · TTFT 5.863 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 24 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 468,02 tok/s TG Prefill 4.949 · TTFT 4.084 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 25 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 360,92 tok/s TG Prefill 2.636 · TTFT 6.319 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 26 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 319,02 tok/s TG Prefill 1.498 · TTFT 42.331 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 27 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,94 tok/s TG Prefill 1.446 · TTFT 42.781 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,66 tok/s TG Prefill 5.742 · TTFT 2.122 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 29 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,47 tok/s TG Prefill 1.427 · TTFT 42.816 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 30 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,17 tok/s TG Prefill 1.479 · TTFT 42.546 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 316,35 tok/s TG Prefill 1.470 · TTFT 42.801 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 32 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 316,28 tok/s TG Prefill 1.496 · TTFT 42.551 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 33 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 315,66 tok/s TG Prefill 3.728 · TTFT 2.722 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 34 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 312,21 tok/s TG Prefill 5.010 · TTFT 5.594 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 309,02 tok/s TG Prefill 1.120 · TTFT 42.243 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 276,28 tok/s TG Prefill 9.272 · TTFT 213 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 37 | Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 263,34 tok/s TG Prefill 784 · TTFT 55.800 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 38 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 262,45 tok/s TG Prefill 811 · TTFT 55.388 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 262,44 tok/s TG Prefill 822 · TTFT 55.319 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 242,32 tok/s TG Prefill 6.971 · TTFT 284 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 41 | Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 233,69 tok/s TG Prefill 2.376 · TTFT 950 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 42 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 228,18 tok/s TG Prefill 11.075 · TTFT 179 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 43 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 219,59 tok/s TG Prefill 2.273 · TTFT 11.329 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 44 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,50 tok/s TG Prefill 1.351 · TTFT 15.992 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 45 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,02 tok/s TG Prefill 1.348 · TTFT 16.034 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 46 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,02 tok/s TG Prefill 1.327 · TTFT 16.066 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 47 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 204,44 tok/s TG Prefill 1.300 · TTFT 16.378 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 48 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 204,31 tok/s TG Prefill 1.375 · TTFT 15.932 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 49 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 203,41 tok/s TG Prefill 1.372 · TTFT 16.012 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 50 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 190,25 tok/s TG Prefill 1.859 · TTFT 13.867 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 51 | Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,07 tok/s TG Prefill 3.110 · TTFT 638 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 52 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 184,38 tok/s TG Prefill 940 · TTFT 16.001 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 53 | North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,98 tok/s TG Prefill 1.029 · TTFT 69.564 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 54 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 165,04 tok/s TG Prefill 2.897 · TTFT 711 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 55 | Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 163,13 tok/s TG Prefill 683 · TTFT 22.415 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 56 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 163,13 tok/s TG Prefill 684 · TTFT 22.434 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 57 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 162,55 tok/s TG Prefill 715 · TTFT 21.986 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 58 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,03 tok/s TG Prefill 110 · TTFT 25.408 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 59 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 157,50 tok/s TG Prefill 1.715 · TTFT 6.606 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 60 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 157,00 tok/s TG Prefill 1.473 · TTFT 72.295 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 61 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,26 tok/s TG Prefill 1.343 · TTFT 8.459 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 62 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 155,85 tok/s TG Prefill 1.036 · TTFT 78.057 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 63 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 155,77 tok/s TG Prefill 1.107 · TTFT 76.761 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 64 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,96 tok/s TG Prefill 1.395 · TTFT 74.722 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 65 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,65 tok/s TG Prefill 1.613 · TTFT 73.900 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 66 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 144,58 tok/s TG Prefill 7.078 · TTFT 281 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 67 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 142,87 tok/s TG Prefill 498 · TTFT 91.483 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 68 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 142,20 tok/s TG Prefill 503 · TTFT 90.967 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 69 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 140,90 tok/s TG Prefill 2.783 · TTFT 1.005 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 70 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 140,11 tok/s TG Prefill 524 · TTFT 90.775 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 71 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,75 tok/s TG Prefill 1.439 · TTFT 1.508 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 72 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 129,00 tok/s TG Prefill 3.247 · TTFT 594 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 73 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 120,01 tok/s TG Prefill 1.155 · TTFT 1.875 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 74 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 118,55 tok/s TG Prefill 1.537 · TTFT 22.290 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 75 | North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 118,36 tok/s TG Prefill 895 · TTFT 23.355 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 76 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 118,04 tok/s TG Prefill 1.033 · TTFT 25.146 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 77 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 117,91 tok/s TG Prefill 941 · TTFT 26.171 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 78 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,57 tok/s TG Prefill 1.336 · TTFT 23.791 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 79 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 115,20 tok/s TG Prefill 1.424 · TTFT 23.184 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 80 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,50 tok/s TG Prefill 2.121 · TTFT 85.480 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 81 | Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,05 tok/s TG Prefill 361 · TTFT 137.879 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 82 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,94 tok/s TG Prefill 2.848 · TTFT 64.620 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 83 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,26 tok/s TG Prefill 2.824 · TTFT 64.279 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 84 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,78 tok/s TG Prefill 2.595 · TTFT 761 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 85 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,50 tok/s TG Prefill 1.209 · TTFT 2.272 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 86 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,39 tok/s TG Prefill 1.195 · TTFT 2.302 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 87 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,20 tok/s TG Prefill 1.206 · TTFT 2.277 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 88 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,15 tok/s TG Prefill 3.218 · TTFT 666 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 89 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 84,82 tok/s TG Prefill 3.484 · TTFT 649 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 90 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 83,72 tok/s TG Prefill 448 · TTFT 33.704 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 91 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,00 tok/s TG Prefill 451 · TTFT 34.179 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 92 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,44 tok/s TG Prefill 97 · TTFT 10.098 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 93 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,40 tok/s TG Prefill 445 · TTFT 34.520 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 94 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,04 tok/s TG Prefill 3.021 · TTFT 659 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 95 | Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,03 tok/s TG Prefill 856 · TTFT 2.253 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 96 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,96 tok/s TG Prefill 623 · TTFT 3.485 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 97 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,85 tok/s TG Prefill 604 · TTFT 3.568 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 98 | Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 68,05 tok/s TG Prefill 598 · TTFT 3.605 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 99 | Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,58 tok/s TG Prefill 300 · TTFT 56.560 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 100 | Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,81 tok/s TG Prefill 958 · TTFT 2.541 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 101 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,75 tok/s TG Prefill 902 · TTFT 2.698 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 102 | Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,10 tok/s TG Prefill 865 · TTFT 2.812 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 103 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,07 tok/s TG Prefill 856 · TTFT 2.843 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 104 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,88 tok/s TG Prefill 1.114 · TTFT 148.957 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 105 | Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,26 tok/s TG Prefill 284 · TTFT 238.161 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 106 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,65 tok/s TG Prefill 951 · TTFT 2.560 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 107 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,05 tok/s TG Prefill 224 · TTFT 126.906 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 108 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,83 tok/s TG Prefill 1.470 · TTFT 24.544 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 109 | North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,05 tok/s TG Prefill 745 · TTFT 2.651 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 110 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,81 tok/s TG Prefill 2.629 · TTFT 20.620 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 111 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,59 tok/s TG Prefill 2.617 · TTFT 21.158 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 112 | Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 57,21 tok/s TG Prefill 470 · TTFT 180.290 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 113 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,10 tok/s TG Prefill 190 · TTFT 71.280 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 114 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,93 tok/s TG Prefill 707 · TTFT 215.096 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 115 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,31 tok/s TG Prefill 644 · TTFT 217.710 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 116 | Qwen2.5-32B-Instruct-AWQ32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,95 tok/s TG Prefill 698 · TTFT 216.065 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 117 | Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,33 tok/s TG Prefill 153 · TTFT 257.193 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 118 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,87 tok/s TG Prefill 1.695 · TTFT 20.797 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 119 | Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,36 tok/s TG Prefill 221 · TTFT 103.372 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 120 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,21 tok/s TG Prefill 438 · TTFT 205.680 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 121 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,87 tok/s TG Prefill 1.172 · TTFT 41.913 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 122 | Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,70 tok/s TG Prefill 134 · TTFT 130.995 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 123 | Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,59 tok/s TG Prefill 122 · TTFT 237.566 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 124 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,73 tok/s TG Prefill 816 · TTFT 35.129 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 125 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,14 tok/s TG Prefill 118 · TTFT 246.235 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 126 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,60 tok/s TG Prefill 119 · TTFT 251.486 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 127 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,59 tok/s TG Prefill 819 · TTFT 35.012 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 128 | Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,55 tok/s TG Prefill 442 · TTFT 56.170 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 129 | Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,30 tok/s TG Prefill 431 · TTFT 4.485 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 130 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,95 tok/s TG Prefill 421 · TTFT 4.580 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 131 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,85 tok/s TG Prefill 375 · TTFT 5.208 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 132 | Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,79 tok/s TG Prefill 109 · TTFT 133.175 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 133 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,62 tok/s TG Prefill 1.223 · TTFT 11.695 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 134 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,41 tok/s TG Prefill 1.525 · TTFT 19.257 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 135 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 27,19 tok/s TG Prefill 1.424 · TTFT 20.551 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 136 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,80 tok/s TG Prefill 706 · TTFT 63.420 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 137 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,71 tok/s TG Prefill 662 · TTFT 64.391 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 138 | Qwen2.5-32B-Instruct-AWQ32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,69 tok/s TG Prefill 709 · TTFT 63.754 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 139 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,18 tok/s TG Prefill 261 · TTFT 255.650 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 140 | Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,83 tok/s TG Prefill 267 · TTFT 9.108 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 141 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,73 tok/s TG Prefill 660 · TTFT 34.336 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 142 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,62 tok/s TG Prefill 80 · TTFT 331.679 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 143 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,19 tok/s TG Prefill 102 · TTFT 136.966 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 144 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,83 tok/s TG Prefill 421 · TTFT 75.552 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 145 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,64 tok/s TG Prefill 1.305 · TTFT 10.957 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 146 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,55 tok/s TG Prefill 103 · TTFT 138.591 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 147 | MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,54 tok/s TG Prefill 135 · TTFT 163.713 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 148 | MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,85 tok/s TG Prefill 141 · TTFT 157.949 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 149 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,61 tok/s TG Prefill 1.219 · TTFT 11.738 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 150 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,92 tok/s TG Prefill 170 · TTFT 11.622 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 151 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,57 tok/s TG Prefill 29 · TTFT 286 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 152 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,39 tok/s TG Prefill 172 · TTFT 265.241 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 153 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,13 tok/s TG Prefill 488 · TTFT 20.357 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 154 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,05 tok/s TG Prefill 68 · TTFT 189.332 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 155 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,15 tok/s TG Prefill 1.266 · TTFT 2.131 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 156 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,14 tok/s TG Prefill 1.510 · TTFT 2.317 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 157 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,05 tok/s TG Prefill 517 · TTFT 20.708 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 158 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,94 tok/s TG Prefill 516 · TTFT 20.783 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 159 | minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,95 tok/s TG Prefill 113 · TTFT 190.982 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 160 | Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,81 tok/s TG Prefill 67 · TTFT 215.255 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 161 | Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,70 tok/s TG Prefill 135 · TTFT 20.068 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 162 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,34 tok/s TG Prefill 672 · TTFT 3.622 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 163 | Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,60 tok/s TG Prefill 71 · TTFT 293.317 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 164 | MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,16 tok/s TG Prefill 152 · TTFT 287.291 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 165 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,11 tok/s TG Prefill 622 · TTFT 3.910 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 166 | Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,82 tok/s TG Prefill 509 · TTFT 4.908 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 167 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,39 tok/s TG Prefill 171 · TTFT 124.363 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 168 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,12 tok/s TG Prefill 239 · TTFT 121.204 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 169 | minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,28 tok/s TG Prefill 120 · TTFT 263.391 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 170 | MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,22 tok/s TG Prefill 153 · TTFT 277.094 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 171 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,98 tok/s TG Prefill 695 · TTFT 3.957 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 172 | Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,62 tok/s TG Prefill 130 · TTFT 21.118 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 173 | Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,12 tok/s TG Prefill 98 · TTFT 21.966 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 174 | MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,86 tok/s TG Prefill 87 · TTFT 26.343 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 175 | MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,45 tok/s TG Prefill 84 · TTFT 27.256 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 176 | minimax-m2-awq230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,53 tok/s TG Prefill 67 · TTFT 34.091 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 177 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,95 tok/s TG Prefill 72 · TTFT 174.547 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 178 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,87 tok/s TG Prefill 112 · TTFT 19.038 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 179 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,13 tok/s TG Prefill 69 · TTFT 186.352 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 180 | Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,83 tok/s TG Prefill 430 · TTFT 4.494 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 181 | Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,46 tok/s TG Prefill 453 · TTFT 5.425 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 182 | OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,46 tok/s TG Prefill 449 · TTFT 5.444 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 183 | Qwen2.5-32B-Instruct-AWQ32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,41 tok/s TG Prefill 449 · TTFT 5.486 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 184 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,20 tok/s TG Prefill 98 · TTFT 19.630 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 185 | Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,49 tok/s TG Prefill 409 · TTFT 5.396 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 186 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,29 tok/s TG Prefill 446 · TTFT 4.523 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 187 | Qwen3.5-122B-A10B122BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,24 tok/s TG Prefill 64 · TTFT 30.093 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 188 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,00 tok/s TG Prefill 59 · TTFT 151.350 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 189 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,93 tok/s TG Prefill 59 · TTFT 150.457 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 190 | Nemotron-3-Super-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,87 tok/s TG Prefill 61 · TTFT 35.354 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 191 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,67 tok/s TG Prefill 99 · TTFT 85.963 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 192 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,57 tok/s TG Prefill 98 · TTFT 86.763 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 193 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,50 tok/s TG Prefill 57 · TTFT 152.613 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 194 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,28 tok/s TG Prefill 53 · TTFT 164.092 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 195 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,98 tok/s TG Prefill 61 · TTFT 44.934 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 196 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,93 tok/s TG Prefill 58 · TTFT 151.267 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 197 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,86 tok/s TG Prefill 66 · TTFT 40.934 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 198 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,84 tok/s TG Prefill 66 · TTFT 41.139 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 199 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,80 tok/s TG Prefill 59 · TTFT 150.829 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 200 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,80 tok/s TG Prefill 65 · TTFT 41.504 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 201 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,78 tok/s TG Prefill 173 · TTFT 53.622 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 202 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,77 tok/s TG Prefill 156 · TTFT 56.974 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 203 | Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,63 tok/s TG Prefill 345 · TTFT 5.672 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 204 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,61 tok/s TG Prefill 342 · TTFT 5.738 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 205 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,81 tok/s TG Prefill 55 · TTFT 158.303 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 206 | Nemotron-H-47B-Reasoning-128K47BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,69 tok/s TG Prefill 161 · TTFT 13.385 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 207 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,54 tok/s TG Prefill 143 · TTFT 70.040 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 208 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,47 tok/s TG Prefill 143 · TTFT 69.846 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 209 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,41 tok/s TG Prefill 229 · TTFT 10.683 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 210 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,34 tok/s TG Prefill 107 · TTFT 80.161 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 211 | DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,29 tok/s TG Prefill 65 · TTFT 35.268 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 212 | Laguna-M.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,20 tok/s TG Prefill 57 · TTFT 151.603 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 213 | Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,16 tok/s TG Prefill 149 · TTFT 69.107 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 214 | Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,14 tok/s TG Prefill 150 · TTFT 68.889 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 215 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,60 tok/s TG Prefill 108 · TTFT 79.520 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 216 | Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,52 tok/s TG Prefill 148 · TTFT 16.554 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 217 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,16 tok/s TG Prefill 128 · TTFT 21.272 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 218 | Devstral-2-123B-Instruct-2512123BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1,73 tok/s TG Prefill 95 · TTFT 22.362 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 219 | Mistral-Medium-3.5-128B128BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1,71 tok/s TG Prefill 95 · TTFT 22.448 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 220 | Llama-3.1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1,68 tok/s TG Prefill 48 · TTFT 183.808 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 221 | Llama-3.1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1,63 tok/s TG Prefill 51 · TTFT 181.415 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 222 | Llama-3.1-Nemotron-Ultra-253B-v1253BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 0,67 tok/s TG Prefill 35 · TTFT 60.617 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → |