🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-4-E2B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.608,46 tok/s TG Prefill 31.452 · TTFT 1.633 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 2 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.443,88 tok/s TG Prefill 35.348 · TTFT 560 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | Details → | |
| 3 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.386,79 tok/s TG Prefill 19.981 · TTFT 1.205 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 4 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.295,30 tok/s TG Prefill 25.462 · TTFT 808 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 5 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.238,26 tok/s TG Prefill 21.843 · TTFT 905 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw | Details → | |
| 6 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.070,56 tok/s TG Prefill 33.741 · TTFT 976 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 7 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.028,59 tok/s TG Prefill 24.461 · TTFT 1.670 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 8 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.028,53 tok/s TG Prefill 36.884 · TTFT 916 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 9 | gemma-4-E4B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.022,79 tok/s TG Prefill 18.744 · TTFT 2.204 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 10 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.015,69 tok/s TG Prefill 20.061 · TTFT 1.289 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 11 | gemma-4-E2B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 973,54 tok/s TG Prefill 23.599 · TTFT 460 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 12 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 966,21 tok/s TG Prefill 33.768 · TTFT 1.793 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 13 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 961,53 tok/s TG Prefill 32.305 · TTFT 1.633 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 14 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 952,78 tok/s TG Prefill 20.106 · TTFT 1.542 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 15 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 910,74 tok/s TG Prefill 33.907 · TTFT 1.527 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 16 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 909,25 tok/s TG Prefill 37.116 · TTFT 1.783 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 17 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 906,04 tok/s TG Prefill 39.029 · TTFT 1.193 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 18 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 901,86 tok/s TG Prefill 12.965 · TTFT 12.663 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 19 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 883,71 tok/s TG Prefill 12.981 · TTFT 12.917 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 20 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 873,72 tok/s TG Prefill 33.023 · TTFT 1.835 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 21 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 842,94 tok/s TG Prefill 31.098 · TTFT 319 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | Details → | |
| 22 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 803,96 tok/s TG Prefill 16.236 · TTFT 616 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 23 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 797,18 tok/s TG Prefill 11.820 · TTFT 1.789 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 24 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 796,82 tok/s TG Prefill 11.892 · TTFT 1.781 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 25 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 790,09 tok/s TG Prefill 13.693 · TTFT 1.142 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw | Details → | |
| 26 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 784,45 tok/s TG Prefill 17.724 · TTFT 560 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 27 | Magistral-Small-2509Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 726,94 tok/s TG Prefill 10.204 · TTFT 2.619 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 28 | Devstral-Small-2-24B-Instruct-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 725,58 tok/s TG Prefill 11.872 · TTFT 2.430 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 29 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 688,61 tok/s TG Prefill 16.192 · TTFT 873 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 30 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 676,76 tok/s TG Prefill 21.675 · TTFT 725 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 31 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 670,65 tok/s TG Prefill 17.357 · TTFT 3.808 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 32 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 666,52 tok/s TG Prefill 27.804 · TTFT 465 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 33 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 655,83 tok/s TG Prefill 17.990 · TTFT 931 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 34 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 649,04 tok/s TG Prefill 17.868 · TTFT 764 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 35 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 633,41 tok/s TG Prefill 20.292 · TTFT 767 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 36 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 625,71 tok/s TG Prefill 31.724 · TTFT 396 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 37 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 618,22 tok/s TG Prefill 28.790 · TTFT 435 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 38 | gemma-4-E4B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 616,01 tok/s TG Prefill 13.778 · TTFT 803 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 39 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 615,82 tok/s TG Prefill 13.999 · TTFT 797 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 40 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 596,47 tok/s TG Prefill 26.540 · TTFT 369 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 41 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 594,77 tok/s TG Prefill 25.604 · TTFT 404 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 42 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 533,54 tok/s TG Prefill 16.604 · TTFT 5.626 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawBF16 | Details → | |
| 43 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 524,37 tok/s TG Prefill 7.751 · TTFT 4.130 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 44 | Qwen2.5-32B-Instruct-AWQQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 510,34 tok/s TG Prefill 6.104 · TTFT 4.473 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 45 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 500,57 tok/s TG Prefill 5.466 · TTFT 5.230 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 46 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 497,64 tok/s TG Prefill 8.340 · TTFT 5.360 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 47 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 496,79 tok/s TG Prefill 12.291 · TTFT 3.700 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 48 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 487,24 tok/s TG Prefill 12.271 · TTFT 3.758 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 49 | gemma-4-12B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 486,20 tok/s TG Prefill 4.345 · TTFT 5.863 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 50 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 483,69 tok/s TG Prefill 9.270 · TTFT 1.070 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 51 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 479,47 tok/s TG Prefill 9.242 · TTFT 1.075 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 52 | Devstral-Small-2-24B-Instruct-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 423,35 tok/s TG Prefill 6.026 · TTFT 2.001 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 53 | Magistral-Small-2509Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 411,83 tok/s TG Prefill 7.172 · TTFT 1.728 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 54 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 399,08 tok/s TG Prefill 14.492 · TTFT 984 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 55 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 397,81 tok/s TG Prefill 11.797 · TTFT 1.550 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawBF16 | Details → | |
| 56 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 338,30 tok/s TG Prefill 5.943 · TTFT 2.299 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 57 | Magistral-Small-2509Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 330,94 tok/s TG Prefill 4.379 · TTFT 7.353 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 58 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,66 tok/s TG Prefill 5.742 · TTFT 2.122 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 59 | gemma-4-12B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 315,66 tok/s TG Prefill 3.728 · TTFT 2.722 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 60 | Qwen2.5-32B-Instruct-AWQQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,61 tok/s TG Prefill 4.931 · TTFT 2.537 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 61 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 298,12 tok/s TG Prefill 5.098 · TTFT 2.468 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 62 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 280,15 tok/s TG Prefill 9.224 · TTFT 217 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 63 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 268,71 tok/s TG Prefill 17.371 · TTFT 114 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | Details → | |
| 64 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 267,04 tok/s TG Prefill 7.273 · TTFT 272 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 65 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 252,68 tok/s TG Prefill 7.068 · TTFT 281 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw | Details → | |
| 66 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 243,00 tok/s TG Prefill 4.297 · TTFT 765 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 67 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 237,20 tok/s TG Prefill 8.070 · TTFT 353 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 68 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 233,88 tok/s TG Prefill 10.557 · TTFT 236 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 69 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 232,79 tok/s TG Prefill 8.323 · TTFT 311 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 70 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 228,95 tok/s TG Prefill 9.070 · TTFT 302 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 71 | gemma-4-E2B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 228,18 tok/s TG Prefill 11.075 · TTFT 179 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 72 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 227,91 tok/s TG Prefill 2.384 · TTFT 1.021 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 73 | Magistral-Small-2509Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 226,20 tok/s TG Prefill 2.929 · TTFT 4.189 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 74 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 221,28 tok/s TG Prefill 8.379 · TTFT 300 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 75 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 204,94 tok/s TG Prefill 4.657 · TTFT 527 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 76 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 195,53 tok/s TG Prefill 6.810 · TTFT 291 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 77 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 195,04 tok/s TG Prefill 8.425 · TTFT 231 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 78 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 191,04 tok/s TG Prefill 5.708 · TTFT 732 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawBF16 | Details → | |
| 79 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 176,18 tok/s TG Prefill 8.074 · TTFT 245 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 80 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 176,06 tok/s TG Prefill 7.970 · TTFT 248 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 81 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 174,20 tok/s TG Prefill 5.042 · TTFT 47.620 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 82 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,72 tok/s TG Prefill 7.637 · TTFT 319 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 83 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,65 tok/s TG Prefill 7.081 · TTFT 345 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 84 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,59 tok/s TG Prefill 6.991 · TTFT 350 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 85 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 160,64 tok/s TG Prefill 13.528 · TTFT 3.190 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 86 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,26 tok/s TG Prefill 10.264 · TTFT 3.946 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 87 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,33 tok/s TG Prefill 23.508 · TTFT 1.417 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawBF16 | Details → | |
| 88 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 144,83 tok/s TG Prefill 9.895 · TTFT 217 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 89 | gemma-4-E4B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 144,58 tok/s TG Prefill 7.078 · TTFT 281 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 90 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,02 tok/s TG Prefill 547 · TTFT 39.314 ms | 10× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclaw | Details → | |
| 91 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,63 tok/s TG Prefill 4.568 · TTFT 13.673 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 92 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,12 tok/s TG Prefill 5.634 · TTFT 12.854 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 93 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,57 tok/s TG Prefill 6.997 · TTFT 5.319 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 94 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,49 tok/s TG Prefill 7.016 · TTFT 5.294 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 95 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,25 tok/s TG Prefill 6.620 · TTFT 5.066 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 96 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,46 tok/s TG Prefill 10.458 · TTFT 1.708 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawBF16 | Details → | |
| 97 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,28 tok/s TG Prefill 10.572 · TTFT 1.487 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 98 | Devstral-Small-2-24B-Instruct-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 96,87 tok/s TG Prefill 5.696 · TTFT 375 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 99 | Magistral-Small-2509Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 96,03 tok/s TG Prefill 5.629 · TTFT 380 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 100 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,62 tok/s TG Prefill 2.949 · TTFT 726 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 101 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,90 tok/s TG Prefill 7.618 · TTFT 2.214 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 102 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,25 tok/s TG Prefill 12.250 · TTFT 2.840 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 103 | Ministral-3-14B-Reasoning-2512Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,15 tok/s TG Prefill 3.218 · TTFT 666 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 104 | MiniMax-M2.5MiniMax Harness benchmarkTool Usage Standard 1.0 | 2.427 Pkt 81,4% · 16/16 Aufg. · 228,0 s | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawBF16 | Details → | |
| 105 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 77,74 tok/s TG Prefill 5.460 · TTFT 2.641 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 106 | gemma-4-12B-itGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,04 tok/s TG Prefill 3.021 · TTFT 659 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 107 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 73,44 tok/s TG Prefill 5.550 · TTFT 2.628 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 108 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 73,09 tok/s TG Prefill 408 · TTFT 27.221 ms | 5× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclaw | Details → | |
| 109 | Qwen2.5-32B-Instruct-AWQQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,16 tok/s TG Prefill 2.321 · TTFT 1.217 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 110 | Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,51 tok/s TG Prefill 5.970 · TTFT 7.475 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 111 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,17 tok/s TG Prefill 3.527 · TTFT 696 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 112 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,19 tok/s TG Prefill 7.289 · TTFT 412 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 113 | MiniMax-M2.5MiniMax Harness benchmarkTool Usage Standard 1.0 | 2.033 Pkt 68,2% · 16/16 Aufg. · 373,0 s | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawBF16 | Details → | |
| 114 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,75 tok/s TG Prefill 6.946 · TTFT 4.901 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 115 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,45 tok/s TG Prefill 7.167 · TTFT 4.743 ms | 10× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 116 | MiniMax-M2.5MiniMax Performance benchmarkPerformancetest Small 1.0 | 62,70 tok/s TG Prefill 368 · TTFT 144 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawBF16 | Details → | |
| 117 | MiniMax-M2.7MiniMax Harness benchmarkTool-Parcours Dossier 40 V1.0 | 3.641 Pkt 61,1% · 40/40 Aufg. · 8.209,0 s | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 118 | MiniMax-M2.5MiniMax Harness benchmarkTool-Parcours Dossier 40 V1.0 | 3.622 Pkt 60,8% · 34/40 Aufg. · 7.862,0 s | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawBF16 | Details → | |
| 119 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 59,41 tok/s TG Prefill 3.761 · TTFT 569 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 120 | Magistral-Small-2509Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 58,03 tok/s TG Prefill 1.644 · TTFT 1.302 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocketAWQ | Details → | |
| 121 | MiniMax-M2.5MiniMax Harness benchmarkTool Usage Standard 1.0 | 1.714 Pkt 57,5% · 16/16 Aufg. · 487,0 s | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclawBF16 | Details → | |
| 122 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 55,99 tok/s TG Prefill 3.520 · TTFT 622 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 123 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,72 tok/s TG Prefill 4.993 · TTFT 874 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw4-Bit | Details → | |
| 124 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 52,46 tok/s TG Prefill 5.268 · TTFT 2.720 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 125 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,61 tok/s TG Prefill 5.448 · TTFT 2.676 ms | 5× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 126 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,30 tok/s TG Prefill 320 · TTFT 6.725 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 127 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,40 tok/s TG Prefill 3.509 · TTFT 649 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 128 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,65 tok/s TG Prefill 5.913 · TTFT 437 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 129 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,52 tok/s TG Prefill 4.080 · TTFT 752 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 130 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,18 tok/s TG Prefill 5.211 · TTFT 480 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 131 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,43 tok/s TG Prefill 861 · TTFT 2.500 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 132 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 8.091 · TTFT 1.621 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 133 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,17 tok/s TG Prefill 4.851 · TTFT 489 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 134 | Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,20 tok/s TG Prefill 4.890 · TTFT 4.010 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 135 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,04 tok/s TG Prefill 3.904 · TTFT 581 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 136 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,95 tok/s TG Prefill 8.044 · TTFT 378 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 137 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,21 tok/s TG Prefill 5.446 · TTFT 460 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 138 | Qwen3.6-27BQwen (Alibaba) Harness benchmarkTool Usage Standard 1.0 | 1.220 Pkt 40,9% · 16/16 Aufg. · 1.036,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | Details → | |
| 139 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,50 tok/s TG Prefill 5.664 · TTFT 755 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 140 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,74 tok/s TG Prefill 3.947 · TTFT 575 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 141 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,70 tok/s TG Prefill 4.998 · TTFT 387 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 142 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,27 tok/s TG Prefill 5.443 · TTFT 774 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 143 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,34 tok/s TG Prefill 8.377 · TTFT 387 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 144 | NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,30 tok/s TG Prefill 5.839 · TTFT 376 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawBF16 | Details → | |
| 145 | Qwen3.6-27BQwen (Alibaba) Harness benchmarkTool-Parcours Dossier 40 V1.0 | 2.267 Pkt 38,0% · 38/40 Aufg. · 10.331,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | Details → | |
| 146 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,87 tok/s TG Prefill 7.939 · TTFT 473 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 147 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,66 tok/s TG Prefill 6.540 · TTFT 375 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw4-Bit | Details → | |
| 148 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,82 tok/s TG Prefill 5.528 · TTFT 767 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 149 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,80 tok/s TG Prefill 4.274 · TTFT 570 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 150 | MiniMax-M2.7MiniMax Performance benchmarkPerformancetest Small 1.0 | 34,37 tok/s TG Prefill 503 · TTFT 105 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 151 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,36 tok/s TG Prefill 7.861 · TTFT 473 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 152 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,21 tok/s TG Prefill 5.971 · TTFT 356 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 153 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,19 tok/s TG Prefill 2.767 · TTFT 1.132 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 154 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,76 tok/s TG Prefill 4.322 · TTFT 563 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 155 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,23 tok/s TG Prefill 2.184 · TTFT 1.050 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 156 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,93 tok/s TG Prefill 2.096 · TTFT 1.093 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 157 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,73 tok/s TG Prefill 816 · TTFT 35.129 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 158 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,52 tok/s TG Prefill 2.328 · TTFT 991 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 159 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,59 tok/s TG Prefill 819 · TTFT 35.012 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 160 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,28 tok/s TG Prefill 1.804 · TTFT 1.281 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 161 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,73 tok/s TG Prefill 888 · TTFT 25.625 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 162 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,41 tok/s TG Prefill 1.525 · TTFT 19.257 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 163 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,35 tok/s TG Prefill 1.986 · TTFT 1.157 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 164 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,06 tok/s TG Prefill 4.992 · TTFT 415 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 165 | Qwen3.6-27BQwen (Alibaba) Performance benchmarkTimebench 2 - Token-Generation / Output-Durchsatz | 28,80 tok/s TG Prefill 599 · TTFT 122 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | Details → | |
| 166 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,70 tok/s TG Prefill 3.379 · TTFT 986 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw4-Bit | Details → | |
| 167 | Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,88 tok/s TG Prefill 3.698 · TTFT 748 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 168 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,73 tok/s TG Prefill 660 · TTFT 34.336 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 169 | gemma-4-31B-itGoogle Performance benchmarkPerformancetest Small 1.0 | 24,36 tok/s TG Prefill 309 · TTFT 91 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT8 | Details → | |
| 170 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,25 tok/s TG Prefill 2.437 · TTFT 960 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 171 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,01 tok/s TG Prefill 2.068 · TTFT 1.108 ms | 1× | NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAM | vLLMgodclawAWQ | Details → | |
| 172 | Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,73 tok/s TG Prefill 2.230 · TTFT 1.115 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 173 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,64 tok/s TG Prefill 1.305 · TTFT 10.957 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 174 | Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,53 tok/s TG Prefill 2.237 · TTFT 1.117 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 175 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,31 tok/s TG Prefill 654 · TTFT 34.975 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 176 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,98 tok/s TG Prefill 642 · TTFT 15.446 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 177 | gpt-oss-120bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,48 tok/s TG Prefill 4.300 · TTFT 556 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw4-Bit | Details → | |
| 178 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,13 tok/s TG Prefill 488 · TTFT 20.357 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 179 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,05 tok/s TG Prefill 517 · TTFT 20.708 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 180 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,94 tok/s TG Prefill 516 · TTFT 20.783 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 181 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,85 tok/s TG Prefill 481 · TTFT 21.081 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 182 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,67 tok/s TG Prefill 86 · TTFT 23.622 ms | 1× | AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAM | vLLMgodclaw | Details → | |
| 183 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 16,34 tok/s TG Prefill 672 · TTFT 3.622 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 184 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 15,00 tok/s TG Prefill 9.072 · TTFT 245 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 185 | Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,37 tok/s TG Prefill 8.629 · TTFT 305 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 186 | gpt-oss-120bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,32 tok/s TG Prefill 405 · TTFT 26.375 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 187 | gemma-4-31B-itGoogle Performance benchmarkPerformancetest Small 1.0 | 12,45 tok/s TG Prefill 208 · TTFT 135 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT8 | Details → | |
| 188 | gemma-4-31B-itGoogle Performance benchmarkTimebench 2 - Token-Generation / Output-Durchsatz | 11,19 tok/s TG Prefill 162 · TTFT 716 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT8 | Details → | |
| 189 | gemma-4-31B-itGoogle Performance benchmarkPerformancetest Small 1.0 | 10,54 tok/s TG Prefill 199 · TTFT 141 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT8 | Details → | |
| 190 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,86 tok/s TG Prefill 8.244 · TTFT 264 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 191 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,84 tok/s TG Prefill 7.325 · TTFT 311 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 192 | GLM-4.5-AirZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,08 tok/s TG Prefill 5.237 · TTFT 407 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 193 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,99 tok/s TG Prefill 4.687 · TTFT 495 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclawAWQ | Details → | |
| 194 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,66 tok/s TG Prefill 533 · TTFT 3.719 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | vLLMwebsocket | Details → | |
| 195 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,29 tok/s TG Prefill 446 · TTFT 4.523 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 196 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,06 tok/s TG Prefill 266 · TTFT 8.622 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 197 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,03 tok/s TG Prefill 253 · TTFT 9.057 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 198 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,01 tok/s TG Prefill 250 · TTFT 9.170 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 199 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,98 tok/s TG Prefill 4.076 · TTFT 559 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 200 | gpt-oss-20bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,79 tok/s TG Prefill 406 · TTFT 4.916 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 201 | gpt-oss-120bOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,46 tok/s TG Prefill 333 · TTFT 6.064 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cli | Details → | |
| 202 | GLM-4.5-AirZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,20 tok/s TG Prefill 382 · TTFT 35.625 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 203 | Mistral-Small-3.1-24B-Instruct-2503Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 6,13 tok/s TG Prefill 2.944 · TTFT 763 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 204 | Mistral-Small-4-119B-2603Mistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,77 tok/s TG Prefill 325 · TTFT 5.900 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 205 | Qwen3.5-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,63 tok/s TG Prefill 345 · TTFT 5.672 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 206 | Qwen3.6-35B-A3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,61 tok/s TG Prefill 342 · TTFT 5.738 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclawAWQ | Details → | |
| 207 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,57 tok/s TG Prefill 4.108 · TTFT 529 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 208 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,54 tok/s TG Prefill 5.413 · TTFT 420 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 209 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,30 tok/s TG Prefill 3.582 · TTFT 607 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 210 | Qwen2.5-Coder-32B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 5,24 tok/s TG Prefill 3.234 · TTFT 701 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 211 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,61 tok/s TG Prefill 717 · TTFT 35.394 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 212 | MiniMax-M2.7MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,92 tok/s TG Prefill 600 · TTFT 23.512 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 213 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,39 tok/s TG Prefill 391 · TTFT 32.665 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 214 | GLM-4.5-AirZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,34 tok/s TG Prefill 182 · TTFT 11.740 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | vLLMcodex_cliAWQ | Details → | |
| 215 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,23 tok/s TG Prefill 434 · TTFT 75.130 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 216 | MiniMax-M2.5MiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,92 tok/s TG Prefill 510 · TTFT 38.845 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → |