🏆
Rankings
LLM Leaderboard
Real measurements of every tested language model on real, named hardware – rated by raw speed (performance in tokens per second, prefill and time to first token) and by practical task quality in complete agent and chat runs (harness). Pick a benchmark type below or filter by model, maker and hardware to see exactly what is tested and how the results are produced.
⚡ Performance (tok/s)🤖 Harness quality👥 Concurrency🖥️ real hardware
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.564,61 tok/s TG Prefill 2.600 · TTFT 34.894 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 2 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.562,27 tok/s TG Prefill 2.593 · TTFT 34.854 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 3 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.555,31 tok/s TG Prefill 2.655 · TTFT 34.751 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 4 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.100,69 tok/s TG Prefill 27.110 · TTFT 739 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 5 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 1.044,38 tok/s TG Prefill 38.866 · TTFT 388 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | serverphasetimingNVFP4 | Details → | |
| 6 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 902,92 tok/s TG Prefill - · TTFT 227 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 7 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 861,40 tok/s TG Prefill 15.615 · TTFT 1.677 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 8 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 846,62 tok/s TG Prefill - · TTFT 238 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 9 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 833,03 tok/s TG Prefill - · TTFT 213 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 10 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 826,24 tok/s TG Prefill 3.229 · TTFT 15.223 ms | 10× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 11 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 804,23 tok/s TG Prefill 2.435 · TTFT 15.796 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 12 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 795,03 tok/s TG Prefill 2.378 · TTFT 15.951 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 13 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 783,55 tok/s TG Prefill 2.459 · TTFT 15.907 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 14 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 697,38 tok/s TG Prefill 14.373 · TTFT 1.721 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 15 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 626,30 tok/s TG Prefill - · TTFT 165 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 16 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 608,35 tok/s TG Prefill 23.343 · TTFT 414 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 17 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 589,64 tok/s TG Prefill 43.711 · TTFT 223 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | serverphasetimingNVFP4 | Details → | |
| 18 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 569,97 tok/s TG Prefill - · TTFT 160 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 19 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 543,78 tok/s TG Prefill 12.359 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 20 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 490,51 tok/s TG Prefill - · TTFT 177 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 21 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 474,76 tok/s TG Prefill 1.760 · TTFT 26.540 ms | 10× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 22 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 436,25 tok/s TG Prefill 3.526 · TTFT 5.370 ms | 5× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 23 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 417,52 tok/s TG Prefill 12.747 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 24 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 351,55 tok/s TG Prefill 1.164 · TTFT 38.427 ms | 10× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 25 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 333,12 tok/s TG Prefill 1.168 · TTFT 37.996 ms | 10× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 26 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 267,65 tok/s TG Prefill 1.544 · TTFT 9.962 ms | 5× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 27 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 219,59 tok/s TG Prefill 2.273 · TTFT 11.329 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 28 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 198,63 tok/s TG Prefill 993 · TTFT 14.781 ms | 5× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 29 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 198,55 tok/s TG Prefill 1.000 · TTFT 14.742 ms | 5× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 30 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 190,25 tok/s TG Prefill 1.859 · TTFT 13.867 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 31 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,47 tok/s TG Prefill - · TTFT 98 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 32 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,71 tok/s TG Prefill - · TTFT 160 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 33 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,58 tok/s TG Prefill 1.951 · TTFT 1.010 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 34 | NVIDIA-Nemotron-3.5-Super-VL-120B-A12B120BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,32 tok/s TG Prefill 1.225 · TTFT 2.121 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 35 | Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,06 tok/s TG Prefill 1.772 · TTFT 1.128 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | stratagodclawUD-Q4_K_XL | Details → | |
| 36 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 157,50 tok/s TG Prefill 1.715 · TTFT 6.606 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 37 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,26 tok/s TG Prefill 1.343 · TTFT 8.459 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 38 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,56 tok/s TG Prefill 1.267 · TTFT 4.040 ms | 10× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLQ4_K_M | Details → | |
| 39 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 140,06 tok/s TG Prefill 1.284 · TTFT 1.994 ms | 5× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLQ4_K_M | Details → | |
| 40 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,75 tok/s TG Prefill 1.439 · TTFT 1.508 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 41 | gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 134,26 tok/s TG Prefill 1.113 · TTFT 2.031 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 42 | Kolibri-178.1BAleph Alpha Performance benchmarkKolibri Prefill-Decode 1024-256 - Summenraten C1 C5 C10 V1 | 133,13 tok/s TG Prefill 20.590 · TTFT 106 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | serverphasetimingNVFP4 | Details → | |
| 43 | Kolibri-178.1BAleph Alpha Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,86 tok/s TG Prefill - · TTFT 155 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclaw | Details → | |
| 44 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,73 tok/s TG Prefill 15.397 · TTFT 126 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 45 | Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 127,28 tok/s TG Prefill 8.225 · TTFT 296 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawNVFP4 | Details → | |
| 46 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 126,12 tok/s TG Prefill 7.867 · TTFT 251 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 47 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 124,52 tok/s TG Prefill 1.096 · TTFT 2.336 ms | 5× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLUD-Q4_K_M | Details → | |
| 48 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 120,01 tok/s TG Prefill 1.155 · TTFT 1.875 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppgodclawIQ4_XS | Details → | |
| 49 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 111,12 tok/s TG Prefill 616 · TTFT 16.066 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 50 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,30 tok/s TG Prefill 694 · TTFT 29.007 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 51 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,04 tok/s TG Prefill 1.089 · TTFT 4.703 ms | 10× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLUD-Q4_K_M | Details → | |
| 52 | Kolibri-178.1BAleph Alpha Harness benchmarkOffice Agentic Work 100 - Tool Usage V1 | 100 Pkt 100,0% · 100/100 Aufg. · 547,7 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | officeagentic100NVFP4 | Details → | |
| 53 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 57,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMBuzzwordTrainAWQ | Details → | |
| 54 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 36,2 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 55 | Open-Jev-27B-v1.127BZefan Cai / Open-Jev Harness benchmarkDecision-Benchmark V 1.0 | 200 Pkt 100,0% · 200/200 Aufg. · 75,5 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | pytorchpytorch | Details → | |
| 56 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 207 Pkt 98,6% · 207/210 Aufg. · 1.080,2 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic210 | Details → | |
| 57 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 97,08 tok/s TG Prefill 757 · TTFT 13.077 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 58 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 193 Pkt 96,5% · 193/200 Aufg. · 3.667,6 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 59 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 289 Pkt 93,2% · 289/310 Aufg. · 2.504,7 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310FP8 | Details → | |
| 60 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 283 Pkt 91,3% · 283/310 Aufg. · 2.384,4 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310NVFP4 | Details → | |
| 61 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 84,70 tok/s TG Prefill 1.022 · TTFT 2.264 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 62 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,07 tok/s TG Prefill 383 · TTFT 4.502 ms | 5× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 63 | Nemotron-Cascade-2-30B-A3B30BNVIDIA Harness benchmarkDecision-Benchmark V 1.0 | 159 Pkt 79,5% · 159/200 Aufg. · 35,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllm | Details → | |
| 64 | Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 78,10 tok/s TG Prefill 816 · TTFT 627 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLQ4_K_M | Details → | |
| 65 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,84 tok/s TG Prefill 920 · TTFT 2.098 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 66 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,58 tok/s TG Prefill 888 · TTFT 15.224 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 67 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,43 tok/s TG Prefill 898 · TTFT 2.781 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 68 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 64,46 tok/s TG Prefill 592 · TTFT 16.869 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 69 | gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 63,18 tok/s TG Prefill 627 · TTFT 3.155 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliMXFP4 | Details → | |
| 70 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 62,18 tok/s TG Prefill 592 · TTFT 865 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLUD-Q4_K_M | Details → | |
| 71 | Laya0.4BConvai Innovations Harness benchmarkDecision-Benchmark V 1.0 | 122 Pkt 61,0% · 122/200 Aufg. · 14,1 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | pytorchpytorch | Details → | |
| 72 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 58,96 tok/s TG Prefill 818 · TTFT 24.766 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 73 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 54,23 tok/s TG Prefill 357 · TTFT 14.331 ms | 10× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLQ8_0 | Details → | |
| 74 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,58 tok/s TG Prefill 348 · TTFT 7.358 ms | 5× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLQ8_0 | Details → | |
| 75 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 210 V1.0 | 108 Pkt 51,4% · 108/210 Aufg. · 72,1 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic210 | Details → | |
| 76 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,75 tok/s TG Prefill 305 · TTFT 32.520 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 77 | Qwen3.6-35B-A3B-AWQ35BQwen (Alibaba) Harness benchmarkDecision-Benchmark High V 1.0 | 87 Pkt 43,5% · 87/200 Aufg. · 19,0 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition iAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMvllmAWQ | Details → | |
| 78 | gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 43,23 tok/s TG Prefill 758 · TTFT 2.613 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 79 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,11 tok/s TG Prefill 821 · TTFT 2.298 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | openclaw_cli | Details → | |
| 80 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,46 tok/s TG Prefill 476 · TTFT 25.832 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 81 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 119 Pkt 38,4% · 119/310 Aufg. · 87,9 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310NVFP4 | Details → | |
| 82 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,94 tok/s TG Prefill 70 · TTFT 161.804 ms | 10× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 83 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,65 tok/s TG Prefill 776 · TTFT 29.085 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 84 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,29 tok/s TG Prefill 1.115 · TTFT 27.826 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 85 | Kolibri-178.1BAleph Alpha Harness benchmarkKolibri-Qwen Diverse Deterministic 310 V2.0 | 115 Pkt 37,1% · 115/310 Aufg. · 99,6 s | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMdeterministic310FP8 | Details → | |
| 86 | Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,46 tok/s TG Prefill 589 · TTFT 4.189 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 87 | Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 33,54 tok/s TG Prefill 547 · TTFT 3.535 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 88 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,41 tok/s TG Prefill 50 · TTFT 226.449 ms | 5× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 89 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 26,57 tok/s TG Prefill 50 · TTFT 276.964 ms | 10× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 90 | Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,68 tok/s TG Prefill 182 · TTFT 2.809 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cli batched-bench SYCLQ8_0 | Details → | |
| 91 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,04 tok/s TG Prefill 333 · TTFT 61.247 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 92 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,74 tok/s TG Prefill 212 · TTFT 57.889 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 93 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,84 tok/s TG Prefill 277 · TTFT 48.247 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 94 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,64 tok/s TG Prefill 281 · TTFT 6.718 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 95 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,29 tok/s TG Prefill 273 · TTFT 55.104 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 96 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,18 tok/s TG Prefill 319 · TTFT 8.542 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 97 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,15 tok/s TG Prefill 308 · TTFT 64.768 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 98 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 23,11 tok/s TG Prefill 639 · TTFT 44.373 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 99 | Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,41 tok/s TG Prefill 388 · TTFT 5.855 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 100 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,30 tok/s TG Prefill 298 · TTFT 6.721 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 101 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,24 tok/s TG Prefill 263 · TTFT 57.267 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 102 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,75 tok/s TG Prefill 987 · TTFT 26.527 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 103 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,72 tok/s TG Prefill 45 · TTFT 32.857 ms | 5× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 104 | Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,57 tok/s TG Prefill 159 · TTFT 13.491 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 105 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,55 tok/s TG Prefill 166 · TTFT 13.627 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 106 | Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,51 tok/s TG Prefill 185 · TTFT 14.723 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 107 | Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,47 tok/s TG Prefill 197 · TTFT 13.734 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 108 | Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,34 tok/s TG Prefill 243 · TTFT 13.913 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 109 | gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,82 tok/s TG Prefill 40 · TTFT 49.516 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 110 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 10,94 tok/s TG Prefill 762 · TTFT 15.666 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 111 | GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,01 tok/s TG Prefill 441 · TTFT 4.837 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawFP8 | Details → | |
| 112 | Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,00 tok/s TG Prefill 15 · TTFT 531 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 113 | command-a-reasoning-08-2025111BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 0,02 tok/s TG Prefill 5 · TTFT 485.856 ms | 1× | Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |