🏆
Ranglisten
LLM Leaderboard
Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.
⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-4-E2B-it5BQ4_K_MGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 668,00 tok/s TG Prefill 11.047 · TTFT 1.802 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 2 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 667,02 tok/s TG Prefill 4.019 · TTFT 17.735 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 3 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 655,34 tok/s TG Prefill 4.936 · TTFT 17.123 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 4 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 629,37 tok/s TG Prefill 4.530 · TTFT 17.991 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 5 | gemma-4-E2B-it5BQ8_0Google PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 600,60 tok/s TG Prefill 11.197 · TTFT 1.774 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 6 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 518,27 tok/s TG Prefill 13.775 · TTFT 18.702 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 7 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 508,08 tok/s TG Prefill 5.204 · TTFT 21.109 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 8 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 489,43 tok/s TG Prefill 10.618 · TTFT 18.898 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 9 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 487,60 tok/s TG Prefill 5.077 · TTFT 20.649 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 10 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 476,21 tok/s TG Prefill 5.858 · TTFT 20.719 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 11 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 474,97 tok/s TG Prefill 3.481 · TTFT 22.488 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 12 | gemma-4-E2B-it5BQ4_K_MGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 462,78 tok/s TG Prefill 10.812 · TTFT 917 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 13 | gemma-4-E2B-it5BQ8_0Google PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 429,79 tok/s TG Prefill 10.850 · TTFT 916 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 14 | gemma-4-E4B-it8BQ4_K_MGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 428,56 tok/s TG Prefill 6.452 · TTFT 3.073 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 15 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 382,25 tok/s TG Prefill 3.656 · TTFT 5.903 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 16 | gpt-oss-20b20BMXFP4OpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 378,51 tok/s TG Prefill 6.766 · TTFT 2.939 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 17 | gemma-4-E4B-it8BQ8_0Google PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 375,94 tok/s TG Prefill 6.660 · TTFT 2.979 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 18 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 375,87 tok/s TG Prefill 4.619 · TTFT 5.434 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 19 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 358,48 tok/s TG Prefill 4.148 · TTFT 5.814 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 20 | Qwen3-Coder-30B-A3B-Instruct30BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 344,35 tok/s TG Prefill 10.942 · TTFT 2.759 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 21 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 343,70 tok/s TG Prefill 9.999 · TTFT 3.230 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 22 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 339,73 tok/s TG Prefill 10.614 · TTFT 2.771 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 23 | Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 329,89 tok/s TG Prefill 5.097 · TTFT 30.395 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 24 | Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 327,48 tok/s TG Prefill 6.307 · TTFT 30.045 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 25 | Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 325,23 tok/s TG Prefill 3.265 · TTFT 32.856 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 26 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 300,99 tok/s TG Prefill 4.071 · TTFT 4.790 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 27 | Nemotron-3.5-Lightning-30B-A3B30BBF16NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 290,27 tok/s TG Prefill 35.719 · TTFT 1.015 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 28 | Qwen3.6-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 286,68 tok/s TG Prefill 4.535 · TTFT 4.311 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 29 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 286,24 tok/s TG Prefill 2.858 · TTFT 1.792 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 30 | gemma-4-E4B-it8BQ4_K_MGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 283,39 tok/s TG Prefill 6.346 · TTFT 1.565 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 31 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 281,80 tok/s TG Prefill 10.273 · TTFT 5.323 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 32 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 277,95 tok/s TG Prefill 8.575 · TTFT 597 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 33 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 277,39 tok/s TG Prefill 5.993 · TTFT 3.672 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 34 | Meta-Llama-3.1-8B-Instruct8BQ8_0Meta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 276,49 tok/s TG Prefill 9.874 · TTFT 3.124 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 35 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 275,72 tok/s TG Prefill 13.406 · TTFT 4.952 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 36 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 274,94 tok/s TG Prefill 6.188 · TTFT 6.209 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 37 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 273,62 tok/s TG Prefill 5.151 · TTFT 994 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 38 | gpt-oss-20b20BMXFP4OpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 273,57 tok/s TG Prefill 6.722 · TTFT 1.473 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 39 | Qwen3.6-35B-A3B35BQ8_0Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 271,41 tok/s TG Prefill 8.886 · TTFT 576 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 40 | Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 271,41 tok/s TG Prefill 8.886 · TTFT 0 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench | Details → | |
| 41 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 270,40 tok/s TG Prefill 6.824 · TTFT 750 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 42 | Qwen3-Coder-30B-A3B-Instruct30BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 266,26 tok/s TG Prefill 8.447 · TTFT 1.538 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 43 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 265,88 tok/s TG Prefill 2.862 · TTFT 894 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 44 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 262,22 tok/s TG Prefill 9.011 · TTFT 568 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 45 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 261,45 tok/s TG Prefill 4.824 · TTFT 6.145 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 46 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 260,59 tok/s TG Prefill 6.954 · TTFT 368 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 47 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 260,37 tok/s TG Prefill 8.681 · TTFT 1.498 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 48 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 256,65 tok/s TG Prefill 4.749 · TTFT 539 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 49 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 255,30 tok/s TG Prefill 5.644 · TTFT 6.016 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 50 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 254,56 tok/s TG Prefill 3.174 · TTFT 7.205 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 51 | gemma-4-E4B-it8BQ8_0Google PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 254,04 tok/s TG Prefill 6.450 · TTFT 1.538 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 52 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 253,13 tok/s TG Prefill 5.903 · TTFT 434 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 53 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 250,32 tok/s TG Prefill 5.865 · TTFT 3.782 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 54 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 248,17 tok/s TG Prefill 4.462 · TTFT 2.412 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 55 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 247,13 tok/s TG Prefill 9.886 · TTFT 518 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 56 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 244,04 tok/s TG Prefill 5.934 · TTFT 863 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 57 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 241,82 tok/s TG Prefill 7.918 · TTFT 647 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 58 | Qwen3.6-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,95 tok/s TG Prefill 4.270 · TTFT 2.268 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 59 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 237,04 tok/s TG Prefill 7.169 · TTFT 1.831 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 60 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 232,53 tok/s TG Prefill 7.614 · TTFT 336 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 61 | Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 229,95 tok/s TG Prefill 655 · TTFT 21.862 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 62 | Qwen3.8-27B27BFP8Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 229,39 tok/s TG Prefill 5.064 · TTFT 1.011 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cli | Details → | |
| 63 | Qwen3.6-35B-A3B35BQ8_0Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 226,35 tok/s TG Prefill 7.505 · TTFT 341 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 64 | Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 224,79 tok/s TG Prefill 606 · TTFT 26.540 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 65 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 222,82 tok/s TG Prefill 4.205 · TTFT 4.901 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 66 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 220,45 tok/s TG Prefill 4.107 · TTFT 5.581 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 67 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 219,79 tok/s TG Prefill 4.791 · TTFT 2.262 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 68 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 217,41 tok/s TG Prefill 2.159 · TTFT 4.552 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 69 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 216,85 tok/s TG Prefill 3.842 · TTFT 5.955 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 70 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 216,36 tok/s TG Prefill 8.015 · TTFT 319 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 71 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 216,16 tok/s TG Prefill 3.928 · TTFT 5.087 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 72 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 212,92 tok/s TG Prefill 3.795 · TTFT 6.753 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 73 | Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,79 tok/s TG Prefill 606 · TTFT 28.206 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 74 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 210,46 tok/s TG Prefill 6.833 · TTFT 375 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 75 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 210,36 tok/s TG Prefill 3.683 · TTFT 5.472 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 76 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 209,92 tok/s TG Prefill 3.882 · TTFT 2.491 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 77 | Nemotron-3-Nano-4B4BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 208,19 tok/s TG Prefill 6.153 · TTFT 3.583 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 78 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 207,55 tok/s TG Prefill 3.338 · TTFT 3.388 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 79 | Devstral-Small-2-24B-Instruct-251224BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 206,34 tok/s TG Prefill 5.938 · TTFT 44.987 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 80 | Devstral-Small-2-24B-Instruct-251224BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 206,26 tok/s TG Prefill 4.766 · TTFT 42.744 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 81 | Devstral-Small-250724BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,80 tok/s TG Prefill 7.519 · TTFT 31.654 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 82 | Devstral-Small-250724BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 205,12 tok/s TG Prefill 6.044 · TTFT 32.830 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 83 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 202,20 tok/s TG Prefill 5.476 · TTFT 468 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 84 | Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 201,46 tok/s TG Prefill 3.877 · TTFT 48.219 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 85 | Muse-Glimmer-30B30BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 199,09 tok/s TG Prefill 2.520 · TTFT 2.032 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 86 | Devstral-Small-2-24B-Instruct-251224BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 199,08 tok/s TG Prefill 3.016 · TTFT 51.389 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 87 | Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 198,80 tok/s TG Prefill 5.019 · TTFT 46.235 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 88 | Meta-Llama-3.1-8B-Instruct8BQ8_0Meta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 197,34 tok/s TG Prefill 6.940 · TTFT 1.849 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 89 | gemma-4-E2B-it5BQ4_K_MGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 194,48 tok/s TG Prefill 8.378 · TTFT 236 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 90 | Devstral-Small-250724BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 192,69 tok/s TG Prefill 3.898 · TTFT 37.605 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 91 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 192,66 tok/s TG Prefill 2.706 · TTFT 3.642 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 92 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 192,16 tok/s TG Prefill 2.755 · TTFT 3.564 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 93 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 192,04 tok/s TG Prefill 3.084 · TTFT 2.806 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 94 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,98 tok/s TG Prefill 4.071 · TTFT 5.658 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 95 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 188,35 tok/s TG Prefill 4.100 · TTFT 5.611 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 96 | Nemotron-3-Nano-4B4BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 187,29 tok/s TG Prefill 4.534 · TTFT 2.375 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 97 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 187,06 tok/s TG Prefill 2.824 · TTFT 3.499 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 98 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 186,28 tok/s TG Prefill 3.569 · TTFT 2.478 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 99 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 185,39 tok/s TG Prefill 3.957 · TTFT 2.535 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 100 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,45 tok/s TG Prefill 4.012 · TTFT 2.498 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 101 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,99 tok/s TG Prefill 3.958 · TTFT 2.533 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 102 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,97 tok/s TG Prefill 3.848 · TTFT 5.198 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 103 | Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,91 tok/s TG Prefill 2.336 · TTFT 55.212 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 104 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,74 tok/s TG Prefill 3.527 · TTFT 2.492 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 105 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,28 tok/s TG Prefill 3.620 · TTFT 2.799 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 106 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,01 tok/s TG Prefill 3.865 · TTFT 5.849 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 107 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 178,15 tok/s TG Prefill 3.106 · TTFT 7.058 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 108 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 173,97 tok/s TG Prefill 3.522 · TTFT 2.513 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 109 | Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 173,24 tok/s TG Prefill 4.852 · TTFT 8.741 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 110 | Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,87 tok/s TG Prefill 3.023 · TTFT 10.146 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 111 | Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,59 tok/s TG Prefill 6.061 · TTFT 8.390 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 112 | Nemotron-3.5-Lightning-30B-A3B30BBF16NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 170,48 tok/s TG Prefill 23.477 · TTFT 582 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 113 | Qwen3.5-122B-A10B122BGPTQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,57 tok/s TG Prefill 13.855 · TTFT 2.538 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 114 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 167,21 tok/s TG Prefill 3.497 · TTFT 6.460 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 115 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 166,48 tok/s TG Prefill 4.080 · TTFT 529 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 116 | gpt-oss-20b20BMXFP4OpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 165,76 tok/s TG Prefill 5.419 · TTFT 365 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 117 | Qwen3.6-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 165,40 tok/s TG Prefill 1.938 · TTFT 60.555 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 118 | Qwen3.6-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 164,46 tok/s TG Prefill 1.637 · TTFT 62.197 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 119 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 163,57 tok/s TG Prefill 260 · TTFT 122.321 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 120 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 162,73 tok/s TG Prefill 260 · TTFT 122.965 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 121 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 162,66 tok/s TG Prefill 262 · TTFT 121.770 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 122 | Qwen3-Coder-30B-A3B-Instruct30BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 161,57 tok/s TG Prefill 5.583 · TTFT 437 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 123 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 160,98 tok/s TG Prefill 5.616 · TTFT 434 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 124 | Qwen3-Omni-30B-A3B-Thinking30BAWQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 160,64 tok/s TG Prefill 13.528 · TTFT 3.190 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 125 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 160,21 tok/s TG Prefill 2.383 · TTFT 10.663 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 126 | Mistral-Small-3.1-24B-Instruct-250324BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,85 tok/s TG Prefill 3.304 · TTFT 8.318 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 127 | Qwen3.6-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,77 tok/s TG Prefill 1.098 · TTFT 68.122 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 128 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,57 tok/s TG Prefill 2.376 · TTFT 10.673 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 129 | Muse-Glimmer-30B30BQ8_0Meta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 159,55 tok/s TG Prefill 3.112 · TTFT 1.645 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 130 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 157,01 tok/s TG Prefill 4.273 · TTFT 508 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 131 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,95 tok/s TG Prefill 3.643 · TTFT 6.292 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 132 | Laguna-XS-2.1INT4Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,26 tok/s TG Prefill 10.264 · TTFT 3.946 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 133 | gemma-4-E2B-it5BQ8_0Google PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 153,69 tok/s TG Prefill 8.308 · TTFT 239 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 134 | Nemotron-3-Nano-30B-A3B30BBF16NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,33 tok/s TG Prefill 23.508 · TTFT 1.417 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 135 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 147,82 tok/s TG Prefill 3.534 · TTFT 555 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 136 | gpt-oss-20b20BQ4_K_MOpenAI Performancebenchmark i | 147,82 tok/s TG Prefill 3.534 · TTFT 555 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 137 | Qwen3.8-27B27BAWQ-INT4Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,44 tok/s TG Prefill 6.889 · TTFT 4.782 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 138 | Qwen3.8-27B27BFP8Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 144,27 tok/s TG Prefill 5.193 · TTFT 493 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cli | Details → | |
| 139 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 143,90 tok/s TG Prefill 4.229 · TTFT 464 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 140 | gpt-oss-20b20BQ4_K_MOpenAI Performancebenchmark i | 143,90 tok/s TG Prefill 4.229 · TTFT 464 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 141 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 141,11 tok/s TG Prefill 1.831 · TTFT 16.128 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 142 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,75 tok/s TG Prefill 3.025 · TTFT 712 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 143 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 137,66 tok/s TG Prefill 4.422 · TTFT 445 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 144 | gpt-oss-20b20BQ4_K_MOpenAI Performancebenchmark i | 137,66 tok/s TG Prefill 4.422 · TTFT 445 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 145 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 136,24 tok/s TG Prefill 3.620 · TTFT 595 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 146 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 131,42 tok/s TG Prefill 2.111 · TTFT 5.856 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 147 | Qwen3.6-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 131,05 tok/s TG Prefill 3.671 · TTFT 526 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 148 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 129,52 tok/s TG Prefill 3.211 · TTFT 671 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 149 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 127,39 tok/s TG Prefill 1.511 · TTFT 3.388 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 150 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 125,69 tok/s TG Prefill 1.771 · TTFT 1.085 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 151 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 125,29 tok/s TG Prefill 2.467 · TTFT 4.937 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 152 | Nemotron-3-Nano-4B4BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 124,60 tok/s TG Prefill 4.092 · TTFT 528 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 153 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,37 tok/s TG Prefill 269 · TTFT 141.283 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 154 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,13 tok/s TG Prefill 269 · TTFT 141.200 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 155 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,08 tok/s TG Prefill 272 · TTFT 140.873 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 156 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,93 tok/s TG Prefill 270 · TTFT 141.290 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 157 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,92 tok/s TG Prefill 269 · TTFT 140.690 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 158 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,82 tok/s TG Prefill 269 · TTFT 141.070 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 159 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 121,30 tok/s TG Prefill 2.872 · TTFT 178 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 160 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,28 tok/s TG Prefill 271 · TTFT 141.620 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 161 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,14 tok/s TG Prefill 268 · TTFT 141.582 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 162 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 120,98 tok/s TG Prefill 269 · TTFT 141.455 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 163 | gemma-4-E4B-it8BQ4_K_MGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 119,55 tok/s TG Prefill 5.239 · TTFT 378 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 164 | Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 118,51 tok/s TG Prefill 482 · TTFT 2.854 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 165 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 117,63 tok/s TG Prefill 1.021 · TTFT 14.961 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 166 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 113,57 tok/s TG Prefill 2.783 · TTFT 184 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 167 | Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 112,02 tok/s TG Prefill 553 · TTFT 3.143 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 168 | Magistral-Small-250924BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 111,95 tok/s TG Prefill 473 · TTFT 3.796 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 169 | Devstral-Small-250724BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,40 tok/s TG Prefill 6.025 · TTFT 9.558 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 170 | Devstral-Small-250724BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,11 tok/s TG Prefill 4.704 · TTFT 10.335 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 171 | Devstral-Small-2-24B-Instruct-251224BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,78 tok/s TG Prefill 3.792 · TTFT 12.949 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 172 | Devstral-Small-2-24B-Instruct-251224BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,16 tok/s TG Prefill 4.914 · TTFT 12.245 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 173 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 108,12 tok/s TG Prefill 2.777 · TTFT 184 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 174 | Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,89 tok/s TG Prefill 3.707 · TTFT 13.889 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 175 | Nemotron-Cascade-2-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 107,87 tok/s TG Prefill 3.141 · TTFT 690 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 176 | Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,69 tok/s TG Prefill 4.844 · TTFT 12.709 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 177 | Seed-OSS-36B-Instruct36BQ4_K_MByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,25 tok/s TG Prefill 1.621 · TTFT 14.654 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 178 | gpt-oss-120b120BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,02 tok/s TG Prefill 173 · TTFT 186.661 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 179 | Qwen3.8-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 106,96 tok/s TG Prefill 2.955 · TTFT 1.733 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 180 | gpt-oss-120b120BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,85 tok/s TG Prefill 172 · TTFT 186.714 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 181 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,46 tok/s TG Prefill 2.518 · TTFT 762 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 182 | Nemotron-3.5-Lightning-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 105,94 tok/s TG Prefill 2.835 · TTFT 181 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 183 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,88 tok/s TG Prefill 2.728 · TTFT 789 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 184 | gpt-oss-120b120BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 105,39 tok/s TG Prefill 170 · TTFT 189.655 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 185 | Devstral-Small-2-24B-Instruct-251224BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,92 tok/s TG Prefill 2.267 · TTFT 15.348 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 186 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,78 tok/s TG Prefill 284 · TTFT 139.519 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 187 | Qwen3.8-27B27BAWQ-INT4Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,34 tok/s TG Prefill 3.766 · TTFT 8.416 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 188 | GLM-4.5-Air106BQ4_K_MZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 104,08 tok/s TG Prefill 2.674 · TTFT 8.272 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 189 | Devstral-Small-250724BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,69 tok/s TG Prefill 2.847 · TTFT 13.024 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 190 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,53 tok/s TG Prefill 283 · TTFT 140.845 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 191 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,21 tok/s TG Prefill 2.393 · TTFT 803 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 192 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 103,17 tok/s TG Prefill 1.484 · TTFT 1.725 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 193 | Ornith-1.0-35B35BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 103,11 tok/s TG Prefill 282 · TTFT 141.242 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 194 | Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 102,89 tok/s TG Prefill 3.111 · TTFT 692 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 195 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,63 tok/s TG Prefill 266 · TTFT 144.911 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 196 | Laguna-XS-2.1Q4_K_MPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,53 tok/s TG Prefill 311 · TTFT 161.346 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 197 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 102,47 tok/s TG Prefill 4.866 · TTFT 508 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 198 | Nemotron-3-Nano-30B-A3B30BBF16NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,46 tok/s TG Prefill 10.458 · TTFT 1.708 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 199 | Laguna-XS-2.1Q4_K_MPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,20 tok/s TG Prefill 309 · TTFT 162.437 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 200 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,00 tok/s TG Prefill 264 · TTFT 145.506 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 201 | Laguna-XS-2.1Q4_K_MPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,58 tok/s TG Prefill 308 · TTFT 162.990 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 202 | Codestral-22B-v0.122BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,58 tok/s TG Prefill 2.196 · TTFT 16.679 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 203 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 101,05 tok/s TG Prefill 268 · TTFT 145.152 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 204 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,84 tok/s TG Prefill 268 · TTFT 146.060 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 205 | Qwen3.5-122B-A10B122BGPTQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,64 tok/s TG Prefill 10.369 · TTFT 1.153 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 206 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,45 tok/s TG Prefill 265 · TTFT 146.219 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 207 | Qwen3-Omni-30B-A3B-Thinking30BAWQQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,28 tok/s TG Prefill 10.572 · TTFT 1.487 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 208 | Qwen3.5-35B-A3B35BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,21 tok/s TG Prefill 266 · TTFT 147.297 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 209 | Nemotron-3-Nano-30B-A3B30BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,92 tok/s TG Prefill 2.124 · TTFT 903 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 210 | Qwen3.6-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,85 tok/s TG Prefill 266 · TTFT 147.215 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 211 | Qwen3.8-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 99,82 tok/s TG Prefill 1.006 · TTFT 5.090 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 212 | gpt-oss-120b120BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 99,77 tok/s TG Prefill 1.920 · TTFT 1.022 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 213 | gpt-oss-120b120BQ4_K_MOpenAI Performancebenchmark i | 99,77 tok/s TG Prefill 1.920 · TTFT 1.022 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 214 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,65 tok/s TG Prefill 266 · TTFT 147.433 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 215 | Qwen-AgentWorld-35B-A3B35BUD-Q4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,59 tok/s TG Prefill 264 · TTFT 148.312 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 216 | Qwen3-Coder-30B-A3B-Instruct30BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,95 tok/s TG Prefill 2.674 · TTFT 916 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 217 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,79 tok/s TG Prefill 1.311 · TTFT 9.807 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 218 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 97,61 tok/s TG Prefill 2.827 · TTFT 862 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 219 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) Performancebenchmark i | 97,61 tok/s TG Prefill 2.827 · TTFT 862 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 220 | Qwen3.8-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 97,18 tok/s TG Prefill 2.418 · TTFT 2.117 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 221 | Qwen3.8-27B27BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 95,78 tok/s TG Prefill 1.777 · TTFT 2.881 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 222 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,93 tok/s TG Prefill 206 · TTFT 56.638 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 223 | Qwen3.8-27B27BQ8_0Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 94,76 tok/s TG Prefill 3.651 · TTFT 1.402 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 224 | Mistral-Small-3.1-24B-Instruct-250324BQ4_K_MMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,61 tok/s TG Prefill 2.657 · TTFT 4.592 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 225 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,39 tok/s TG Prefill 208 · TTFT 56.248 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 226 | Seed-OSS-36B-Instruct36BQ4_K_MByteDance Seed PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 93,75 tok/s TG Prefill 2.324 · TTFT 9.824 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 227 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 93,53 tok/s TG Prefill 2.671 · TTFT 192 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 228 | Nemotron-3-Nano-4B4BQ4_K_MNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 93,42 tok/s TG Prefill 2.630 · TTFT 822 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 229 | Ornith-1.0-9B9BQ4_K_MDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 93,36 tok/s TG Prefill 3.523 · TTFT 547 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 230 | gpt-oss-20b20BQ4_K_MOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,91 tok/s TG Prefill 206 · TTFT 56.755 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 231 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 91,48 tok/s TG Prefill 3.221 · TTFT 159 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 232 | Qwen3-30B-A3B-Thinking-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 91,39 tok/s TG Prefill 4.034 · TTFT 603 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 233 | Qwen3-30B-A3B-Thinking-250730BQ4_K_MQwen (Alibaba) Performancebenchmark i | 91,39 tok/s TG Prefill 4.034 · TTFT 603 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 234 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 90,98 tok/s TG Prefill 4.283 · TTFT 569 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 235 | Qwen3-30B-A3B-Instruct-250730BQ4_K_MQwen (Alibaba) Performancebenchmark i | 90,98 tok/s TG Prefill 4.283 · TTFT 569 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 236 | Nemotron-3.5-Lightning-30B-A3B30BQ8_0NVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 90,81 tok/s TG Prefill 3.309 · TTFT 155 ms | 1× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 237 | Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performancebenchmark i | 89,84 tok/s TG Prefill 4.031 · TTFT 605 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 238 | Ling-3.0-flash127.5BQ4_K_MinclusionAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,35 tok/s TG Prefill 1.608 · TTFT 8.030 ms | 5× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 239 | Laguna-XS-2.1INT4Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 88,90 tok/s TG Prefill 7.618 · TTFT 2.214 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | Details → | |
| 240 | Qwen3.8-27B27BQ8_0Qwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 88,86 tok/s TG Prefill 1.184 · TTFT 4.324 ms | 10× | 4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCm | Details → | |
| 241 | Qwen3-30B-A3B-Thinking-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 88,58 tok/s TG Prefill 4.831 · TTFT 503 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 242 | Qwen3-30B-A3B-Thinking-250730BQ4_K_MQwen (Alibaba) Performancebenchmark i | 88,58 tok/s TG Prefill 4.831 · TTFT 503 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 243 | Qwen3-Coder-30B-A3B-Instruct30BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 88,22 tok/s TG Prefill 5.195 · TTFT 470 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 244 | Qwen3-Coder-30B-A3B-Instruct30BQ4_K_MQwen (Alibaba) Performancebenchmark i | 88,22 tok/s TG Prefill 5.195 · TTFT 470 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 245 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 87,92 tok/s TG Prefill 4.116 · TTFT 600 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 246 | Qwen3-30B-A3B-Thinking-250730BQ4_K_MQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 87,84 tok/s TG Prefill 2.455 · TTFT 1.018 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 247 | Qwen3-30B-A3B-Thinking-250730BQ4_K_MQwen (Alibaba) Performancebenchmark i | 87,84 tok/s TG Prefill 2.455 · TTFT 1.018 ms | 1× | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclaw | Details → | |
| 248 | North-Mini-Code-1.0Q4_K_MCohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 87,33 tok/s TG Prefill 3.234 · TTFT 648 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → | |
| 249 | gemma-4-E4B-it8BQ8_0Google PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) i | 87,28 tok/s TG Prefill 5.229 · TTFT 378 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli | Details → | |
| 250 | Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 87,03 tok/s TG Prefill 3.930 · TTFT 629 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclaw | Details → |