Created bymario-alka.dePowered bynoob2claw.detricoma.de
⚡
Performance benchmark

How fast is the model?

Raw throughput on real hardware – how many tokens a model generates per second, how quickly it processes the prompt and how short the time to first token is. Higher is better.

⚡ Generation (tok/s)🔄 Prefill⏱️ TTFT👥 Concurrency
Reset
Metric:
Size
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.743,96 tok/s TG
Prefill 13.641 · TTFT 5.790 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
2gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.743,14 tok/s TG
Prefill 12.148 · TTFT 5.881 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
3gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,46 tok/s TG
Prefill 31.452 · TTFT 1.633 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
4gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.210,29 tok/s TG
Prefill 9.745 · TTFT 8.399 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
5NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.196,98 tok/s TG
Prefill 6.074 · TTFT 10.280 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
6gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.082,39 tok/s TG
Prefill 6.941 · TTFT 9.659 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
7gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.022,79 tok/s TG
Prefill 18.744 · TTFT 2.204 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
8Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.009,04 tok/s TG
Prefill 4.090 · TTFT 12.734 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
9gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
973,54 tok/s TG
Prefill 23.599 · TTFT 460 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
10gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
971,35 tok/s TG
Prefill 9.983 · TTFT 2.015 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
11gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
969,62 tok/s TG
Prefill 12.437 · TTFT 1.852 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
12Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
913,39 tok/s TG
Prefill 8.119 · TTFT 11.247 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
13Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
883,39 tok/s TG
Prefill 5.377 · TTFT 12.467 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
14Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
717,61 tok/s TG
Prefill 52.503 · TTFT 1.022 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
15gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
710,36 tok/s TG
Prefill 8.954 · TTFT 2.695 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
16gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
702,86 tok/s TG
Prefill 5.157 · TTFT 6.385 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
17Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
696,81 tok/s TG
Prefill 41.362 · TTFT 722 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
18gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
677,50 tok/s TG
Prefill 2.978 · TTFT 18.549 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
19NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
676,42 tok/s TG
Prefill 5.367 · TTFT 3.579 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
20gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
616,01 tok/s TG
Prefill 13.778 · TTFT 803 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
21gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
592,13 tok/s TG
Prefill 5.662 · TTFT 3.385 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
22Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
590,01 tok/s TG
Prefill 5.490 · TTFT 17.999 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
23Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
585,92 tok/s TG
Prefill 3.535 · TTFT 4.487 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
24SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
531,74 tok/s TG
Prefill 44.141 · TTFT 1.002 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
25gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
505,77 tok/s TG
Prefill 5.745 · TTFT 7.265 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
26Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
497,64 tok/s TG
Prefill 8.340 · TTFT 5.360 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQ
27Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
495,51 tok/s TG
Prefill 19.609 · TTFT 628 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
28Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
489,71 tok/s TG
Prefill 8.631 · TTFT 3.252 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
29gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
486,20 tok/s TG
Prefill 4.345 · TTFT 5.863 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
30Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
479,20 tok/s TG
Prefill 40.760 · TTFT 356 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
31Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
468,61 tok/s TG
Prefill 4.836 · TTFT 11.175 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
32Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
468,02 tok/s TG
Prefill 4.949 · TTFT 4.084 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
33Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
465,73 tok/s TG
Prefill 23.398 · TTFT 1.915 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
34gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
465,47 tok/s TG
Prefill 8.435 · TTFT 2.408 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
35gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
455,35 tok/s TG
Prefill 8.245 · TTFT 2.462 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
36Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
451,00 tok/s TG
Prefill 3.878 · TTFT 14.664 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
37Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
450,54 tok/s TG
Prefill 3.632 · TTFT 14.999 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
38Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
447,00 tok/s TG
Prefill 3.645 · TTFT 15.139 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
39Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
445,18 tok/s TG
Prefill 19.926 · TTFT 1.357 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
40Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
443,74 tok/s TG
Prefill 31.085 · TTFT 445 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
41Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
442,02 tok/s TG
Prefill 16.333 · TTFT 3.286 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
42Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
419,38 tok/s TG
Prefill 11.768 · TTFT 2.673 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
43Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
418,31 tok/s TG
Prefill 11.855 · TTFT 2.651 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
44Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
404,99 tok/s TG
Prefill 14.538 · TTFT 2.823 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
45Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
387,65 tok/s TG
Prefill 32.764 · TTFT 2.280 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
46Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
384,19 tok/s TG
Prefill 49.306 · TTFT 1.939 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
47gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
360,92 tok/s TG
Prefill 2.636 · TTFT 6.319 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
48Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
360,12 tok/s TG
Prefill 19.755 · TTFT 1.579 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
49Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
358,15 tok/s TG
Prefill 19.410 · TTFT 1.565 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
50gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
357,72 tok/s TG
Prefill 4.799 · TTFT 4.228 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
51Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
355,86 tok/s TG
Prefill 24.866 · TTFT 2.634 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
52gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
347,49 tok/s TG
Prefill 4.656 · TTFT 4.348 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
53gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
344,13 tok/s TG
Prefill 3.766 · TTFT 5.354 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
54gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
343,93 tok/s TG
Prefill 2.544 · TTFT 7.919 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
55SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
338,72 tok/s TG
Prefill 33.135 · TTFT 574 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
56gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
331,51 tok/s TG
Prefill 6.908 · TTFT 1.433 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
57gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
329,94 tok/s TG
Prefill 3.647 · TTFT 5.519 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
58Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
326,73 tok/s TG
Prefill 13.426 · TTFT 1.202 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
59Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
324,87 tok/s TG
Prefill 7.451 · TTFT 4.042 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
60gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
323,15 tok/s TG
Prefill 3.285 · TTFT 3.021 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
61Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
323,12 tok/s TG
Prefill 5.337 · TTFT 5.911 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
62gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
322,89 tok/s TG
Prefill 27.208 · TTFT 972 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
63Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
322,77 tok/s TG
Prefill 5.717 · TTFT 5.160 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
64Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
321,67 tok/s TG
Prefill 7.148 · TTFT 4.460 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
65Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
320,40 tok/s TG
Prefill 19.188 · TTFT 3.026 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
66gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
319,92 tok/s TG
Prefill 3.167 · TTFT 3.125 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
67Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
319,02 tok/s TG
Prefill 1.498 · TTFT 42.331 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
68Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,94 tok/s TG
Prefill 1.446 · TTFT 42.781 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
69Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,66 tok/s TG
Prefill 5.742 · TTFT 2.122 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQ
70Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,54 tok/s TG
Prefill 19.091 · TTFT 830 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
71Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,47 tok/s TG
Prefill 1.427 · TTFT 42.816 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
72Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,18 tok/s TG
Prefill 9.348 · TTFT 1.524 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
73Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,17 tok/s TG
Prefill 1.479 · TTFT 42.546 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
74gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
316,40 tok/s TG
Prefill 7.121 · TTFT 1.391 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
75Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
316,35 tok/s TG
Prefill 1.470 · TTFT 42.801 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
76Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
316,28 tok/s TG
Prefill 1.496 · TTFT 42.551 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
77gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
315,66 tok/s TG
Prefill 3.728 · TTFT 2.722 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
78Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
315,53 tok/s TG
Prefill 2.703 · TTFT 7.505 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
79Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
315,16 tok/s TG
Prefill 13.007 · TTFT 3.960 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
80gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
314,82 tok/s TG
Prefill 4.224 · TTFT 2.350 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
81Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
314,14 tok/s TG
Prefill 15.050 · TTFT 825 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
82Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
314,04 tok/s TG
Prefill 7.502 · TTFT 4.050 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
83North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
312,72 tok/s TG
Prefill 4.146 · TTFT 5.378 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
84Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
312,21 tok/s TG
Prefill 5.010 · TTFT 5.594 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
85gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
310,59 tok/s TG
Prefill 4.175 · TTFT 2.376 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
86Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
309,02 tok/s TG
Prefill 1.120 · TTFT 42.243 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
87gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
306,90 tok/s TG
Prefill 2.293 · TTFT 4.306 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
88Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
305,48 tok/s TG
Prefill 10.848 · TTFT 2.513 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
89Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
305,38 tok/s TG
Prefill 5.073 · TTFT 5.334 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
90Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
303,14 tok/s TG
Prefill 7.263 · TTFT 4.140 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
91Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
301,98 tok/s TG
Prefill 19.406 · TTFT 1.945 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
92Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
301,64 tok/s TG
Prefill 7.030 · TTFT 4.327 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
93Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
300,93 tok/s TG
Prefill 6.663 · TTFT 4.522 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
94Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
296,15 tok/s TG
Prefill 4.336 · TTFT 4.376 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
95Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
294,88 tok/s TG
Prefill 9.401 · TTFT 1.516 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
96Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
293,98 tok/s TG
Prefill 2.069 · TTFT 9.136 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
97Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
289,48 tok/s TG
Prefill 11.717 · TTFT 3.710 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
98Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
280,80 tok/s TG
Prefill 8.760 · TTFT 5.247 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
99gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,96 tok/s TG
Prefill 4.128 · TTFT 2.405 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
100Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,88 tok/s TG
Prefill 6.465 · TTFT 4.568 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
101Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,01 tok/s TG
Prefill 11.575 · TTFT 1.408 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
102Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,95 tok/s TG
Prefill 7.786 · TTFT 4.143 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
103North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,90 tok/s TG
Prefill 3.500 · TTFT 5.729 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
104gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,28 tok/s TG
Prefill 9.272 · TTFT 213 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
105gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,10 tok/s TG
Prefill 4.691 · TTFT 4.615 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
106Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
272,78 tok/s TG
Prefill 1.270 · TTFT 14.950 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
107Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,15 tok/s TG
Prefill 1.523 · TTFT 12.453 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
108gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,11 tok/s TG
Prefill 4.998 · TTFT 4.486 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
109Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
267,70 tok/s TG
Prefill 6.847 · TTFT 4.383 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
110Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
264,15 tok/s TG
Prefill 7.432 · TTFT 4.406 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
111gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
263,50 tok/s TG
Prefill 3.150 · TTFT 4.792 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
112NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
263,34 tok/s TG
Prefill 784 · TTFT 55.800 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
113Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,93 tok/s TG
Prefill 8.472 · TTFT 4.535 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
114Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,45 tok/s TG
Prefill 811 · TTFT 55.388 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
115Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,44 tok/s TG
Prefill 822 · TTFT 55.319 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
116Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
261,39 tok/s TG
Prefill 10.101 · TTFT 2.985 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
117Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
260,24 tok/s TG
Prefill 38.946 · TTFT 372 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
118Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
260,23 tok/s TG
Prefill 6.946 · TTFT 3.919 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
119Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,36 tok/s TG
Prefill 5.960 · TTFT 5.584 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
120Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,25 tok/s TG
Prefill 6.921 · TTFT 4.438 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
121Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
257,54 tok/s TG
Prefill 4.819 · TTFT 6.626 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
122Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
254,59 tok/s TG
Prefill 7.497 · TTFT 4.296 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
123Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,98 tok/s TG
Prefill 19.902 · TTFT 780 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
124gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,35 tok/s TG
Prefill 5.135 · TTFT 1.933 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
125Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
252,00 tok/s TG
Prefill 26.134 · TTFT 576 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
126Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
251,08 tok/s TG
Prefill 5.146 · TTFT 6.222 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
127Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,30 tok/s TG
Prefill 3.039 · TTFT 6.513 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
128Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
246,82 tok/s TG
Prefill 4.686 · TTFT 6.831 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
129Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
245,10 tok/s TG
Prefill 5.881 · TTFT 4.862 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
130Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
244,12 tok/s TG
Prefill 2.809 · TTFT 7.040 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
131Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
243,73 tok/s TG
Prefill 13.492 · TTFT 181 ms
1×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
132Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
243,46 tok/s TG
Prefill 2.311 · TTFT 25.408 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_M
133Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
242,44 tok/s TG
Prefill 3.921 · TTFT 5.712 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
134gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
242,32 tok/s TG
Prefill 6.971 · TTFT 284 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
135Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
241,23 tok/s TG
Prefill 15.447 · TTFT 931 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
136Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
241,10 tok/s TG
Prefill 5.388 · TTFT 5.855 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
137Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
239,26 tok/s TG
Prefill 2.309 · TTFT 8.469 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
138gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
238,53 tok/s TG
Prefill 6.897 · TTFT 1.885 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
139Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
237,33 tok/s TG
Prefill 4.217 · TTFT 5.319 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
140Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
235,51 tok/s TG
Prefill 2.971 · TTFT 16.110 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
141Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
235,12 tok/s TG
Prefill 3.475 · TTFT 6.384 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
142NVIDIA-Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,69 tok/s TG
Prefill 2.376 · TTFT 950 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
143Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,01 tok/s TG
Prefill 6.125 · TTFT 5.956 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
144Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
230,12 tok/s TG
Prefill 5.654 · TTFT 2.560 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
145gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
228,18 tok/s TG
Prefill 11.075 · TTFT 179 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
146Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
228,11 tok/s TG
Prefill 5.935 · TTFT 2.341 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
147Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,98 tok/s TG
Prefill 3.204 · TTFT 3.127 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
148Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,87 tok/s TG
Prefill 3.972 · TTFT 7.112 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
149Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,73 tok/s TG
Prefill 2.419 · TTFT 11.596 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
150Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,39 tok/s TG
Prefill 3.401 · TTFT 2.949 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
151gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,27 tok/s TG
Prefill 3.118 · TTFT 3.181 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
152Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
224,25 tok/s TG
Prefill 3.178 · TTFT 3.153 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
153Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
224,00 tok/s TG
Prefill 10.578 · TTFT 1.518 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
154Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
223,82 tok/s TG
Prefill 3.920 · TTFT 3.793 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
155Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
223,59 tok/s TG
Prefill 2.319 · TTFT 10.040 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
156Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
222,74 tok/s TG
Prefill 5.246 · TTFT 5.445 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
157Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
221,06 tok/s TG
Prefill 15.907 · TTFT 999 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
158Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
220,46 tok/s TG
Prefill 5.841 · TTFT 2.373 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
159Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
220,09 tok/s TG
Prefill 4.004 · TTFT 7.026 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
160Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,94 tok/s TG
Prefill 5.830 · TTFT 2.480 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
161Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,82 tok/s TG
Prefill 3.287 · TTFT 5.954 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
162Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,77 tok/s TG
Prefill 1.680 · TTFT 11.308 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
163Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,88 tok/s TG
Prefill 3.836 · TTFT 3.241 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
164gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 1.128 · TTFT 8.806 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
165Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
214,82 tok/s TG
Prefill 3.547 · TTFT 7.908 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
166Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
213,88 tok/s TG
Prefill 16.055 · TTFT 898 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
167Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
213,50 tok/s TG
Prefill 5.805 · TTFT 2.392 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
168North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
213,37 tok/s TG
Prefill 3.510 · TTFT 2.952 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
169gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
212,89 tok/s TG
Prefill 638 · TTFT 31.124 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
170Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
212,47 tok/s TG
Prefill 1.988 · TTFT 11.157 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
171Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
212,06 tok/s TG
Prefill 5.466 · TTFT 2.536 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
172Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,94 tok/s TG
Prefill 5.476 · TTFT 2.426 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
173Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,78 tok/s TG
Prefill 3.317 · TTFT 6.868 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
174Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,46 tok/s TG
Prefill 2.663 · TTFT 8.403 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
175Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,36 tok/s TG
Prefill 8.014 · TTFT 1.554 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
176Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,00 tok/s TG
Prefill 4.544 · TTFT 2.942 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
177gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,75 tok/s TG
Prefill 1.247 · TTFT 16.274 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
178gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,69 tok/s TG
Prefill 4.186 · TTFT 4.508 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
179gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,09 tok/s TG
Prefill 646 · TTFT 30.756 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
180Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,03 tok/s TG
Prefill 11.184 · TTFT 257 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
181Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
207,89 tok/s TG
Prefill 6.462 · TTFT 4.062 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawQ4_K_M
182Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
207,68 tok/s TG
Prefill 2.458 · TTFT 4.035 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
183Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,56 tok/s TG
Prefill 5.340 · TTFT 2.489 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
184Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,48 tok/s TG
Prefill 3.217 · TTFT 7.108 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
185North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,68 tok/s TG
Prefill 3.174 · TTFT 3.129 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
186Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,50 tok/s TG
Prefill 1.351 · TTFT 15.992 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
187Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,12 tok/s TG
Prefill 5.797 · TTFT 5.426 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
188Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,02 tok/s TG
Prefill 1.348 · TTFT 16.034 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawINT4
189Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,02 tok/s TG
Prefill 1.327 · TTFT 16.066 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
190Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,64 tok/s TG
Prefill 13.127 · TTFT 2.817 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
191Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,44 tok/s TG
Prefill 1.300 · TTFT 16.378 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
192Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,31 tok/s TG
Prefill 1.375 · TTFT 15.932 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
193Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,28 tok/s TG
Prefill 2.468 · TTFT 9.078 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
194Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,26 tok/s TG
Prefill 2.556 · TTFT 8.711 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_M
195Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,18 tok/s TG
Prefill 5.112 · TTFT 2.507 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
196Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
203,52 tok/s TG
Prefill 4.756 · TTFT 2.908 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
197Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
203,41 tok/s TG
Prefill 1.372 · TTFT 16.012 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
198gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,99 tok/s TG
Prefill 1.186 · TTFT 16.972 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
199Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,53 tok/s TG
Prefill 2.489 · TTFT 8.976 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
200Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,38 tok/s TG
Prefill 4.258 · TTFT 2.272 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
201Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,02 tok/s TG
Prefill 13.392 · TTFT 2.808 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
202Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
200,47 tok/s TG
Prefill 5.590 · TTFT 2.527 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
203Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
199,74 tok/s TG
Prefill 5.200 · TTFT 2.539 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
204Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,63 tok/s TG
Prefill 5.420 · TTFT 2.546 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
205Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,58 tok/s TG
Prefill 3.095 · TTFT 3.242 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
206Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,18 tok/s TG
Prefill 7.101 · TTFT 2.296 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
207Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,83 tok/s TG
Prefill 4.807 · TTFT 2.927 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
208Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,82 tok/s TG
Prefill 3.730 · TTFT 3.658 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
209Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
195,94 tok/s TG
Prefill 3.019 · TTFT 3.323 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
210Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
194,91 tok/s TG
Prefill 2.312 · TTFT 11.972 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
211Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
194,77 tok/s TG
Prefill 3.434 · TTFT 3.848 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
212Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
194,68 tok/s TG
Prefill 1.934 · TTFT 12.719 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
213Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
194,57 tok/s TG
Prefill 2.108 · TTFT 4.741 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
214Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
193,40 tok/s TG
Prefill 2.117 · TTFT 4.707 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
215Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
192,64 tok/s TG
Prefill 2.920 · TTFT 3.432 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
216gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,85 tok/s TG
Prefill 1.344 · TTFT 15.099 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
217Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,84 tok/s TG
Prefill 5.308 · TTFT 2.484 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
218Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,23 tok/s TG
Prefill 1.903 · TTFT 11.602 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
219gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,79 tok/s TG
Prefill 3.528 · TTFT 2.818 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
220Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,57 tok/s TG
Prefill 4.215 · TTFT 6.476 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
221Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,39 tok/s TG
Prefill 14.992 · TTFT 1.125 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
222Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,07 tok/s TG
Prefill 3.110 · TTFT 638 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
223gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,89 tok/s TG
Prefill 3.739 · TTFT 2.671 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
224Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,33 tok/s TG
Prefill 1.184 · TTFT 17.577 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
225gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,26 tok/s TG
Prefill 21.013 · TTFT 558 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
226Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
186,86 tok/s TG
Prefill 3.200 · TTFT 3.133 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0
227Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
185,99 tok/s TG
Prefill 3.624 · TTFT 3.860 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
228Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,78 tok/s TG
Prefill 1.567 · TTFT 7.199 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_M
229Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,38 tok/s TG
Prefill 940 · TTFT 16.001 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
230Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,04 tok/s TG
Prefill 1.777 · TTFT 5.487 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_M
231Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
183,53 tok/s TG
Prefill 1.935 · TTFT 5.145 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_M
232Muse-Glimmer-30B29.8Bmeta-models Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
182,69 tok/s TG
Prefill 1.099 · TTFT 18.308 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
233Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
182,16 tok/s TG
Prefill 1.440 · TTFT 6.875 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
234Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
182,10 tok/s TG
Prefill 1.903 · TTFT 6.524 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
235Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
179,04 tok/s TG
Prefill 2.033 · TTFT 4.903 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
236Qwen2.5-32B-Instruct32.8BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
179,02 tok/s TG
Prefill 3.915 · TTFT 10.290 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
237Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,74 tok/s TG
Prefill 9.274 · TTFT 1.816 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
238Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,53 tok/s TG
Prefill 3.756 · TTFT 10.700 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawAWQ
239Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,27 tok/s TG
Prefill 8.322 · TTFT 1.724 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
240Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
177,66 tok/s TG
Prefill 7.172 · TTFT 5.181 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQ
241Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
175,20 tok/s TG
Prefill 3.098 · TTFT 3.204 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
242Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
172,91 tok/s TG
Prefill 2.730 · TTFT 3.618 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
243Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
172,69 tok/s TG
Prefill 2.964 · TTFT 3.184 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
244Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,96 tok/s TG
Prefill 2.383 · TTFT 4.068 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
245gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,69 tok/s TG
Prefill 2.902 · TTFT 11.434 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
246North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
168,98 tok/s TG
Prefill 1.029 · TTFT 69.564 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_M
247Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
168,28 tok/s TG
Prefill 3.412 · TTFT 2.850 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
248Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
167,79 tok/s TG
Prefill 1.706 · TTFT 11.878 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
249Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
165,72 tok/s TG
Prefill 4.638 · TTFT 2.673 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
250Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
165,70 tok/s TG
Prefill 2.126 · TTFT 11.893 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M