Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Ranglisten

LLM Leaderboard

Filtere reale Messergebnisse nach Benchmarktyp und Systemkonfiguration.

Reset
#Modell / HerstellerTypMesswerteGPU / CPU / RAMRuntimeDatum
1gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
147,82 tok/s
Prefill 3.534 · TTFT 555 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
2gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
143,90 tok/s
Prefill 4.229 · TTFT 464 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
3gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
137,66 tok/s
Prefill 4.422 · TTFT 445 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
4Nemotron-Cascade-2-30B-A3BNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
107,87 tok/s
Prefill 3.141 · TTFT 690 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
5Nemotron-3-Nano-Omni-30B-A3B-ReasoningNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
102,89 tok/s
Prefill 3.111 · TTFT 692 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
6gpt-oss-120bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
99,77 tok/s
Prefill 1.920 · TTFT 1.022 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
7Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
97,61 tok/s
Prefill 2.827 · TTFT 862 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
8NVIDIA-Nemotron-3-Nano-4BNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
93,42 tok/s
Prefill 2.630 · TTFT 822 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
9Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
91,39 tok/s
Prefill 4.034 · TTFT 603 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
10Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
90,98 tok/s
Prefill 4.283 · TTFT 569 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
11Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
89,84 tok/s
Prefill 4.031 · TTFT 605 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
12Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
88,58 tok/s
Prefill 4.831 · TTFT 503 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
13Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
88,22 tok/s
Prefill 5.195 · TTFT 470 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
14Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
87,84 tok/s
Prefill 2.455 · TTFT 1.018 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
15North-Mini-Code-1.0CohereTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
87,33 tok/s
Prefill 3.234 · TTFT 648 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
16Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
86,76 tok/s
Prefill 4.914 · TTFT 497 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
17Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
86,67 tok/s
Prefill 2.692 · TTFT 903 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
18Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
82,49 tok/s
Prefill 3.953 · TTFT 587 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
19Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
79,36 tok/s
Prefill 2.286 · TTFT 843 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
20Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
78,90 tok/s
Prefill 4.644 · TTFT 504 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
21Qwen-AgentWorld-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
78,54 tok/s
Prefill 2.337 · TTFT 875 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
22Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
78,46 tok/s
Prefill 2.327 · TTFT 829 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
23NVIDIA-Nemotron-3-Nano-30B-A3BNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
78,25 tok/s
Prefill 2.525 · TTFT 867 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
24Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
75,66 tok/s
Prefill 1.817 · TTFT 2.001 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
25Qwen-AgentWorld-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
75,30 tok/s
Prefill 2.873 · TTFT 669 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
26Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
69,19 tok/s
Prefill 7.289 · TTFT 412 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
27Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
68,58 tok/s
Prefill 1.297 · TTFT 1.648 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
28Qwen-AgentWorld-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
62,70 tok/s
Prefill 2.064 · TTFT 1.114 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
29MiniMax-M2.5MiniMaxPerformancetest Small 1.0Performancebenchmark
62,70 tok/s
Prefill 368 · TTFT 144 ms
3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclaw BF1620.07.2026
30Qwen3-Coder-NextQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
62,39 tok/s
Prefill 2.142 · TTFT 1.132 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
31Qwen3-Coder-NextQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
60,99 tok/s
Prefill 2.410 · TTFT 1.005 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
32Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
60,88 tok/s
Prefill 2.087 · TTFT 996 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
33Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
59,79 tok/s
Prefill 2.291 · TTFT 889 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
34Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
59,41 tok/s
Prefill 3.761 · TTFT 569 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
35Mistral-Small-4-119B-2603Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
58,52 tok/s
Prefill 2.053 · TTFT 1.304 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
36Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
55,99 tok/s
Prefill 3.520 · TTFT 622 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
37gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
52,72 tok/s
Prefill 4.993 · TTFT 874 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw22.07.2026
38Ministral-3-14B-Reasoning-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
51,00 tok/s
Prefill 3.205 · TTFT 716 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
39Ministral-3-14B-Reasoning-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
50,36 tok/s
Prefill 3.889 · TTFT 593 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
40Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
49,30 tok/s
Prefill 320 · TTFT 6.725 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
41Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
48,40 tok/s
Prefill 3.509 · TTFT 649 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
42Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
47,99 tok/s
Prefill 867 · TTFT 2.482 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
43Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
47,65 tok/s
Prefill 5.913 · TTFT 437 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
44Ministral-3-14B-Reasoning-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
47,59 tok/s
Prefill 2.183 · TTFT 1.016 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
45Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
46,52 tok/s
Prefill 4.080 · TTFT 752 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
46Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
46,18 tok/s
Prefill 5.211 · TTFT 480 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
47Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
45,43 tok/s
Prefill 861 · TTFT 2.500 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
48Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
44,17 tok/s
Prefill 4.851 · TTFT 489 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
49Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
43,75 tok/s
Prefill 913 · TTFT 2.357 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
50Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
42,63 tok/s
Prefill 3.281 · TTFT 617 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
51Gemma-4-26B-A4B-itGooglePerformancetest Small 1.0Performancebenchmark
42,22 tok/s
Prefill 71 · TTFT 609 ms
AMD Radeon Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMllama.cppgodclaw Q8_022.07.2026
52Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
42,04 tok/s
Prefill 3.904 · TTFT 581 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
53Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
41,95 tok/s
Prefill 8.044 · TTFT 378 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
54Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
41,21 tok/s
Prefill 5.446 · TTFT 460 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
55Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
40,50 tok/s
Prefill 5.664 · TTFT 755 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
56Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
39,74 tok/s
Prefill 3.947 · TTFT 575 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
57Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
39,70 tok/s
Prefill 4.998 · TTFT 387 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
58Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
39,27 tok/s
Prefill 5.443 · TTFT 774 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
59Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
38,34 tok/s
Prefill 8.377 · TTFT 387 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
60Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
36,87 tok/s
Prefill 7.939 · TTFT 473 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
61gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
35,66 tok/s
Prefill 6.540 · TTFT 375 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw22.07.2026
62Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
34,82 tok/s
Prefill 5.528 · TTFT 767 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
63Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
34,80 tok/s
Prefill 4.274 · TTFT 570 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
64MiniMax-M2.7-AWQ-4bitMiniMaxPerformancetest Small 1.0Performancebenchmark
34,37 tok/s
Prefill 503 · TTFT 105 ms
NVIDIA GB10NVIDIA Grace · 120 GB RAMvLLMgodclaw AWQ20.07.2026
65Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
34,36 tok/s
Prefill 7.861 · TTFT 473 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
66Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
34,21 tok/s
Prefill 5.971 · TTFT 356 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
67Devstral-Small-2507Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,91 tok/s
Prefill 0 · TTFT 1.523 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
68Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,48 tok/s
Prefill 1.390 · TTFT 1.474 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
69Codestral-22B-v0.1Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,47 tok/s
Prefill 810 · TTFT 3.810 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
70Magistral-Small-2509Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,32 tok/s
Prefill 2.001 · TTFT 1.001 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
71Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,19 tok/s
Prefill 2.767 · TTFT 1.132 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
72Codestral-22B-v0.1Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,12 tok/s
Prefill 2.688 · TTFT 893 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
73Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
33,10 tok/s
Prefill 1.265 · TTFT 1.767 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
74Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
32,98 tok/s
Prefill 2.592 · TTFT 790 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
75GLM-4.5-AirZ.ai (Zhipu)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
32,88 tok/s
Prefill 982 · TTFT 3.379 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
76Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
32,76 tok/s
Prefill 4.322 · TTFT 563 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
77Devstral-Small-2507Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
32,07 tok/s
Prefill 2.888 · TTFT 1.129 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
78Devstral-Small-2507Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
31,41 tok/s
Prefill 1.961 · TTFT 1.394 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
79Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
31,27 tok/s
Prefill 1.563 · TTFT 1.699 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
80Devstral-Small-2507Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
31,20 tok/s
Prefill 0 · TTFT 3.155 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
81Devstral-Small-2507Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
30,97 tok/s
Prefill 1.167 · TTFT 1.890 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
82Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
30,28 tok/s
Prefill 1.804 · TTFT 1.281 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
83Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
29,97 tok/s
Prefill 1.536 · TTFT 2.083 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
84Devstral-Small-2-24B-Instruct-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
29,35 tok/s
Prefill 905 · TTFT 3.213 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
85Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
29,06 tok/s
Prefill 4.992 · TTFT 415 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
86Magistral-Small-2509Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,90 tok/s
Prefill 1.318 · TTFT 2.246 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
87Qwen3.6-27BQwen (Alibaba)Timebench 2 - Token-Generation / Output-DurchsatzPerformancebenchmark
28,80 tok/s
Prefill 599 · TTFT 122 ms
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition32x AMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclaw20.07.2026
88Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,76 tok/s
Prefill 1.407 · TTFT 1.945 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
89Magistral-Small-2509Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,74 tok/s
Prefill 1.614 · TTFT 1.813 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
90gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,70 tok/s
Prefill 3.379 · TTFT 986 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw22.07.2026
91Devstral-Small-2507Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,45 tok/s
Prefill 890 · TTFT 3.580 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
92Devstral-Small-2-24B-Instruct-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,27 tok/s
Prefill 1.667 · TTFT 1.617 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
93Devstral-Small-2-24B-Instruct-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
28,24 tok/s
Prefill 1.569 · TTFT 1.948 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
94Codestral-22B-v0.1Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
27,68 tok/s
Prefill 1.289 · TTFT 3.106 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
95Laguna-XS-2.1-INT4PoolsideTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
26,88 tok/s
Prefill 3.698 · TTFT 748 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT422.07.2026
96Magistral-Small-2509Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
26,59 tok/s
Prefill 1.273 · TTFT 1.574 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
97Codestral-22B-v0.1Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
25,47 tok/s
Prefill 1.170 · TTFT 2.158 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
98gemma-4-31b-it-int8GooglePerformancetest Small 1.0Performancebenchmark
24,36 tok/s
Prefill 309 · TTFT 91 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT820.07.2026
99OpenReasoning-Nemotron-32BNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
23,25 tok/s
Prefill 1.196 · TTFT 2.115 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
100Qwen3-Coder-NextQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
22,73 tok/s
Prefill 2.230 · TTFT 1.115 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
101Qwen3-Coder-NextQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
22,53 tok/s
Prefill 2.237 · TTFT 1.117 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
102gpt-oss-120bOpenAITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
21,48 tok/s
Prefill 4.300 · TTFT 556 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw22.07.2026
103Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
21,20 tok/s
Prefill 1.548 · TTFT 1.551 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
104Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
20,90 tok/s
Prefill 572 · TTFT 7.773 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
105Magistral-Small-2509Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
19,42 tok/s
Prefill 2.175 · TTFT 1.030 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
106Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
19,14 tok/s
Prefill 1.274 · TTFT 1.705 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
107Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
19,08 tok/s
Prefill 1.508 · TTFT 1.441 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
108Seed-OSS-36B-InstructByteDance SeedTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
19,07 tok/s
Prefill 1.108 · TTFT 2.083 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
109Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
18,95 tok/s
Prefill 835 · TTFT 2.604 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
110Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
18,60 tok/s
Prefill 615 · TTFT 4.520 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
111Magistral-Small-2509Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
18,46 tok/s
Prefill 1.263 · TTFT 1.741 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
112Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
15,00 tok/s
Prefill 9.072 · TTFT 245 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT422.07.2026
113Laguna-S-2.1-INT4PoolsideTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
13,37 tok/s
Prefill 8.629 · TTFT 305 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT422.07.2026
114gemma-4-31b-it-int8GooglePerformancetest Small 1.0Performancebenchmark
12,45 tok/s
Prefill 208 · TTFT 135 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT820.07.2026
115Llama-3_3-Nemotron-Super-49B-v1_5NVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
12,27 tok/s
Prefill 823 · TTFT 2.292 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
116gemma-4-31b-it-int8GoogleTimebench 2 - Token-Generation / Output-DurchsatzPerformancebenchmark
11,19 tok/s
Prefill 162 · TTFT 716 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT820.07.2026
117gemma-4-31b-it-int8GooglePerformancetest Small 1.0Performancebenchmark
10,54 tok/s
Prefill 199 · TTFT 141 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT820.07.2026
118Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
9,86 tok/s
Prefill 8.244 · TTFT 264 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
119Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
9,84 tok/s
Prefill 7.325 · TTFT 311 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
120GLM-4.5-AirZ.ai (Zhipu)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
9,08 tok/s
Prefill 5.237 · TTFT 407 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ22.07.2026
121Devstral-Small-2-24B-Instruct-2512Mistral AIPerformancetest Small 1.0Performancebenchmark
8,88 tok/s
Prefill 22 · TTFT 906 ms
AMD Radeon Graphics32x AMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMllama.cppgodclaw Q8_020.07.2026
122Nemotron-H-47B-Reasoning-128KNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
7,96 tok/s
Prefill 338 · TTFT 6.286 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
123command-a-reasoning-08-2025CohereTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
7,81 tok/s
Prefill 173 · TTFT 10.910 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
124Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
6,98 tok/s
Prefill 4.076 · TTFT 559 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT422.07.2026
125Devstral-2-123B-Instruct-2512Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
6,50 tok/s
Prefill 323 · TTFT 6.557 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M21.07.2026
126Minimax-2.5MiniMaxTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
6,46 tok/s
Prefill 119 · TTFT 21.346 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw22.07.2026
127Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
6,13 tok/s
Prefill 2.944 · TTFT 763 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw INT422.07.2026
128Mistral-Medium-3.5-128BMistral AITimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
5,77 tok/s
Prefill 334 · TTFT 5.648 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw21.07.2026
129Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
5,57 tok/s
Prefill 4.108 · TTFT 529 ms
AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
130Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
5,54 tok/s
Prefill 5.413 · TTFT 420 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
131Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
5,30 tok/s
Prefill 3.582 · TTFT 607 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
132Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation)Performancebenchmark
5,24 tok/s
Prefill 3.234 · TTFT 701 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw AWQ21.07.2026
133MiniMax-M2.7MiniMaxTimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
3,00 tok/s
Prefill 139 · TTFT 15.493 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026
134Qwen2.5-72B-Instruct-Q4_K_M.ggufQwen (Alibaba)Performancetest Small 1.0Performancebenchmark
2,28 tok/s
Prefill 81 · TTFT 569 ms
Keine GPU (CPU-only)51x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMgodclaw20.07.2026
135NVIDIA-Nemotron-3-Super-120B-A12BNVIDIATimebench 3 - Kombi (Prefill + Generation)Performancebenchmark
1,99 tok/s
Prefill 204 · TTFT 10.412 ms
3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclaw Q4_K_M22.07.2026