Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🧠
Prozessor

AMD Ryzen Threadripper PRO 9965WX 24-Cores

AMD
519Benchmarks
49Modelle
510Performance
9Harness
50 WIdle-Leistung
350 WMax-Leistung
Beste Generation
2.143,6 tok/s
gemma-4-E2B-it
∅ Generation
557,4 tok/s
Schnitt aus 510 Läufen
Bester Prefill
21.843 tok/s
Prompt-Verarbeitung
Bester TTFT
59 ms
Time to First Token
Beste Harness-Quote
81%
9 Harness-Läufe
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser CPU · 2.143,6 tok/s
Bester Prefill: 21.843 tok/s · 49 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf AMD Ryzen Threadripper PRO 9965WX 24-Cores – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
2.143,6 tok/s
Nemotron-3-Nano-4B4B
1.937,7 tok/s
gpt-oss-20b20B
1.835,7 tok/s
Ornith-1.0-35B35B
1.799,4 tok/s
Nemotron-3-Nano-30B-A3B30B
1.654,6 tok/s
Laguna-XS-2.1
1.629,9 tok/s
Performanceprofil

Durchsatz auf AMD Ryzen Threadripper PRO 9965WX 24-Cores

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

2.5572.1011.6461.1907342.9678.93714.90720.878Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 2.143,6 tok/s Generation, 13.768 tok/s Prefill, TTFT 3.190 ms (2 Laufe)gemma-4-E2B-itNemotron-3-Nano-4B - 1.937,7 tok/s Generation, 9.988 tok/s Prefill, TTFT 6.339 ms (4 Laufe)Nemotron-3-Nano-4Bgpt-oss-20b - 1.835,7 tok/s Generation, 17.725 tok/s Prefill, TTFT 4.801 ms (5 Laufe)gpt-oss-20bOrnith-1.0-35B - 1.799,4 tok/s Generation, 7.789 tok/s Prefill, TTFT 8.498 ms (3 Laufe)Ornith-1.0-35BNemotron-Cascade-2-30B-A3B - 1.655,2 tok/s Generation, 9.796 tok/s Prefill, TTFT 7.336 ms (3 Laufe)Nemotron-Cascade-2-30...Nemotron-3-Nano-30B-A3B - 1.654,6 tok/s Generation, 9.583 tok/s Prefill, TTFT 7.332 ms (3 Laufe)Nemotron-3-Nano-30B-A...Nemotron-3-Nano-Omni-30B-A3B-Reasoning - 1.651,0 tok/s Generation, 9.643 tok/s Prefill, TTFT 7.361 ms (3 Laufe)Nemotron-3-Nano-Omni-...Laguna-XS-2.1 - 1.629,9 tok/s Generation, 10.685 tok/s Prefill, TTFT 7.645 ms (12 Laufe)Laguna-XS-2.1Qwen3-Coder-30B-A3B-Instruct - 1.545,3 tok/s Generation, 15.911 tok/s Prefill, TTFT 7.199 ms (3 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-30B-A3B-Thinking-2507 - 1.521,4 tok/s Generation, 12.138 tok/s Prefill, TTFT 7.670 ms (3 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-30B-A3B-Instruct-2507 - 1.515,7 tok/s Generation, 15.662 tok/s Prefill, TTFT 7.348 ms (3 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-Omni-30B-A3B-Thinking - 1.512,4 tok/s Generation, 11.464 tok/s Prefill, TTFT 7.787 ms (3 Laufe)Qwen3-Omni-30B-A3B-Th...Qwen3-VL-30B-A3B-Instruct - 1.505,0 tok/s Generation, 15.269 tok/s Prefill, TTFT 7.432 ms (3 Laufe)Qwen3-VL-30B-A3B-Inst...North-Mini-Code-1.0 - 1.492,4 tok/s Generation, 9.903 tok/s Prefill, TTFT 7.727 ms (4 Laufe)North-Mini-Code-1.0Gemma-4-26B-A4B-it - 1.479,9 tok/s Generation, 7.757 tok/s Prefill, TTFT 8.277 ms (3 Laufe)Gemma-4-26B-A4B-itMeta-Llama-3.1-8B-Instruct - 1.433,0 tok/s Generation, 17.435 tok/s Prefill, TTFT 7.424 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...gemma-4-E4B-it - 1.423,3 tok/s Generation, 11.579 tok/s Prefill, TTFT 6.972 ms (2 Laufe)gemma-4-E4B-itQwen3.5-35B-A3B - 1.398,4 tok/s Generation, 7.710 tok/s Prefill, TTFT 8.290 ms (4 Laufe)Qwen3.5-35B-A3BQwen3.6-35B-A3B - 1.367,3 tok/s Generation, 8.188 tok/s Prefill, TTFT 8.435 ms (3 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 1.363,4 tok/s Generation, 8.118 tok/s Prefill, TTFT 8.471 ms (3 Laufe)Qwen-AgentWorld-35B-A...Ornith-1.0-9B - 1.349,7 tok/s Generation, 9.894 tok/s Prefill, TTFT 7.940 ms (3 Laufe)Ornith-1.0-9Bgpt-oss-120b - 1.229,7 tok/s Generation, 8.307 tok/s Prefill, TTFT 8.989 ms (3 Laufe)gpt-oss-120bQwen3-Coder-Next - 1.147,5 tok/s Generation, 6.119 tok/s Prefill, TTFT 10.637 ms (2 Laufe)Qwen3-Coder-Next
gemma-4-E2B-it 2.143,6 tok/sNemotron-3-Nano-4B 1.937,7 tok/sgpt-oss-20b 1.835,7 tok/sOrnith-1.0-35B 1.799,4 tok/sNemotron-Cascade-2-30B-A3B 1.655,2 tok/sNemotron-3-Nano-30B-A3B 1.654,6 tok/sNemotron-3-Nano-Omni-30B-A3B-Reasoning 1.651,0 tok/sLaguna-XS-2.1 1.629,9 tok/sQwen3-Coder-30B-A3B-Instruct 1.545,3 tok/sQwen3-30B-A3B-Thinking-2507 1.521,4 tok/sQwen3-30B-A3B-Instruct-2507 1.515,7 tok/sQwen3-Omni-30B-A3B-Thinking 1.512,4 tok/sQwen3-VL-30B-A3B-Instruct 1.505,0 tok/sNorth-Mini-Code-1.0 1.492,4 tok/sGemma-4-26B-A4B-it 1.479,9 tok/sMeta-Llama-3.1-8B-Instruct 1.433,0 tok/sgemma-4-E4B-it 1.423,3 tok/sQwen3.5-35B-A3B 1.398,4 tok/sQwen3.6-35B-A3B 1.367,3 tok/sQwen-AgentWorld-35B-A3B 1.363,4 tok/sOrnith-1.0-9B 1.349,7 tok/sgpt-oss-120b 1.229,7 tok/sQwen3-Coder-Next 1.147,5 tok/s

ENGnach Engine

2.5392.1151.6911.2678437.74113.52919.31725.104Prefill (tok/s)Generation (tok/s)llama.cpp - 2.143,6 tok/s Generation, 11.003 tok/s Prefill, TTFT 7.574 ms (79 Laufe)llama.cppvLLM - 1.238,3 tok/s Generation, 21.843 tok/s Prefill, TTFT 905 ms (1 Lauf)vLLM
llama.cpp 2.143,6 tok/svLLM 1.238,3 tok/s

GPUnach Grafikkarte

2.3582.2512.1442.0361.92910.47010.91511.36111.806Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 2.143,6 tok/s Generation, 11.138 tok/s Prefill, TTFT 7.491 ms (80 Laufe)NVIDIA RTX PRO 6000 B...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 2.143,6 tok/s
Plattform

Mainboards mit dieser CPU

Auf diesen Boards wurde AMD Ryzen Threadripper PRO 9965WX 24-Cores gemessen – anklicken für Board-Details mit CPUs und Modellen.

Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Ryzen Threadripper PRO 9965WX 24-Cores.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.143,55 tok/s TG
Prefill 13.632 · TTFT 4.819 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
2Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.937,67 tok/s TG
Prefill 9.452 · TTFT 6.288 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
3Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.911,59 tok/s TG
Prefill 10.116 · TTFT 6.245 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.896,98 tok/s TG
Prefill 10.984 · TTFT 6.227 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.835,73 tok/s TG
Prefill 15.972 · TTFT 5.760 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.830,31 tok/s TG
Prefill 9.399 · TTFT 6.598 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
7gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.819,53 tok/s TG
Prefill 19.732 · TTFT 5.578 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
8gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.801,97 tok/s TG
Prefill 18.226 · TTFT 5.605 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
9Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.799,41 tok/s TG
Prefill 9.192 · TTFT 8.876 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.742,13 tok/s TG
Prefill 12.852 · TTFT 6.156 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.655,21 tok/s TG
Prefill 10.591 · TTFT 7.004 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.654,57 tok/s TG
Prefill 10.472 · TTFT 7.000 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
13Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.650,98 tok/s TG
Prefill 11.364 · TTFT 6.872 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
14Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.650,72 tok/s TG
Prefill 11.398 · TTFT 6.887 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
15Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.649,85 tok/s TG
Prefill 10.323 · TTFT 7.066 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
16Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.629,91 tok/s TG
Prefill 11.384 · TTFT 7.322 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.620,45 tok/s TG
Prefill 10.729 · TTFT 7.428 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
18Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.620,41 tok/s TG
Prefill 12.519 · TTFT 7.197 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
19Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.615,26 tok/s TG
Prefill 13.041 · TTFT 7.166 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
20Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.611,02 tok/s TG
Prefill 12.725 · TTFT 7.223 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
21Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.609,12 tok/s TG
Prefill 10.883 · TTFT 7.452 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
22Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,39 tok/s TG
Prefill 11.312 · TTFT 7.410 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
23Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.607,66 tok/s TG
Prefill 10.675 · TTFT 7.505 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
24Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.606,11 tok/s TG
Prefill 12.690 · TTFT 7.203 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
25Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.554,46 tok/s TG
Prefill 7.954 · TTFT 8.418 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
26Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.554,37 tok/s TG
Prefill 10.928 · TTFT 6.920 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
27Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.545,29 tok/s TG
Prefill 19.346 · TTFT 6.758 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
28Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.542,64 tok/s TG
Prefill 7.398 · TTFT 8.118 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
29Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.540,50 tok/s TG
Prefill 7.349 · TTFT 8.077 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
30Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.534,12 tok/s TG
Prefill 7.243 · TTFT 8.145 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
31Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.533,70 tok/s TG
Prefill 6.831 · TTFT 8.783 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
32Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.532,89 tok/s TG
Prefill 7.482 · TTFT 8.633 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
33Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.531,89 tok/s TG
Prefill 17.119 · TTFT 6.936 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
34Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.521,37 tok/s TG
Prefill 12.779 · TTFT 7.364 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
35Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.518,42 tok/s TG
Prefill 15.383 · TTFT 7.173 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
36Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.515,72 tok/s TG
Prefill 20.491 · TTFT 6.859 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
37Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.512,43 tok/s TG
Prefill 14.637 · TTFT 7.246 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
38Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.511,01 tok/s TG
Prefill 11.948 · TTFT 7.503 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
39Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.507,51 tok/s TG
Prefill 16.412 · TTFT 7.065 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
40Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.505,03 tok/s TG
Prefill 19.292 · TTFT 6.959 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
41Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.498,91 tok/s TG
Prefill 15.825 · TTFT 7.173 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
42North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.492,41 tok/s TG
Prefill 10.415 · TTFT 7.570 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
43North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.490,67 tok/s TG
Prefill 10.879 · TTFT 7.498 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
44North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.482,54 tok/s TG
Prefill 11.096 · TTFT 7.518 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
45Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.479,91 tok/s TG
Prefill 8.811 · TTFT 7.965 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
46Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.479,41 tok/s TG
Prefill 6.414 · TTFT 8.654 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
47North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.477,72 tok/s TG
Prefill 7.220 · TTFT 8.321 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
48Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.466,18 tok/s TG
Prefill 8.044 · TTFT 8.213 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
49Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.465,26 tok/s TG
Prefill 8.251 · TTFT 8.474 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
50Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.458,58 tok/s TG
Prefill 7.808 · TTFT 8.611 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
51Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.455,41 tok/s TG
Prefill 11.267 · TTFT 7.904 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
52Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.447,27 tok/s TG
Prefill 8.138 · TTFT 7.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
53Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.436,00 tok/s TG
Prefill 10.085 · TTFT 8.120 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
54Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.432,98 tok/s TG
Prefill 21.012 · TTFT 6.892 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
55gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.423,31 tok/s TG
Prefill 10.739 · TTFT 6.965 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
56gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.421,79 tok/s TG
Prefill 12.418 · TTFT 6.980 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
57Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.420,15 tok/s TG
Prefill 10.691 · TTFT 8.165 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
58Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.400,99 tok/s TG
Prefill 6.038 · TTFT 8.703 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
59Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.398,38 tok/s TG
Prefill 8.247 · TTFT 8.094 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
60Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.389,23 tok/s TG
Prefill 7.940 · TTFT 8.056 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
61Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.383,23 tok/s TG
Prefill 17.796 · TTFT 7.072 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
62Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.367,32 tok/s TG
Prefill 9.899 · TTFT 8.047 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
63Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.363,39 tok/s TG
Prefill 9.248 · TTFT 8.137 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
64Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.361,67 tok/s TG
Prefill 9.538 · TTFT 7.854 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
65Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.349,73 tok/s TG
Prefill 11.193 · TTFT 7.579 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
66Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.348,63 tok/s TG
Prefill 6.479 · TTFT 8.949 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
67Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.341,33 tok/s TG
Prefill 8.440 · TTFT 8.344 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
68Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.338,40 tok/s TG
Prefill 8.627 · TTFT 8.328 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
69Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.309,27 tok/s TG
Prefill 10.749 · TTFT 7.401 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
70Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.267,62 tok/s TG
Prefill 13.497 · TTFT 8.310 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
71Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.243,85 tok/s TG
Prefill 5.117 · TTFT 9.159 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
72gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.238,26 tok/s TG
Prefill 21.843 · TTFT 905 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMvLLMgodclaw
73Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.236,51 tok/s TG
Prefill 7.739 · TTFT 8.840 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
74gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.229,72 tok/s TG
Prefill 9.543 · TTFT 8.771 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
75gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.220,77 tok/s TG
Prefill 7.425 · TTFT 9.155 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
76gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.214,90 tok/s TG
Prefill 7.954 · TTFT 9.043 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
77Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.212,13 tok/s TG
Prefill 6.225 · TTFT 8.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_M
78gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.195,72 tok/s TG
Prefill 13.905 · TTFT 1.561 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
79Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.147,50 tok/s TG
Prefill 5.750 · TTFT 10.762 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
80Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.141,98 tok/s TG
Prefill 6.489 · TTFT 10.511 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Ryzen Threadripper PRO 9965WX 24-Cores.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – AMD Ryzen Threadripper PRO 9965WX 24-Cores

HerstellerAMD
TDP350 W
Beste Generation2.143,6 tok/s
Bester Prefill21.843 tok/s
Modelle49
Messläufe (Performance)510