Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🧠
Prozessor

AMD Ryzen Threadripper PRO 7955WX 16-Cores

AMD
1852Benchmarks
60Modelle
1852Performance
0Harness
40 WIdle-Leistung
350 WMax-Leistung
Beste Generation
1.568,0 tok/s
gemma-4-E2B-it
∅ Generation
166,0 tok/s
Schnitt aus 1852 Läufen
Bester Prefill
55.260 tok/s
Prompt-Verarbeitung
Bester TTFT
31 ms
Time to First Token
Beste Harness-Quote
%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser CPU · 1.568,0 tok/s
Bester Prefill: 55.260 tok/s · 60 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf AMD Ryzen Threadripper PRO 7955WX 16-Cores – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
1.568,0 tok/s
Nemotron-3-Nano-4B4B
1.485,1 tok/s
Ornith-1.0-9B9B
1.062,5 tok/s
Qwen3.5-35B-A3B35B
842,1 tok/s
Gemma-4-26B-A4B-it26B
841,8 tok/s
Laguna-XS-2.1
836,4 tok/s
Qwen3.6-35B-A3B35B
800,4 tok/s
Performanceprofil

Durchsatz auf AMD Ryzen Threadripper PRO 7955WX 16-Cores

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

1.9131.5051.0976892812.44315.11727.79140.465Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.568,0 tok/s Generation, 33.935 tok/s Prefill, TTFT 798 ms (8 Laufe)gemma-4-E2B-itNemotron-3-Nano-4B - 1.485,1 tok/s Generation, 19.097 tok/s Prefill, TTFT 9.210 ms (6 Laufe)Nemotron-3-Nano-4BOrnith-1.0-9B - 1.062,5 tok/s Generation, 18.369 tok/s Prefill, TTFT 1.318 ms (5 Laufe)Ornith-1.0-9BMeta-Llama-3.1-8B-Instruct - 1.026,4 tok/s Generation, 24.931 tok/s Prefill, TTFT 1.159 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3.5-35B-A3B - 842,1 tok/s Generation, 21.017 tok/s Prefill, TTFT 5.093 ms (6 Laufe)Qwen3.5-35B-A3BGemma-4-26B-A4B-it - 841,8 tok/s Generation, 28.153 tok/s Prefill, TTFT 1.058 ms (4 Laufe)Gemma-4-26B-A4B-itLaguna-XS-2.1 - 836,4 tok/s Generation, 25.684 tok/s Prefill, TTFT 5.379 ms (6 Laufe)Laguna-XS-2.1Qwen3.6-35B-A3B - 800,4 tok/s Generation, 20.714 tok/s Prefill, TTFT 5.924 ms (6 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 799,7 tok/s Generation, 30.088 tok/s Prefill, TTFT 894 ms (2 Laufe)Qwen-AgentWorld-35B-A...Qwen3-Coder-30B-A3B-Instruct - 789,2 tok/s Generation, 28.705 tok/s Prefill, TTFT 2.367 ms (4 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-VL-30B-A3B-Instruct - 763,5 tok/s Generation, 33.064 tok/s Prefill, TTFT 1.075 ms (2 Laufe)Qwen3-VL-30B-A3B-Inst...Qwen3-30B-A3B-Instruct-2507 - 758,7 tok/s Generation, 32.859 tok/s Prefill, TTFT 1.069 ms (2 Laufe)Qwen3-30B-A3B-Instruc...Nemotron-3-Nano-30B-A3B - 756,7 tok/s Generation, 11.340 tok/s Prefill, TTFT 10.216 ms (3 Laufe)Nemotron-3-Nano-30B-A...Qwen3-30B-A3B-Thinking-2507 - 751,7 tok/s Generation, 31.426 tok/s Prefill, TTFT 1.213 ms (2 Laufe)Qwen3-30B-A3B-Thinkin...Ministral-3-14B-Reasoning-2512 - 735,1 tok/s Generation, 15.874 tok/s Prefill, TTFT 2.078 ms (2 Laufe)Ministral-3-14B-Reaso...Nemotron-Cascade-2-30B-A3B - 723,7 tok/s Generation, 11.365 tok/s Prefill, TTFT 10.330 ms (3 Laufe)Nemotron-Cascade-2-30...gpt-oss-20b - 703,8 tok/s Generation, 8.973 tok/s Prefill, TTFT 5.347 ms (4 Laufe)gpt-oss-20bgemma-4-12B-it - 681,8 tok/s Generation, 15.255 tok/s Prefill, TTFT 2.017 ms (2 Laufe)gemma-4-12B-itNorth-Mini-Code-1.0 - 648,5 tok/s Generation, 18.445 tok/s Prefill, TTFT 4.022 ms (4 Laufe)North-Mini-Code-1.0Qwen3-Coder-Next - 629,8 tok/s Generation, 24.446 tok/s Prefill, TTFT 1.439 ms (2 Laufe)Qwen3-Coder-NextOrnith-1.5-35B-A3B - 626,4 tok/s Generation, 16.135 tok/s Prefill, TTFT 4.286 ms (4 Laufe)Ornith-1.5-35B-A3B
gemma-4-E2B-it 1.568,0 tok/sNemotron-3-Nano-4B 1.485,1 tok/sOrnith-1.0-9B 1.062,5 tok/sMeta-Llama-3.1-8B-Instruct 1.026,4 tok/sQwen3.5-35B-A3B 842,1 tok/sGemma-4-26B-A4B-it 841,8 tok/sLaguna-XS-2.1 836,4 tok/sQwen3.6-35B-A3B 800,4 tok/sQwen-AgentWorld-35B-A3B 799,7 tok/sQwen3-Coder-30B-A3B-Instruct 789,2 tok/sQwen3-VL-30B-A3B-Instruct 763,5 tok/sQwen3-30B-A3B-Instruct-2507 758,7 tok/sNemotron-3-Nano-30B-A3B 756,7 tok/sQwen3-30B-A3B-Thinking-2507 751,7 tok/sMinistral-3-14B-Reasoning-2512 735,1 tok/sNemotron-Cascade-2-30B-A3B 723,7 tok/sgpt-oss-20b 703,8 tok/sgemma-4-12B-it 681,8 tok/sNorth-Mini-Code-1.0 648,5 tok/sQwen3-Coder-Next 629,8 tok/sOrnith-1.5-35B-A3B 626,4 tok/s

ENGnach Engine

1.8701.5371.2058735401.81412.68723.56134.434Prefill (tok/s)Generation (tok/s)vLLM - 1.568,0 tok/s Generation, 28.844 tok/s Prefill, TTFT 1.105 ms (56 Laufe)vLLMllama.cpp - 842,1 tok/s Generation, 7.404 tok/s Prefill, TTFT 10.739 ms (24 Laufe)llama.cpp
vLLM 1.568,0 tok/sllama.cpp 842,1 tok/s

GPUnach Grafikkarte

1.9051.5111.11872433009.28318.56527.848Prefill (tok/s)Generation (tok/s)NVIDIA RTX A6000 - 1.568,0 tok/s Generation, 23.110 tok/s Prefill, TTFT 3.465 ms (77 Laufe)NVIDIA RTX A6000AMD Radeon AI PRO R9700 - 667,0 tok/s Generation, 4.495 tok/s Prefill, TTFT 17.616 ms (3 Laufe)AMD Radeon AI PRO R97...
NVIDIA RTX A6000 1.568,0 tok/sAMD Radeon AI PRO R9700 667,0 tok/s
Plattform

Mainboards mit dieser CPU

Auf diesen Boards wurde AMD Ryzen Threadripper PRO 7955WX 16-Cores gemessen – anklicken für Board-Details mit CPUs und Modellen.

Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Ryzen Threadripper PRO 7955WX 16-Cores.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.567,98 tok/s TG
Prefill 55.260 · TTFT 492 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
2Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.485,14 tok/s TG
Prefill 44.171 · TTFT 717 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
3gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.359,09 tok/s TG
Prefill 47.158 · TTFT 587 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
4gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.122,50 tok/s TG
Prefill 38.712 · TTFT 690 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
5Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.062,52 tok/s TG
Prefill 21.965 · TTFT 1.226 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
6Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.026,44 tok/s TG
Prefill 26.805 · TTFT 1.371 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
7gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
909,00 tok/s TG
Prefill 43.093 · TTFT 288 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
8Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
899,41 tok/s TG
Prefill 30.214 · TTFT 473 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
9Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
881,75 tok/s TG
Prefill 22.565 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
10Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
842,08 tok/s TG
Prefill 6.029 · TTFT 13.332 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
11Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
841,75 tok/s TG
Prefill 32.027 · TTFT 923 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
12Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
838,55 tok/s TG
Prefill 6.016 · TTFT 13.397 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
13Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
836,37 tok/s TG
Prefill 39.157 · TTFT 1.033 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
14Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
832,96 tok/s TG
Prefill 27.508 · TTFT 1.327 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
15Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
810,27 tok/s TG
Prefill 7.685 · TTFT 13.735 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
16Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
806,94 tok/s TG
Prefill 7.252 · TTFT 13.902 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
17gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
803,18 tok/s TG
Prefill 35.757 · TTFT 347 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
18Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
800,39 tok/s TG
Prefill 32.313 · TTFT 827 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
19Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
799,65 tok/s TG
Prefill 31.954 · TTFT 834 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
20Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
791,54 tok/s TG
Prefill 26.710 · TTFT 1.226 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
21Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
789,24 tok/s TG
Prefill 37.676 · TTFT 952 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
22Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
787,25 tok/s TG
Prefill 32.522 · TTFT 826 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
23Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
786,19 tok/s TG
Prefill 19.249 · TTFT 1.376 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
24Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
771,80 tok/s TG
Prefill 34.194 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
25Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
763,50 tok/s TG
Prefill 35.900 · TTFT 987 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
26Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
758,69 tok/s TG
Prefill 34.913 · TTFT 992 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
27Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
756,69 tok/s TG
Prefill 7.030 · TTFT 14.551 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
28Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
755,10 tok/s TG
Prefill 6.964 · TTFT 14.586 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
29Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
754,69 tok/s TG
Prefill 26.306 · TTFT 1.120 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
30Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
751,67 tok/s TG
Prefill 32.340 · TTFT 1.271 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
31Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
735,14 tok/s TG
Prefill 16.886 · TTFT 1.945 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
32Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
732,27 tok/s TG
Prefill 28.221 · TTFT 955 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
33Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
729,28 tok/s TG
Prefill 27.628 · TTFT 966 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
34Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
723,68 tok/s TG
Prefill 7.027 · TTFT 14.700 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
35Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
723,16 tok/s TG
Prefill 7.058 · TTFT 14.771 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
36Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
720,92 tok/s TG
Prefill 30.926 · TTFT 1.138 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
37Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
718,47 tok/s TG
Prefill 28.493 · TTFT 951 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
38Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
712,04 tok/s TG
Prefill 35.143 · TTFT 1.137 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
39gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
703,79 tok/s TG
Prefill 8.617 · TTFT 5.459 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
40Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,04 tok/s TG
Prefill 30.227 · TTFT 1.164 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
41Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
691,32 tok/s TG
Prefill 30.805 · TTFT 1.147 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
42Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
690,88 tok/s TG
Prefill 29.513 · TTFT 1.000 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
43gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
687,53 tok/s TG
Prefill 9.035 · TTFT 5.288 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
44gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
685,28 tok/s TG
Prefill 9.018 · TTFT 5.356 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
45gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
681,82 tok/s TG
Prefill 16.224 · TTFT 1.899 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
46gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
680,00 tok/s TG
Prefill 9.221 · TTFT 5.286 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
47Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
679,07 tok/s TG
Prefill 5.945 · TTFT 15.921 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
48Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
675,29 tok/s TG
Prefill 20.479 · TTFT 781 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
49Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
673,19 tok/s TG
Prefill 30.512 · TTFT 1.156 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
50Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
669,65 tok/s TG
Prefill 6.004 · TTFT 15.775 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
51gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
668,00 tok/s TG
Prefill 11.047 · TTFT 1.802 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
52Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
667,02 tok/s TG
Prefill 4.019 · TTFT 17.735 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
53Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
664,59 tok/s TG
Prefill 27.704 · TTFT 965 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
54Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
658,68 tok/s TG
Prefill 27.910 · TTFT 964 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
55Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,42 tok/s TG
Prefill 30.671 · TTFT 1.283 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
56Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,34 tok/s TG
Prefill 4.936 · TTFT 17.123 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
57Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,08 tok/s TG
Prefill 14.863 · TTFT 2.211 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
58North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
648,52 tok/s TG
Prefill 29.491 · TTFT 1.310 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
59Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
647,82 tok/s TG
Prefill 16.265 · TTFT 725 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
60gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
631,69 tok/s TG
Prefill 29.259 · TTFT 405 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
61Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
630,94 tok/s TG
Prefill 24.767 · TTFT 1.191 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
62Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,83 tok/s TG
Prefill 26.016 · TTFT 1.347 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
63Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,37 tok/s TG
Prefill 4.530 · TTFT 17.991 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
64Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,41 tok/s TG
Prefill 28.681 · TTFT 928 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
65Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
622,29 tok/s TG
Prefill 24.690 · TTFT 1.093 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
66Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
611,40 tok/s TG
Prefill 11.799 · TTFT 2.083 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
67gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
610,99 tok/s TG
Prefill 14.285 · TTFT 2.134 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
68Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
610,90 tok/s TG
Prefill 25.129 · TTFT 1.087 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
69Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
603,66 tok/s TG
Prefill 5.250 · TTFT 7.504 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
70Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
600,91 tok/s TG
Prefill 5.037 · TTFT 7.660 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
71gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
600,60 tok/s TG
Prefill 11.197 · TTFT 1.774 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
72North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
598,90 tok/s TG
Prefill 30.083 · TTFT 948 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
73Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
593,67 tok/s TG
Prefill 14.572 · TTFT 6.256 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
74Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
592,35 tok/s TG
Prefill 20.010 · TTFT 1.519 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
75North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
592,34 tok/s TG
Prefill 6.822 · TTFT 6.994 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
76North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
589,57 tok/s TG
Prefill 7.384 · TTFT 6.836 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
77Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
588,56 tok/s TG
Prefill 25.569 · TTFT 1.053 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
78Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
588,46 tok/s TG
Prefill 20.028 · TTFT 1.512 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
79Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
587,94 tok/s TG
Prefill 22.877 · TTFT 1.531 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
80Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
582,71 tok/s TG
Prefill 31.647 · TTFT 1.123 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Ryzen Threadripper PRO 7955WX 16-Cores.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – AMD Ryzen Threadripper PRO 7955WX 16-Cores

HerstellerAMD
TDP350 W
Beste Generation1.568,0 tok/s
Bester Prefill55.260 tok/s
Modelle60
Messläufe (Performance)1852