Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🧠
Processor

AMD Ryzen 9 9950X 16-Core Processor

AMD
250Benchmarks
52Models
247Performance
3Harness
25 WIdle power
230 WMax power
Best generation
2.414,4 tok/s
gemma-4-E2B-it
∅ Generation
512,5 tok/s
Schnitt aus 247 Läufen
Best prefill
39.029 tok/s
Prompt processing
Best TTFT
114 ms
Time to First Token
Best harness rate
91%
3 Harness-Läufe
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser CPU · 2.414,4 tok/s
Bester Prefill: 39.029 tok/s · 52 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf AMD Ryzen 9 9950X 16-Core Processor – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
2.414,4 tok/s
Nemotron-3-Nano-4B4B
2.182,7 tok/s
gpt-oss-20b20B
1.995,4 tok/s
Nemotron-3-Nano-Omni-30B-A3B-Reasoning30B
1.791,5 tok/s
Nemotron-3-Nano-30B-A3B30B
1.773,5 tok/s
Nemotron-Cascade-2-30B-A3B30B
1.768,1 tok/s
gemma-4-E4B-it8B
1.758,6 tok/s
Laguna-XS-2.1
1.757,4 tok/s
Qwen3-Coder-30B-A3B-Instruct30B
1.690,0 tok/s
Qwen3-30B-A3B-Thinking-250730B
1.670,5 tok/s
Performance profile

Durchsatz auf AMD Ryzen 9 9950X 16-Core Processor

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

3.0092.2701.53179252,809.26418.52727.791Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 2.414,4 tok/s Generation, 19.218 tok/s Prefill, TTFT 2.704 ms (2 Laufe)gemma-4-E2B-itNemotron-3-Nano-4B - 2.182,7 tok/s Generation, 9.816 tok/s Prefill, TTFT 3.831 ms (2 Laufe)Nemotron-3-Nano-4Bgpt-oss-20b - 1.995,4 tok/s Generation, 21.379 tok/s Prefill, TTFT 2.477 ms (6 Laufe)gpt-oss-20bNemotron-3-Nano-Omni-30B-A3B-Reasoning - 1.791,5 tok/s Generation, 7.874 tok/s Prefill, TTFT 4.722 ms (2 Laufe)Nemotron-3-Nano-Omni-...Nemotron-3-Nano-30B-A3B - 1.773,5 tok/s Generation, 8.253 tok/s Prefill, TTFT 4.653 ms (2 Laufe)Nemotron-3-Nano-30B-A...Nemotron-Cascade-2-30B-A3B - 1.768,1 tok/s Generation, 8.105 tok/s Prefill, TTFT 4.698 ms (2 Laufe)Nemotron-Cascade-2-30...gemma-4-E4B-it - 1.758,6 tok/s Generation, 13.272 tok/s Prefill, TTFT 3.925 ms (2 Laufe)gemma-4-E4B-itLaguna-XS-2.1 - 1.757,4 tok/s Generation, 8.641 tok/s Prefill, TTFT 5.037 ms (6 Laufe)Laguna-XS-2.1Qwen3-Coder-30B-A3B-Instruct - 1.690,0 tok/s Generation, 20.918 tok/s Prefill, TTFT 2.606 ms (4 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-30B-A3B-Thinking-2507 - 1.670,5 tok/s Generation, 19.956 tok/s Prefill, TTFT 3.573 ms (3 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-30B-A3B-Instruct-2507 - 1.658,1 tok/s Generation, 19.444 tok/s Prefill, TTFT 2.839 ms (4 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-Omni-30B-A3B-Thinking - 1.653,3 tok/s Generation, 18.068 tok/s Prefill, TTFT 3.734 ms (3 Laufe)Qwen3-Omni-30B-A3B-Th...Qwen3-VL-30B-A3B-Instruct - 1.639,0 tok/s Generation, 22.928 tok/s Prefill, TTFT 2.619 ms (4 Laufe)Qwen3-VL-30B-A3B-Inst...North-Mini-Code-1.0 - 1.621,0 tok/s Generation, 7.730 tok/s Prefill, TTFT 5.040 ms (2 Laufe)North-Mini-Code-1.0Ornith-1.0-35B - 1.607,5 tok/s Generation, 6.986 tok/s Prefill, TTFT 5.071 ms (2 Laufe)Ornith-1.0-35BGemma-4-26B-A4B-it - 1.589,1 tok/s Generation, 6.473 tok/s Prefill, TTFT 5.416 ms (2 Laufe)Gemma-4-26B-A4B-itOrnith-1.0-9B - 1.560,5 tok/s Generation, 10.193 tok/s Prefill, TTFT 4.497 ms (2 Laufe)Ornith-1.0-9BMeta-Llama-3.1-8B-Instruct - 1.533,0 tok/s Generation, 14.593 tok/s Prefill, TTFT 4.233 ms (2 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3.5-35B-A3B - 1.520,4 tok/s Generation, 13.098 tok/s Prefill, TTFT 3.996 ms (3 Laufe)Qwen3.5-35B-A3BQwen3.6-35B-A3B - 1.489,1 tok/s Generation, 11.758 tok/s Prefill, TTFT 4.017 ms (3 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 1.481,2 tok/s Generation, 7.662 tok/s Prefill, TTFT 5.259 ms (2 Laufe)Qwen-AgentWorld-35B-A...gpt-oss-120b - 1.335,9 tok/s Generation, 6.383 tok/s Prefill, TTFT 5.948 ms (4 Laufe)gpt-oss-120bQwen3-Coder-Next - 1.253,3 tok/s Generation, 4.766 tok/s Prefill, TTFT 7.334 ms (2 Laufe)Qwen3-Coder-Nextgemma-4-12B-it - 1.104,3 tok/s Generation, 5.032 tok/s Prefill, TTFT 11.207 ms (1 Lauf)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 1.060,0 tok/s Generation, 13.374 tok/s Prefill, TTFT 6.915 ms (3 Laufe)Ministral-3-14B-Reaso...Mistral-Small-4-119B-2603 - 959,6 tok/s Generation, 8.078 tok/s Prefill, TTFT 11.971 ms (1 Lauf)Mistral-Small-4-119B-...Laguna-S-2.1-INT4 - 835,1 tok/s Generation, 3.585 tok/s Prefill, TTFT 16.348 ms (4 Laufe)Laguna-S-2.1-INT4Magistral-Small-2509 - 726,9 tok/s Generation, 5.193 tok/s Prefill, TTFT 4.923 ms (2 Laufe)Magistral-Small-2509Devstral-Small-2-24B-Instruct-2512 - 725,6 tok/s Generation, 11.872 tok/s Prefill, TTFT 2.430 ms (1 Lauf)Devstral-Small-2-24B-...GLM-4.5-Air - 661,8 tok/s Generation, 3.559 tok/s Prefill, TTFT 18.166 ms (1 Lauf)GLM-4.5-AirDevstral-Small-2507 - 647,6 tok/s Generation, 10.804 tok/s Prefill, TTFT 10.971 ms (1 Lauf)Devstral-Small-2507
gemma-4-E2B-it 2.414,4 tok/sNemotron-3-Nano-4B 2.182,7 tok/sgpt-oss-20b 1.995,4 tok/sNemotron-3-Nano-Omni-30B-A3B-Reasoning 1.791,5 tok/sNemotron-3-Nano-30B-A3B 1.773,5 tok/sNemotron-Cascade-2-30B-A3B 1.768,1 tok/sgemma-4-E4B-it 1.758,6 tok/sLaguna-XS-2.1 1.757,4 tok/sQwen3-Coder-30B-A3B-Instruct 1.690,0 tok/sQwen3-30B-A3B-Thinking-2507 1.670,5 tok/sQwen3-30B-A3B-Instruct-2507 1.658,1 tok/sQwen3-Omni-30B-A3B-Thinking 1.653,3 tok/sQwen3-VL-30B-A3B-Instruct 1.639,0 tok/sNorth-Mini-Code-1.0 1.621,0 tok/sOrnith-1.0-35B 1.607,5 tok/sGemma-4-26B-A4B-it 1.589,1 tok/sOrnith-1.0-9B 1.560,5 tok/sMeta-Llama-3.1-8B-Instruct 1.533,0 tok/sQwen3.5-35B-A3B 1.520,4 tok/sQwen3.6-35B-A3B 1.489,1 tok/sQwen-AgentWorld-35B-A3B 1.481,2 tok/sgpt-oss-120b 1.335,9 tok/sQwen3-Coder-Next 1.253,3 tok/sgemma-4-12B-it 1.104,3 tok/sMinistral-3-14B-Reasoning-2512 1.060,0 tok/sMistral-Small-4-119B-2603 959,6 tok/sLaguna-S-2.1-INT4 835,1 tok/sMagistral-Small-2509 726,9 tok/sDevstral-Small-2-24B-Instruct-2512 725,6 tok/sGLM-4.5-Air 661,8 tok/sDevstral-Small-2507 647,6 tok/s

ENGnach Engine

2.8502.3901.9291.4691.0084.64413.46022.27531.090Prefill (tok/s)Generation (tok/s)llama.cpp - 2.414,4 tok/s Generation, 9.310 tok/s Prefill, TTFT 6.184 ms (65 Laufe)llama.cppvLLM - 1.443,9 tok/s Generation, 26.424 tok/s Prefill, TTFT 1.242 ms (15 Laufe)vLLM
llama.cpp 2.414,4 tok/svLLM 1.443,9 tok/s

GPUnach Grafikkarte

2.6562.5352.4142.2942.17311.76812.26912.76913.270Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 2.414,4 tok/s Generation, 12.519 tok/s Prefill, TTFT 5.257 ms (80 Laufe)NVIDIA RTX PRO 6000 B...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 2.414,4 tok/s
Platform

Mainboards with this CPU

Auf diesen Boards wurde AMD Ryzen 9 9950X 16-Core Processor gemessen – anklicken für Board-Details mit CPUs und Modellen.

🧮ASUSTeK COMPUTER INC. ProArt X870E-CREATOR WIFIASUS · 52 Modelle · 248 Läufe · bis 2.414,4 tok/s→
Throughput & latency

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Ryzen 9 9950X 16-Core Processor.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2.414,37 tok/s TG
Prefill 20.277 · TTFT 4.107 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
2Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2.182,67 tok/s TG
Prefill 10.599 · TTFT 5.598 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
3gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.995,37 tok/s TG
Prefill 16.158 · TTFT 5.309 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
4gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.993,51 tok/s TG
Prefill 16.318 · TTFT 5.323 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
5Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.791,48 tok/s TG
Prefill 7.972 · TTFT 6.996 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
6Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.773,53 tok/s TG
Prefill 8.720 · TTFT 6.861 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
7Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.768,14 tok/s TG
Prefill 8.360 · TTFT 6.952 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
8gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.758,55 tok/s TG
Prefill 13.889 · TTFT 5.964 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
9Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.757,37 tok/s TG
Prefill 9.025 · TTFT 7.343 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
10Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.753,82 tok/s TG
Prefill 9.267 · TTFT 7.329 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
11Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.740,43 tok/s TG
Prefill 9.653 · TTFT 7.258 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
12Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.689,95 tok/s TG
Prefill 14.458 · TTFT 6.609 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
13Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.670,49 tok/s TG
Prefill 10.926 · TTFT 7.140 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
14Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.658,09 tok/s TG
Prefill 13.451 · TTFT 6.808 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
15Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.653,28 tok/s TG
Prefill 10.581 · TTFT 7.259 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
16Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.639,00 tok/s TG
Prefill 13.790 · TTFT 6.893 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
17North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.621,00 tok/s TG
Prefill 8.046 · TTFT 7.551 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
18Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.607,48 tok/s TG
Prefill 7.448 · TTFT 7.492 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
19Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.589,11 tok/s TG
Prefill 6.805 · TTFT 8.073 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
20Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.560,53 tok/s TG
Prefill 10.558 · TTFT 6.806 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
21Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.532,95 tok/s TG
Prefill 17.861 · TTFT 6.225 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
22Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.520,35 tok/s TG
Prefill 7.808 · TTFT 7.689 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
23Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.489,06 tok/s TG
Prefill 8.018 · TTFT 7.851 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
24Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.481,23 tok/s TG
Prefill 8.109 · TTFT 7.868 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
25gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.443,88 tok/s TG
Prefill 35.348 · TTFT 560 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawDetails →
26gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.349,34 tok/s TG
Prefill 18.159 · TTFT 1.302 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
27gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.335,85 tok/s TG
Prefill 6.805 · TTFT 8.787 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
28gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.274,68 tok/s TG
Prefill 6.447 · TTFT 8.887 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
29Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.253,31 tok/s TG
Prefill 5.076 · TTFT 10.589 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
30Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.188,73 tok/s TG
Prefill 9.032 · TTFT 2.065 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
31gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.136,34 tok/s TG
Prefill 14.249 · TTFT 1.691 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
32gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.135,00 tok/s TG
Prefill 15.100 · TTFT 1.661 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
33gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.104,30 tok/s TG
Prefill 5.032 · TTFT 11.207 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
34Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.070,56 tok/s TG
Prefill 33.741 · TTFT 976 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
35Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.060,04 tok/s TG
Prefill 10.434 · TTFT 9.706 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
36Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.028,59 tok/s TG
Prefill 24.461 · TTFT 1.670 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
37Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.028,53 tok/s TG
Prefill 36.884 · TTFT 916 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
38Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.015,69 tok/s TG
Prefill 20.061 · TTFT 1.289 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
39Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.008,92 tok/s TG
Prefill 9.626 · TTFT 9.750 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
40Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,80 tok/s TG
Prefill 7.787 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
41Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,26 tok/s TG
Prefill 7.851 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
42Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,02 tok/s TG
Prefill 7.777 · TTFT 2.448 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
43Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
975,10 tok/s TG
Prefill 7.343 · TTFT 2.879 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
44Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
967,89 tok/s TG
Prefill 8.250 · TTFT 2.709 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
45Laguna-XS-2.1Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
966,13 tok/s TG
Prefill 8.310 · TTFT 2.703 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
46Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
961,53 tok/s TG
Prefill 32.305 · TTFT 1.633 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
47Mistral-Small-4-119B-2603119BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
959,57 tok/s TG
Prefill 8.078 · TTFT 11.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
48Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
952,78 tok/s TG
Prefill 20.106 · TTFT 1.542 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
49Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
938,21 tok/s TG
Prefill 13.797 · TTFT 2.113 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
50Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
926,17 tok/s TG
Prefill 9.914 · TTFT 2.386 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
51gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
914,25 tok/s TG
Prefill 12.655 · TTFT 1.885 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
52Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
910,76 tok/s TG
Prefill 14.150 · TTFT 2.150 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
53Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
910,74 tok/s TG
Prefill 33.907 · TTFT 1.527 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
54Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
909,92 tok/s TG
Prefill 9.716 · TTFT 2.416 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
55Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
906,04 tok/s TG
Prefill 39.029 · TTFT 1.193 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
56Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
905,02 tok/s TG
Prefill 13.235 · TTFT 2.202 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
57Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
882,70 tok/s TG
Prefill 6.523 · TTFT 2.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
58Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
876,87 tok/s TG
Prefill 11.325 · TTFT 2.242 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
59North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
876,14 tok/s TG
Prefill 7.415 · TTFT 2.530 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
60Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
869,89 tok/s TG
Prefill 6.141 · TTFT 2.760 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
61gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
842,94 tok/s TG
Prefill 31.098 · TTFT 319 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawDetails →
62Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
835,13 tok/s TG
Prefill 3.499 · TTFT 16.577 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
63Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
829,61 tok/s TG
Prefill 7.025 · TTFT 2.629 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
64Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
824,94 tok/s TG
Prefill 9.828 · TTFT 2.187 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
65Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
812,57 tok/s TG
Prefill 7.150 · TTFT 2.658 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
66Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
812,21 tok/s TG
Prefill 7.214 · TTFT 2.650 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
67Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
797,14 tok/s TG
Prefill 3.616 · TTFT 16.087 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
68Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
791,09 tok/s TG
Prefill 3.559 · TTFT 16.497 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
69Laguna-S-2.1-INT4Poolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
781,43 tok/s TG
Prefill 3.666 · TTFT 16.232 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawINT4Details →
70gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
774,35 tok/s TG
Prefill 5.796 · TTFT 3.127 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
71gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
765,17 tok/s TG
Prefill 6.482 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
72Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
726,94 tok/s TG
Prefill 10.204 · TTFT 2.619 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
73Qwen3-Coder-NextQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
726,51 tok/s TG
Prefill 4.456 · TTFT 4.078 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
74Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
725,58 tok/s TG
Prefill 11.872 · TTFT 2.430 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
75Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
724,52 tok/s TG
Prefill 181 · TTFT 7.226 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
76Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
676,76 tok/s TG
Prefill 21.675 · TTFT 725 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
77Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
666,52 tok/s TG
Prefill 27.804 · TTFT 465 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
78GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
661,81 tok/s TG
Prefill 3.559 · TTFT 18.166 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
79Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
649,04 tok/s TG
Prefill 17.868 · TTFT 764 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMvLLMgodclawAWQDetails →
80Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
647,58 tok/s TG
Prefill 10.804 · TTFT 10.971 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Ryzen 9 9950X 16-Core Processor.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – AMD Ryzen 9 9950X 16-Core Processor

HerstellerAMD
TDP230 W
Best generation2.414,4 tok/s
Best prefill39.029 tok/s
Models52
Messläufe (Performance)247