Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🎮
Grafikkarte

AMD Radeon AI PRO R9700

AMD32 GB VRAM
★★★★★3,0/ 5 · Bewertung
978Benchmarks
65Modelle
978Performance
0Harness
20 WIdle-Leistung
300 WMax-Leistung
Beste Generation
667,0 tok/s
Nemotron-3-Nano-4B
∅ Generation
77,4 tok/s
Schnitt aus 978 Läufen
Bester Prefill
35.719 tok/s
Prompt-Verarbeitung
Bester TTFT
31 ms
Time to First Token
Beste Harness-Quote
–%
noch kein Harness
🏆
Nemotron-3-Nano-4B läuft am schnellsten auf dieser GPU · 667,0 tok/s
Bester Prefill: 35.719 tok/s · 65 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf AMD Radeon AI PRO R9700 – umschaltbar nach Generation, Prefill oder Kombiwert.

Nemotron-3-Nano-4B4B
667,0 tok/s
Qwen3-0.6B0.6B
561,4 tok/s
Meta-Llama-3.1-8B-Instruct8B
518,3 tok/s
Qwen3-1.7B1.7B
492,7 tok/s
Ornith-1.0-9B9B
487,6 tok/s
gemma-4-E2B-it5B
427,8 tok/s
Llama-3.2-3B-Instruct3B
397,2 tok/s
Qwen2.5-3B-Instruct3B
364,1 tok/s
Ministral-3-14B-Reasoning-251214B
329,9 tok/s
Qwen3-4B4B
325,2 tok/s
Anzeige
Videoreihe und Benchmarkauswertung zur AMD R9700
▶

YouTube-Video – lädt erst nach deiner Zustimmung und setzt dann Cookies von YouTube/Google.

Bei YouTube ansehen ↗
Performanceprofil

Durchsatz auf AMD Radeon AI PRO R9700

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

82463344125058,408.62517.24925.874Prefill (tok/s)Generation (tok/s)Nemotron-3-Nano-4B - 667,0 tok/s Generation, 4.204 tok/s Prefill, TTFT 9.885 ms (8 Laufe)Nemotron-3-Nano-4BQwen3-0.6B - 561,4 tok/s Generation, 20.958 tok/s Prefill, TTFT 573 ms (3 Laufe)Qwen3-0.6BMeta-Llama-3.1-8B-Instruct - 518,3 tok/s Generation, 9.871 tok/s Prefill, TTFT 11.240 ms (7 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3-1.7B - 492,7 tok/s Generation, 16.148 tok/s Prefill, TTFT 1.186 ms (2 Laufe)Qwen3-1.7BOrnith-1.0-9B - 487,6 tok/s Generation, 4.676 tok/s Prefill, TTFT 13.870 ms (6 Laufe)Ornith-1.0-9Bgemma-4-E2B-it - 427,8 tok/s Generation, 7.765 tok/s Prefill, TTFT 1.901 ms (2 Laufe)gemma-4-E2B-itLlama-3.2-3B-Instruct - 397,2 tok/s Generation, 14.212 tok/s Prefill, TTFT 1.531 ms (2 Laufe)Llama-3.2-3B-InstructQwen2.5-3B-Instruct - 364,1 tok/s Generation, 13.254 tok/s Prefill, TTFT 1.565 ms (2 Laufe)Qwen2.5-3B-InstructMinistral-3-14B-Reasoning-2512 - 329,9 tok/s Generation, 4.890 tok/s Prefill, TTFT 31.098 ms (3 Laufe)Ministral-3-14B-Reaso...Qwen3-4B - 325,2 tok/s Generation, 9.520 tok/s Prefill, TTFT 2.933 ms (1 Lauf)Qwen3-4Bgpt-oss-20b - 323,6 tok/s Generation, 4.845 tok/s Prefill, TTFT 3.056 ms (2 Laufe)gpt-oss-20bNemotron-Cascade-2-30B-A3B - 295,2 tok/s Generation, 3.614 tok/s Prefill, TTFT 4.927 ms (2 Laufe)Nemotron-Cascade-2-30...Nemotron-3-Nano-30B-A3B - 294,4 tok/s Generation, 3.088 tok/s Prefill, TTFT 4.822 ms (3 Laufe)Nemotron-3-Nano-30B-A...Nemotron-3.5-Lightning-30B-A3B - 290,3 tok/s Generation, 7.905 tok/s Prefill, TTFT 1.298 ms (15 Laufe)Nemotron-3.5-Lightnin...Laguna-XS-2.1 - 288,8 tok/s Generation, 4.736 tok/s Prefill, TTFT 6.808 ms (1 Lauf)Laguna-XS-2.1gemma-4-E4B-it - 277,5 tok/s Generation, 4.348 tok/s Prefill, TTFT 4.623 ms (1 Lauf)gemma-4-E4B-itNorth-Mini-Code-1.0 - 275,3 tok/s Generation, 4.383 tok/s Prefill, TTFT 5.205 ms (1 Lauf)North-Mini-Code-1.0Qwen3.6-35B-A3B - 271,4 tok/s Generation, 7.685 tok/s Prefill, TTFT 1.344 ms (6 Laufe)Qwen3.6-35B-A3BQwen2.5-7B-Instruct - 250,6 tok/s Generation, 9.085 tok/s Prefill, TTFT 3.442 ms (1 Lauf)Qwen2.5-7B-InstructQwen3-Coder-30B-A3B-Instruct - 250,2 tok/s Generation, 7.760 tok/s Prefill, TTFT 4.096 ms (1 Lauf)Qwen3-Coder-30B-A3B-I...Qwen3-30B-A3B-Instruct-2507 - 240,2 tok/s Generation, 7.577 tok/s Prefill, TTFT 4.168 ms (1 Lauf)Qwen3-30B-A3B-Instruc...Qwen3-30B-A3B-Thinking-2507 - 238,8 tok/s Generation, 5.303 tok/s Prefill, TTFT 5.204 ms (1 Lauf)Qwen3-30B-A3B-Thinkin...Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated - 233,4 tok/s Generation, 7.121 tok/s Prefill, TTFT 4.462 ms (1 Lauf)Huihui-Qwen3-VL-30B-A...Qwen3-VL-30B-A3B-Instruct - 233,2 tok/s Generation, 6.992 tok/s Prefill, TTFT 4.523 ms (1 Lauf)Qwen3-VL-30B-A3B-Inst...Magistral-Small-2509 - 230,0 tok/s Generation, 631 tok/s Prefill, TTFT 24.201 ms (2 Laufe)Magistral-Small-2509Qwen3.8-27B - 229,4 tok/s Generation, 5.064 tok/s Prefill, TTFT 1.011 ms (1 Lauf)Qwen3.8-27BQwen3.5-35B-A3B - 220,5 tok/s Generation, 4.018 tok/s Prefill, TTFT 5.334 ms (2 Laufe)Qwen3.5-35B-A3BOrnith-1.0-35B - 216,9 tok/s Generation, 3.842 tok/s Prefill, TTFT 5.955 ms (1 Lauf)Ornith-1.0-35BOrnith-1.5-35B-A3B - 215,5 tok/s Generation, 3.907 tok/s Prefill, TTFT 5.778 ms (1 Lauf)Ornith-1.5-35B-A3B
Nemotron-3-Nano-4B 667,0 tok/sQwen3-0.6B 561,4 tok/sMeta-Llama-3.1-8B-Instruct 518,3 tok/sQwen3-1.7B 492,7 tok/sOrnith-1.0-9B 487,6 tok/sgemma-4-E2B-it 427,8 tok/sLlama-3.2-3B-Instruct 397,2 tok/sQwen2.5-3B-Instruct 364,1 tok/sMinistral-3-14B-Reasoning-2512 329,9 tok/sQwen3-4B 325,2 tok/sgpt-oss-20b 323,6 tok/sNemotron-Cascade-2-30B-A3B 295,2 tok/sNemotron-3-Nano-30B-A3B 294,4 tok/sNemotron-3.5-Lightning-30B-A3B 290,3 tok/sLaguna-XS-2.1 288,8 tok/sgemma-4-E4B-it 277,5 tok/sNorth-Mini-Code-1.0 275,3 tok/sQwen3.6-35B-A3B 271,4 tok/sQwen2.5-7B-Instruct 250,6 tok/sQwen3-Coder-30B-A3B-Instruct 250,2 tok/sQwen3-30B-A3B-Instruct-2507 240,2 tok/sQwen3-30B-A3B-Thinking-2507 238,8 tok/sHuihui-Qwen3-VL-30B-A3B-Instruct-abliterated 233,4 tok/sQwen3-VL-30B-A3B-Instruct 233,2 tok/sMagistral-Small-2509 230,0 tok/sQwen3.8-27B 229,4 tok/sQwen3.5-35B-A3B 220,5 tok/sOrnith-1.0-35B 216,9 tok/sOrnith-1.5-35B-A3B 215,5 tok/s

ENGnach Engine

8096444793131483.42810.29117.15424.016Prefill (tok/s)Generation (tok/s)llama.cpp - 667,0 tok/s Generation, 7.053 tok/s Prefill, TTFT 6.756 ms (78 Laufe)llama.cppvLLM - 290,3 tok/s Generation, 20.392 tok/s Prefill, TTFT 1.013 ms (2 Laufe)vLLM
llama.cpp 667,0 tok/svLLM 290,3 tok/s

CPUnach Prozessor

7556856145444745.6086.9178.2279.536Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 667,0 tok/s Generation, 6.509 tok/s Prefill, TTFT 8.886 ms (47 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 3 3100 4-Core Processor - 561,4 tok/s Generation, 8.635 tok/s Prefill, TTFT 3.440 ms (33 Laufe)AMD Ryzen 3 3100 4-Co...
AMD Ryzen Threadripper PRO 7955WX 16-Cores 667,0 tok/sAMD Ryzen 3 3100 4-Core Processor 561,4 tok/s
Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Radeon AI PRO R9700.

Im Leaderboard →
Messwert:
Größe
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
667,02 tok/s TG
Prefill 4.019 · TTFT 17.735 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
2Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,34 tok/s TG
Prefill 4.936 · TTFT 17.123 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
3Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,37 tok/s TG
Prefill 4.530 · TTFT 17.991 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
4Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
561,43 tok/s TG
Prefill 27.407 · TTFT 973 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
5Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
518,27 tok/s TG
Prefill 13.775 · TTFT 18.702 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
6Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
508,08 tok/s TG
Prefill 5.204 · TTFT 21.109 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
7Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
492,68 tok/s TG
Prefill 18.535 · TTFT 1.471 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
8Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
489,43 tok/s TG
Prefill 10.618 · TTFT 18.898 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
9Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
487,60 tok/s TG
Prefill 5.077 · TTFT 20.649 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
10Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
476,21 tok/s TG
Prefill 5.858 · TTFT 20.719 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
11Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
474,97 tok/s TG
Prefill 3.481 · TTFT 22.488 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
12Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
449,35 tok/s TG
Prefill 21.718 · TTFT 571 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
13gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
427,76 tok/s TG
Prefill 8.456 · TTFT 2.403 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
14Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
397,16 tok/s TG
Prefill 14.911 · TTFT 2.001 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
15Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
382,25 tok/s TG
Prefill 3.656 · TTFT 5.903 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
16Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
375,87 tok/s TG
Prefill 4.619 · TTFT 5.434 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
17Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
364,13 tok/s TG
Prefill 15.658 · TTFT 1.918 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
18Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
358,48 tok/s TG
Prefill 4.148 · TTFT 5.814 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
19Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
344,85 tok/s TG
Prefill 4.759 · TTFT 5.325 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
20Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
329,89 tok/s TG
Prefill 5.097 · TTFT 30.395 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
21Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
327,48 tok/s TG
Prefill 6.307 · TTFT 30.045 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
22Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
325,24 tok/s TG
Prefill 9.520 · TTFT 2.933 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
23Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
325,23 tok/s TG
Prefill 3.265 · TTFT 32.856 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
24gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
323,59 tok/s TG
Prefill 5.090 · TTFT 3.955 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliMXFP4Details →
25Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
320,89 tok/s TG
Prefill 13.760 · TTFT 902 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
26Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
295,16 tok/s TG
Prefill 4.265 · TTFT 6.027 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
27Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
294,37 tok/s TG
Prefill 4.193 · TTFT 6.057 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
28Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
290,27 tok/s TG
Prefill 35.719 · TTFT 1.015 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16Details →
29Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
289,42 tok/s TG
Prefill 10.849 · TTFT 1.212 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
30Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
288,80 tok/s TG
Prefill 4.736 · TTFT 6.808 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
31Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
286,24 tok/s TG
Prefill 2.858 · TTFT 1.792 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
32Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
283,50 tok/s TG
Prefill 4.190 · TTFT 6.068 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
33Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
281,80 tok/s TG
Prefill 10.273 · TTFT 5.323 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
34Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
277,95 tok/s TG
Prefill 8.575 · TTFT 597 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
35gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
277,51 tok/s TG
Prefill 4.348 · TTFT 4.623 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
36Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
275,72 tok/s TG
Prefill 13.406 · TTFT 4.952 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
37North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
275,30 tok/s TG
Prefill 4.383 · TTFT 5.205 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
38Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
274,94 tok/s TG
Prefill 6.188 · TTFT 6.209 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
39Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
273,62 tok/s TG
Prefill 5.151 · TTFT 994 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
40gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
273,22 tok/s TG
Prefill 7.074 · TTFT 1.399 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
41Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
271,41 tok/s TG
Prefill 8.886 · TTFT 576 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
42Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
271,41 tok/s TG
Prefill 8.886 · TTFT 0 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-benchDetails →
43Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
270,40 tok/s TG
Prefill 6.824 · TTFT 750 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
44Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
265,88 tok/s TG
Prefill 2.862 · TTFT 894 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
45Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
262,22 tok/s TG
Prefill 9.011 · TTFT 568 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmUD-Q4_K_MDetails →
46Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
261,48 tok/s TG
Prefill 13.512 · TTFT 1.061 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
47Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
261,45 tok/s TG
Prefill 4.824 · TTFT 6.145 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
48Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
260,59 tok/s TG
Prefill 6.954 · TTFT 368 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
49Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
258,77 tok/s TG
Prefill 9.631 · TTFT 3.487 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
50Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
256,65 tok/s TG
Prefill 4.749 · TTFT 539 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
51Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
255,30 tok/s TG
Prefill 5.644 · TTFT 6.016 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
52Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
254,56 tok/s TG
Prefill 3.174 · TTFT 7.205 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
53Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
253,13 tok/s TG
Prefill 5.903 · TTFT 434 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
54Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,57 tok/s TG
Prefill 9.085 · TTFT 3.442 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
55Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,18 tok/s TG
Prefill 7.760 · TTFT 4.096 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
56Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,85 tok/s TG
Prefill 2.967 · TTFT 3.756 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
57Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,13 tok/s TG
Prefill 9.886 · TTFT 518 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
58Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
244,04 tok/s TG
Prefill 5.934 · TTFT 863 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
59gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
242,43 tok/s TG
Prefill 4.599 · TTFT 2.157 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliMXFP4Details →
60Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
241,82 tok/s TG
Prefill 7.918 · TTFT 647 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
61Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
240,22 tok/s TG
Prefill 7.577 · TTFT 4.168 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
62Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,79 tok/s TG
Prefill 5.303 · TTFT 5.204 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
63Huihui-Qwen3-VL-30B-A3B-Instruct-abliterated30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,40 tok/s TG
Prefill 7.121 · TTFT 4.462 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
64Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,22 tok/s TG
Prefill 6.992 · TTFT 4.523 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
65Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
232,53 tok/s TG
Prefill 7.614 · TTFT 336 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmUD-Q4_K_MDetails →
66Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
229,95 tok/s TG
Prefill 655 · TTFT 21.862 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
67Qwen3.8-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
229,39 tok/s TG
Prefill 5.064 · TTFT 1.011 ms
10×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
68Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
227,38 tok/s TG
Prefill 13.749 · TTFT 177 ms
1×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ8_0Details →
69Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,35 tok/s TG
Prefill 7.505 · TTFT 341 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
70Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
224,79 tok/s TG
Prefill 606 · TTFT 26.540 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
71Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
222,82 tok/s TG
Prefill 4.205 · TTFT 4.901 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
72Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
220,45 tok/s TG
Prefill 4.107 · TTFT 5.581 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
73Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,41 tok/s TG
Prefill 2.159 · TTFT 4.552 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
74Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,85 tok/s TG
Prefill 3.842 · TTFT 5.955 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
75Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,61 tok/s TG
Prefill 2.963 · TTFT 3.827 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
76Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,36 tok/s TG
Prefill 8.015 · TTFT 319 ms
5×4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
77Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 3.928 · TTFT 5.087 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
78Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
215,49 tok/s TG
Prefill 2.912 · TTFT 3.858 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
79Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
215,46 tok/s TG
Prefill 3.907 · TTFT 5.778 ms
10×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
80Nemotron-3.5-Lightning-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
213,81 tok/s TG
Prefill 3.032 · TTFT 3.678 ms
5×AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Radeon AI PRO R9700.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – AMD Radeon AI PRO R9700

HerstellerAMD
ArchitekturRDNA 4
VRAM32 GB
Tensor-Recheneinheiten128
Speicherbandbreite640 GB/s
TDP300 W
PCIe5.0
Release07/2025
Bewertung★★★★★3,0
Beste Generation667,0 tok/s
Bester Prefill35.719 tok/s
Modelle65
Messläufe (Performance)978