Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🎮
Graphics card

AMD Radeon AI PRO R9700

AMD32 GB VRAM
★★★★★3,0/ 5 · Bewertung
855Benchmarks
53Models
855Performance
0Harness
20 WIdle power
300 WMax power
Best generation
667,0 tok/s
Nemotron-3-Nano-4B
∅ Generation
65,8 tok/s
Schnitt aus 855 Läufen
Best prefill
35.719 tok/s
Prompt processing
Best TTFT
31 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
Nemotron-3-Nano-4B läuft am schnellsten auf dieser GPU · 667,0 tok/s
Bester Prefill: 35.719 tok/s · 53 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf AMD Radeon AI PRO R9700 – umschaltbar nach Generation, Prefill oder Kombiwert.

Nemotron-3-Nano-4B4B
667,0 tok/s
Meta-Llama-3.1-8B-Instruct8B
518,3 tok/s
Ornith-1.0-9B9B
487,6 tok/s
Ministral-3-14B-Reasoning-251214B
329,9 tok/s
Nemotron-3.5-Lightning-30B-A3B30B
290,3 tok/s
Qwen3.6-35B-A3B35B
271,4 tok/s
Magistral-Small-250924B
230,0 tok/s
Qwen3.8-27B27B
229,4 tok/s
Qwen3.5-35B-A3B35B
220,5 tok/s
Nemotron-3-Nano-30B-A3B30B
217,4 tok/s
Anzeige
Videoreihe und Benchmarkauswertung zur AMD R9700
▶

YouTube-Video – lädt erst nach deiner Zustimmung und setzt dann Cookies von YouTube/Google.

Bei YouTube ansehen ↗
Performance profile

Durchsatz auf AMD Radeon AI PRO R9700

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

82962943023030,304.0598.11812.177Prefill (tok/s)Generation (tok/s)Nemotron-3-Nano-4B - 667,0 tok/s Generation, 4.318 tok/s Prefill, TTFT 11.666 ms (6 Laufe)Nemotron-3-Nano-4BMeta-Llama-3.1-8B-Instruct - 518,3 tok/s Generation, 9.911 tok/s Prefill, TTFT 12.532 ms (6 Laufe)Meta-Llama-3.1-8B-Ins...Ornith-1.0-9B - 487,6 tok/s Generation, 4.676 tok/s Prefill, TTFT 13.870 ms (6 Laufe)Ornith-1.0-9BMinistral-3-14B-Reasoning-2512 - 329,9 tok/s Generation, 4.880 tok/s Prefill, TTFT 25.509 ms (4 Laufe)Ministral-3-14B-Reaso...Nemotron-3.5-Lightning-30B-A3B - 290,3 tok/s Generation, 8.244 tok/s Prefill, TTFT 705 ms (15 Laufe)Nemotron-3.5-Lightnin...Qwen3.6-35B-A3B - 271,4 tok/s Generation, 6.412 tok/s Prefill, TTFT 2.174 ms (9 Laufe)Qwen3.6-35B-A3BMagistral-Small-2509 - 230,0 tok/s Generation, 622 tok/s Prefill, TTFT 25.536 ms (3 Laufe)Magistral-Small-2509Qwen3.8-27B - 229,4 tok/s Generation, 5.064 tok/s Prefill, TTFT 1.011 ms (1 Lauf)Qwen3.8-27BQwen3.5-35B-A3B - 220,5 tok/s Generation, 3.880 tok/s Prefill, TTFT 3.923 ms (4 Laufe)Qwen3.5-35B-A3BNemotron-3-Nano-30B-A3B - 217,4 tok/s Generation, 3.069 tok/s Prefill, TTFT 4.788 ms (8 Laufe)Nemotron-3-Nano-30B-A...Ornith-1.0-35B - 216,9 tok/s Generation, 3.667 tok/s Prefill, TTFT 4.185 ms (4 Laufe)Ornith-1.0-35BDevstral-Small-2-24B-Instruct-2512 - 206,3 tok/s Generation, 4.574 tok/s Prefill, TTFT 46.373 ms (3 Laufe)Devstral-Small-2-24B-...Devstral-Small-2507 - 205,8 tok/s Generation, 5.820 tok/s Prefill, TTFT 34.030 ms (3 Laufe)Devstral-Small-2507Codestral-22B-v0.1 - 201,5 tok/s Generation, 3.744 tok/s Prefill, TTFT 49.889 ms (3 Laufe)Codestral-22B-v0.1Muse-Glimmer-30B - 199,1 tok/s Generation, 2.520 tok/s Prefill, TTFT 2.032 ms (1 Lauf)Muse-Glimmer-30BQwen-AgentWorld-35B-A3B - 192,0 tok/s Generation, 3.761 tok/s Prefill, TTFT 4.028 ms (4 Laufe)Qwen-AgentWorld-35B-A...
Nemotron-3-Nano-4B 667,0 tok/sMeta-Llama-3.1-8B-Instruct 518,3 tok/sOrnith-1.0-9B 487,6 tok/sMinistral-3-14B-Reasoning-2512 329,9 tok/sNemotron-3.5-Lightning-30B-A3B 290,3 tok/sQwen3.6-35B-A3B 271,4 tok/sMagistral-Small-2509 230,0 tok/sQwen3.8-27B 229,4 tok/sQwen3.5-35B-A3B 220,5 tok/sNemotron-3-Nano-30B-A3B 217,4 tok/sOrnith-1.0-35B 216,9 tok/sDevstral-Small-2-24B-Instruct-2512 206,3 tok/sDevstral-Small-2507 205,8 tok/sCodestral-22B-v0.1 201,5 tok/sMuse-Glimmer-30B 199,1 tok/sQwen-AgentWorld-35B-A3B 192,0 tok/s

ENGnach Engine

8096444793131481.0848.84716.61124.374Prefill (tok/s)Generation (tok/s)llama.cpp - 667,0 tok/s Generation, 5.066 tok/s Prefill, TTFT 11.867 ms (78 Laufe)llama.cppvLLM - 290,3 tok/s Generation, 20.392 tok/s Prefill, TTFT 1.013 ms (2 Laufe)vLLM
llama.cpp 667,0 tok/svLLM 290,3 tok/s

CPUnach Prozessor

7347006676346005.1235.3405.5585.776Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 667,0 tok/s Generation, 5.449 tok/s Prefill, TTFT 11.592 ms (80 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 7955WX 16-Cores 667,0 tok/s
Throughput & latency

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Radeon AI PRO R9700.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
667,02 tok/s TG
Prefill 4.019 · TTFT 17.735 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
2Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
655,34 tok/s TG
Prefill 4.936 · TTFT 17.123 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
3Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
629,37 tok/s TG
Prefill 4.530 · TTFT 17.991 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
4Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
518,27 tok/s TG
Prefill 13.775 · TTFT 18.702 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
5Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
508,08 tok/s TG
Prefill 5.204 · TTFT 21.109 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
6Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
489,43 tok/s TG
Prefill 10.618 · TTFT 18.898 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
7Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
487,60 tok/s TG
Prefill 5.077 · TTFT 20.649 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
8Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
476,21 tok/s TG
Prefill 5.858 · TTFT 20.719 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
9Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
474,97 tok/s TG
Prefill 3.481 · TTFT 22.488 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
10Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
382,25 tok/s TG
Prefill 3.656 · TTFT 5.903 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
11Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
375,87 tok/s TG
Prefill 4.619 · TTFT 5.434 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
12Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
358,48 tok/s TG
Prefill 4.148 · TTFT 5.814 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
13Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
329,89 tok/s TG
Prefill 5.097 · TTFT 30.395 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
14Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
327,48 tok/s TG
Prefill 6.307 · TTFT 30.045 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
15Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
325,23 tok/s TG
Prefill 3.265 · TTFT 32.856 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
16Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
290,27 tok/s TG
Prefill 35.719 · TTFT 1.015 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawBF16Details →
17Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
286,24 tok/s TG
Prefill 2.858 · TTFT 1.792 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
18Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
281,80 tok/s TG
Prefill 10.273 · TTFT 5.323 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
19Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
277,95 tok/s TG
Prefill 8.575 · TTFT 597 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
20Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
275,72 tok/s TG
Prefill 13.406 · TTFT 4.952 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
21Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
274,94 tok/s TG
Prefill 6.188 · TTFT 6.209 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
22Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,62 tok/s TG
Prefill 5.151 · TTFT 994 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
23Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,41 tok/s TG
Prefill 8.886 · TTFT 576 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
24Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,41 tok/s TG
Prefill 8.886 · TTFT 0 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-benchDetails →
25Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
270,40 tok/s TG
Prefill 6.824 · TTFT 750 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
26Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
265,88 tok/s TG
Prefill 2.862 · TTFT 894 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
27Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,22 tok/s TG
Prefill 9.011 · TTFT 568 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmUD-Q4_K_MDetails →
28Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
261,45 tok/s TG
Prefill 4.824 · TTFT 6.145 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
29Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
260,59 tok/s TG
Prefill 6.954 · TTFT 368 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
30Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
256,65 tok/s TG
Prefill 4.749 · TTFT 539 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
31Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
255,30 tok/s TG
Prefill 5.644 · TTFT 6.016 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
32Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
254,56 tok/s TG
Prefill 3.174 · TTFT 7.205 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
33Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,13 tok/s TG
Prefill 5.903 · TTFT 434 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
34Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,13 tok/s TG
Prefill 9.886 · TTFT 518 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
35Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
244,04 tok/s TG
Prefill 5.934 · TTFT 863 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
36Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
241,82 tok/s TG
Prefill 7.918 · TTFT 647 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
37Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
232,53 tok/s TG
Prefill 7.614 · TTFT 336 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmUD-Q4_K_MDetails →
38Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
229,95 tok/s TG
Prefill 655 · TTFT 21.862 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
39Qwen3.8-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
229,39 tok/s TG
Prefill 5.064 · TTFT 1.011 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
40Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,35 tok/s TG
Prefill 7.505 · TTFT 341 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
41Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
224,79 tok/s TG
Prefill 606 · TTFT 26.540 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
42Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
222,82 tok/s TG
Prefill 4.205 · TTFT 4.901 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
43Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
220,45 tok/s TG
Prefill 4.107 · TTFT 5.581 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
44Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
217,41 tok/s TG
Prefill 2.159 · TTFT 4.552 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
45Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,85 tok/s TG
Prefill 3.842 · TTFT 5.955 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
46Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,36 tok/s TG
Prefill 8.015 · TTFT 319 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
47Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 3.928 · TTFT 5.087 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
48Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
212,92 tok/s TG
Prefill 3.795 · TTFT 6.753 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
49Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
210,79 tok/s TG
Prefill 606 · TTFT 28.206 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
50Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
210,46 tok/s TG
Prefill 6.833 · TTFT 375 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
51Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
210,36 tok/s TG
Prefill 3.683 · TTFT 5.472 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
52Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
207,55 tok/s TG
Prefill 3.338 · TTFT 3.388 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
53Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,34 tok/s TG
Prefill 5.938 · TTFT 44.987 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
54Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,26 tok/s TG
Prefill 4.766 · TTFT 42.744 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
55Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,80 tok/s TG
Prefill 7.519 · TTFT 31.654 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
56Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,12 tok/s TG
Prefill 6.044 · TTFT 32.830 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
57Nemotron-3.5-Lightning-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
202,20 tok/s TG
Prefill 5.476 · TTFT 468 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ8_0Details →
58Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,46 tok/s TG
Prefill 3.877 · TTFT 48.219 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
59Muse-Glimmer-30B30BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
199,09 tok/s TG
Prefill 2.520 · TTFT 2.032 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmQ4_K_MDetails →
60Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
199,08 tok/s TG
Prefill 3.016 · TTFT 51.389 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
61Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,80 tok/s TG
Prefill 5.019 · TTFT 46.235 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
62Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
192,69 tok/s TG
Prefill 3.898 · TTFT 37.605 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
63Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
192,66 tok/s TG
Prefill 2.706 · TTFT 3.642 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
64Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
192,16 tok/s TG
Prefill 2.755 · TTFT 3.564 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
65Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
192,04 tok/s TG
Prefill 3.084 · TTFT 2.806 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
66Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,98 tok/s TG
Prefill 4.071 · TTFT 5.658 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
67Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,35 tok/s TG
Prefill 4.100 · TTFT 5.611 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
68Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
187,06 tok/s TG
Prefill 2.824 · TTFT 3.499 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
69Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
186,28 tok/s TG
Prefill 3.569 · TTFT 2.478 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
70Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
185,39 tok/s TG
Prefill 3.957 · TTFT 2.535 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
71Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
183,45 tok/s TG
Prefill 4.012 · TTFT 2.498 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
72Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,99 tok/s TG
Prefill 3.958 · TTFT 2.533 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
73Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,97 tok/s TG
Prefill 3.848 · TTFT 5.198 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
74Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,91 tok/s TG
Prefill 2.336 · TTFT 55.212 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
75Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,74 tok/s TG
Prefill 3.527 · TTFT 2.492 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
76Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,28 tok/s TG
Prefill 3.620 · TTFT 2.799 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
77Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,01 tok/s TG
Prefill 3.865 · TTFT 5.849 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
78Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,15 tok/s TG
Prefill 3.106 · TTFT 7.058 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
79Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
173,97 tok/s TG
Prefill 3.522 · TTFT 2.513 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
80Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
173,24 tok/s TG
Prefill 4.852 · TTFT 8.741 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Radeon AI PRO R9700.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – AMD Radeon AI PRO R9700

HerstellerAMD
ArchitekturRDNA 4
VRAM32 GB
Tensor-Recheneinheiten128
Speicherbandbreite640 GB/s
TDP300 W
PCIe5.0
Release07/2025
Bewertung★★★★★3,0
Best generation667,0 tok/s
Best prefill35.719 tok/s
Models53
Messläufe (Performance)855