Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🎮
Graphics card

AMD Radeon PRO W7800 48GB

AMD48 GB VRAM
149Benchmarks
24Models
149Performance
0Harness
260 WMax power
Best generation
702,9 tok/s
gemma-4-E2B-it
∅ Generation
130,3 tok/s
Schnitt aus 149 Läufen
Best prefill
13.392 tok/s
Prompt processing
Best TTFT
459 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser GPU · 702,9 tok/s
Bester Prefill: 13.392 tok/s · 24 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf AMD Radeon PRO W7800 48GB – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
702,9 tok/s
Meta-Llama-3.1-8B-Instruct8B
323,1 tok/s
Ornith-1.0-9B9B
294,0 tok/s
Qwen3-Coder-30B-A3B-Instruct30B
289,5 tok/s
gpt-oss-20b20B
280,0 tok/s
North-Mini-Code-1.0
276,9 tok/s
Ministral-3-14B-Reasoning-251214B
272,8 tok/s
Qwen3-30B-A3B-Instruct-250730B
267,7 tok/s
Qwen3-30B-A3B-Thinking-250730B
258,3 tok/s
Gemma-4-26B-A4B-it26B
247,3 tok/s
Anzeige
Performance profile

Durchsatz auf AMD Radeon PRO W7800 48GB

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

8926694462230,004.7519.50214.252Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 702,9 tok/s Generation, 5.216 tok/s Prefill, TTFT 3.164 ms (7 Laufe)gemma-4-E2B-itMeta-Llama-3.1-8B-Instruct - 323,1 tok/s Generation, 4.980 tok/s Prefill, TTFT 4.152 ms (9 Laufe)Meta-Llama-3.1-8B-Ins...Ornith-1.0-9B - 294,0 tok/s Generation, 2.236 tok/s Prefill, TTFT 6.586 ms (7 Laufe)Ornith-1.0-9BQwen3-Coder-30B-A3B-Instruct - 289,5 tok/s Generation, 8.142 tok/s Prefill, TTFT 3.150 ms (4 Laufe)Qwen3-Coder-30B-A3B-I...gpt-oss-20b - 280,0 tok/s Generation, 3.327 tok/s Prefill, TTFT 2.726 ms (6 Laufe)gpt-oss-20bNorth-Mini-Code-1.0 - 276,9 tok/s Generation, 3.076 tok/s Prefill, TTFT 5.061 ms (4 Laufe)North-Mini-Code-1.0Ministral-3-14B-Reasoning-2512 - 272,8 tok/s Generation, 1.604 tok/s Prefill, TTFT 10.807 ms (7 Laufe)Ministral-3-14B-Reaso...Qwen3-30B-A3B-Instruct-2507 - 267,7 tok/s Generation, 6.133 tok/s Prefill, TTFT 3.465 ms (2 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-30B-A3B-Thinking-2507 - 258,3 tok/s Generation, 6.115 tok/s Prefill, TTFT 3.461 ms (2 Laufe)Qwen3-30B-A3B-Thinkin...Gemma-4-26B-A4B-it - 247,3 tok/s Generation, 2.822 tok/s Prefill, TTFT 4.850 ms (5 Laufe)Gemma-4-26B-A4B-itQwen3.6-35B-A3B - 235,5 tok/s Generation, 5.874 tok/s Prefill, TTFT 5.380 ms (6 Laufe)Qwen3.6-35B-A3BQwen3-VL-30B-A3B-Instruct - 233,0 tok/s Generation, 5.584 tok/s Prefill, TTFT 4.585 ms (2 Laufe)Qwen3-VL-30B-A3B-Inst...Qwen3-Omni-30B-A3B-Thinking - 205,1 tok/s Generation, 4.373 tok/s Prefill, TTFT 3.193 ms (3 Laufe)Qwen3-Omni-30B-A3B-Th...Qwen3.5-35B-A3B - 204,6 tok/s Generation, 11.587 tok/s Prefill, TTFT 2.088 ms (2 Laufe)Qwen3.5-35B-A3Bgemma-4-12B-it - 202,0 tok/s Generation, 1.583 tok/s Prefill, TTFT 13.022 ms (6 Laufe)gemma-4-12B-itMagistral-Small-2509 - 153,0 tok/s Generation, 891 tok/s Prefill, TTFT 26.016 ms (1 Lauf)Magistral-Small-2509Devstral-Small-2507 - 143,3 tok/s Generation, 1.804 tok/s Prefill, TTFT 16.612 ms (2 Laufe)Devstral-Small-2507Mistral-Small-3.1-24B-Instruct-2503 - 141,9 tok/s Generation, 1.385 tok/s Prefill, TTFT 19.489 ms (1 Lauf)Mistral-Small-3.1-24B...Devstral-Small-2-24B-Instruct-2512 - 138,4 tok/s Generation, 1.562 tok/s Prefill, TTFT 19.650 ms (1 Lauf)Devstral-Small-2-24B-...Codestral-22B-v0.1 - 127,7 tok/s Generation, 1.233 tok/s Prefill, TTFT 25.201 ms (2 Laufe)Codestral-22B-v0.1Qwen3.6-27B - 106,8 tok/s Generation, 645 tok/s Prefill, TTFT 30.333 ms (1 Lauf)Qwen3.6-27B
gemma-4-E2B-it 702,9 tok/sMeta-Llama-3.1-8B-Instruct 323,1 tok/sOrnith-1.0-9B 294,0 tok/sQwen3-Coder-30B-A3B-Instruct 289,5 tok/sgpt-oss-20b 280,0 tok/sNorth-Mini-Code-1.0 276,9 tok/sMinistral-3-14B-Reasoning-2512 272,8 tok/sQwen3-30B-A3B-Instruct-2507 267,7 tok/sQwen3-30B-A3B-Thinking-2507 258,3 tok/sGemma-4-26B-A4B-it 247,3 tok/sQwen3.6-35B-A3B 235,5 tok/sQwen3-VL-30B-A3B-Instruct 233,0 tok/sQwen3-Omni-30B-A3B-Thinking 205,1 tok/sQwen3.5-35B-A3B 204,6 tok/sgemma-4-12B-it 202,0 tok/sMagistral-Small-2509 153,0 tok/sDevstral-Small-2507 143,3 tok/sMistral-Small-3.1-24B-Instruct-2503 141,9 tok/sDevstral-Small-2-24B-Instruct-2512 138,4 tok/sCodestral-22B-v0.1 127,7 tok/sQwen3.6-27B 106,8 tok/s

ENGnach Engine

8566764963161371.4984.6567.81310.971Prefill (tok/s)Generation (tok/s)llama.cpp - 702,9 tok/s Generation, 3.162 tok/s Prefill, TTFT 7.870 ms (70 Laufe)llama.cppvLLM - 289,5 tok/s Generation, 9.307 tok/s Prefill, TTFT 3.012 ms (10 Laufe)vLLM
llama.cpp 702,9 tok/svLLM 289,5 tok/s

CPUnach Prozessor

7737387036686333.6943.8524.0094.166Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 5975WX 32-Cores - 702,9 tok/s Generation, 3.930 tok/s Prefill, TTFT 7.263 ms (80 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 5975WX 32-Cores 702,9 tok/s
Throughput & latency

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Radeon PRO W7800 48GB.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
702,86 tok/s TG
Prefill 5.157 · TTFT 6.385 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
2gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
505,77 tok/s TG
Prefill 5.745 · TTFT 7.265 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
3Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
323,12 tok/s TG
Prefill 5.337 · TTFT 5.911 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
4Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
322,77 tok/s TG
Prefill 5.717 · TTFT 5.160 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
5Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
293,98 tok/s TG
Prefill 2.069 · TTFT 9.136 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
6Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
289,48 tok/s TG
Prefill 11.717 · TTFT 3.710 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
7gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,96 tok/s TG
Prefill 4.128 · TTFT 2.405 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
8Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,88 tok/s TG
Prefill 6.465 · TTFT 4.568 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
9North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,90 tok/s TG
Prefill 3.500 · TTFT 5.729 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
10Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
272,78 tok/s TG
Prefill 1.270 · TTFT 14.950 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
11Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,15 tok/s TG
Prefill 1.523 · TTFT 12.453 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
12Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
267,70 tok/s TG
Prefill 6.847 · TTFT 4.383 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
13gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
263,50 tok/s TG
Prefill 3.150 · TTFT 4.792 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
14Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,93 tok/s TG
Prefill 8.472 · TTFT 4.535 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
15Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
258,25 tok/s TG
Prefill 6.921 · TTFT 4.438 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
16gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,35 tok/s TG
Prefill 5.135 · TTFT 1.933 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
17Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,30 tok/s TG
Prefill 3.039 · TTFT 6.513 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
18Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
244,12 tok/s TG
Prefill 2.809 · TTFT 7.040 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
19Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
239,26 tok/s TG
Prefill 2.309 · TTFT 8.469 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
20gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
238,53 tok/s TG
Prefill 6.897 · TTFT 1.885 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
21Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
235,51 tok/s TG
Prefill 2.971 · TTFT 16.110 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
22Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,01 tok/s TG
Prefill 6.125 · TTFT 5.956 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
23gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
226,27 tok/s TG
Prefill 3.118 · TTFT 3.181 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
24Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
223,59 tok/s TG
Prefill 2.319 · TTFT 10.040 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
25Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,82 tok/s TG
Prefill 3.287 · TTFT 5.954 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
26Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
218,77 tok/s TG
Prefill 1.680 · TTFT 11.308 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
27gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
209,69 tok/s TG
Prefill 4.186 · TTFT 4.508 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
28North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,68 tok/s TG
Prefill 3.174 · TTFT 3.129 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
29Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
205,12 tok/s TG
Prefill 5.797 · TTFT 5.426 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
30Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,64 tok/s TG
Prefill 13.127 · TTFT 2.817 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
31Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,18 tok/s TG
Prefill 5.112 · TTFT 2.507 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
32gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,99 tok/s TG
Prefill 1.186 · TTFT 16.972 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
33Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,02 tok/s TG
Prefill 13.392 · TTFT 2.808 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
34Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,63 tok/s TG
Prefill 5.420 · TTFT 2.546 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
35Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,82 tok/s TG
Prefill 3.730 · TTFT 3.658 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
36gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,85 tok/s TG
Prefill 1.344 · TTFT 15.099 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
37Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
191,84 tok/s TG
Prefill 5.308 · TTFT 2.484 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
38Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,33 tok/s TG
Prefill 1.184 · TTFT 17.577 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
39Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
178,74 tok/s TG
Prefill 9.274 · TTFT 1.816 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
40Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
175,20 tok/s TG
Prefill 3.098 · TTFT 3.204 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
41Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
172,91 tok/s TG
Prefill 2.730 · TTFT 3.618 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
42Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
172,69 tok/s TG
Prefill 2.964 · TTFT 3.184 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
43Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,96 tok/s TG
Prefill 2.383 · TTFT 4.068 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
44gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,69 tok/s TG
Prefill 2.902 · TTFT 11.434 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
45Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
168,28 tok/s TG
Prefill 3.412 · TTFT 2.850 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
46North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
162,37 tok/s TG
Prefill 2.995 · TTFT 7.467 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
47Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
159,48 tok/s TG
Prefill 4.475 · TTFT 2.882 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
48Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,61 tok/s TG
Prefill 3.757 · TTFT 4.751 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
49Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,19 tok/s TG
Prefill 2.436 · TTFT 3.874 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
50Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
154,77 tok/s TG
Prefill 4.675 · TTFT 3.232 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
51Magistral-Small-250924BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
152,96 tok/s TG
Prefill 891 · TTFT 26.016 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
52Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
152,42 tok/s TG
Prefill 5.042 · TTFT 3.214 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
53Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
146,19 tok/s TG
Prefill 6.653 · TTFT 2.534 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
54Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
143,29 tok/s TG
Prefill 1.967 · TTFT 20.264 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
55Mistral-Small-3.1-24B-Instruct-250324BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
141,93 tok/s TG
Prefill 1.385 · TTFT 19.489 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
56Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,90 tok/s TG
Prefill 3.102 · TTFT 4.748 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
57Devstral-Small-2-24B-Instruct-251224BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,44 tok/s TG
Prefill 1.562 · TTFT 19.650 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
58gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
137,99 tok/s TG
Prefill 2.682 · TTFT 738 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
59Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
134,78 tok/s TG
Prefill 2.304 · TTFT 4.417 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
60gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
131,94 tok/s TG
Prefill 3.904 · TTFT 521 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
61gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
128,86 tok/s TG
Prefill 2.698 · TTFT 734 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
62Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,71 tok/s TG
Prefill 1.369 · TTFT 22.194 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
63Codestral-22B-v0.122BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
127,28 tok/s TG
Prefill 1.097 · TTFT 28.208 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
64Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
126,92 tok/s TG
Prefill 1.616 · TTFT 7.001 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
65North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,80 tok/s TG
Prefill 2.638 · TTFT 3.921 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
66Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,10 tok/s TG
Prefill 10.048 · TTFT 1.358 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
67Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,07 tok/s TG
Prefill 3.576 · TTFT 3.191 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
68Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
121,19 tok/s TG
Prefill 9.219 · TTFT 1.374 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMvLLMgodclawAWQDetails →
69gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
120,20 tok/s TG
Prefill 1.360 · TTFT 7.318 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
70Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
117,14 tok/s TG
Prefill 2.985 · TTFT 3.411 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
71gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
114,56 tok/s TG
Prefill 4.326 · TTFT 459 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
72Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
109,93 tok/s TG
Prefill 1.922 · TTFT 5.295 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
73Qwen3.6-27B27BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,84 tok/s TG
Prefill 645 · TTFT 30.333 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
74gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,23 tok/s TG
Prefill 5.351 · TTFT 3.702 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
75Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,43 tok/s TG
Prefill 2.076 · TTFT 5.460 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
76Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,68 tok/s TG
Prefill 1.242 · TTFT 8.170 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
77Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
98,39 tok/s TG
Prefill 2.648 · TTFT 923 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
78gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,86 tok/s TG
Prefill 1.586 · TTFT 6.256 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_MDetails →
79gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
92,04 tok/s TG
Prefill 1.121 · TTFT 21.054 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
80Devstral-Small-250724BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
91,82 tok/s TG
Prefill 1.642 · TTFT 12.961 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0Details →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Radeon PRO W7800 48GB.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – AMD Radeon PRO W7800 48GB

HerstellerAMD
ArchitekturRDNA 3
VRAM48 GB
Tensor-Recheneinheiten140
Speicherbandbreite576 GB/s
TDP260 W
PCIe4.0
Release04/2024
Best generation702,9 tok/s
Best prefill13.392 tok/s
Models24
Messläufe (Performance)149