Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🎮
Graphics card

AMD Radeon RX 7900 XTX

AMD24 GB VRAM
361Benchmarks
67Models
361Performance
0Harness
355 WMax power
Best generation
717,6 tok/s
Llama-3.2-1B-Instruct
∅ Generation
159,1 tok/s
Schnitt aus 361 Läufen
Best prefill
52.503 tok/s
Prompt processing
Best TTFT
156 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
Llama-3.2-1B-Instruct läuft am schnellsten auf dieser GPU · 717,6 tok/s
Bester Prefill: 52.503 tok/s · 67 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf AMD Radeon RX 7900 XTX – umschaltbar nach Generation, Prefill oder Kombiwert.

Llama-3.2-1B-Instruct1B
717,6 tok/s
SmolLM2-1.7B-Instruct1.7B
531,7 tok/s
Qwen3-0.6B0.6B
495,5 tok/s
Laguna-XS-2.133.4B
468,6 tok/s
Llama-3.2-3B-Instruct3B
465,7 tok/s
gemma-4-E2B-it5B
465,5 tok/s
Qwen-AgentWorld-35B-A3B35B
451,0 tok/s
Qwen3.6-35B-A3B35B
450,5 tok/s
Qwen3.5-35B-A3B35B
447,0 tok/s
Qwen3-1.7B1.7B
445,2 tok/s
Anzeige
Performance profile

Durchsatz auf AMD Radeon RX 7900 XTX

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

88468248027875,6015.80831.61747.425Prefill (tok/s)Generation (tok/s)Llama-3.2-1B-Instruct - 717,6 tok/s Generation, 36.601 tok/s Prefill, TTFT 687 ms (6 Laufe)Llama-3.2-1B-InstructSmolLM2-1.7B-Instruct - 531,7 tok/s Generation, 38.638 tok/s Prefill, TTFT 788 ms (2 Laufe)SmolLM2-1.7B-InstructQwen3-0.6B - 495,5 tok/s Generation, 26.530 tok/s Prefill, TTFT 861 ms (6 Laufe)Qwen3-0.6BLaguna-XS-2.1 - 468,6 tok/s Generation, 4.836 tok/s Prefill, TTFT 11.175 ms (1 Lauf)Laguna-XS-2.1Llama-3.2-3B-Instruct - 465,7 tok/s Generation, 19.013 tok/s Prefill, TTFT 1.416 ms (5 Laufe)Llama-3.2-3B-Instructgemma-4-E2B-it - 465,5 tok/s Generation, 7.677 tok/s Prefill, TTFT 1.923 ms (4 Laufe)gemma-4-E2B-itQwen-AgentWorld-35B-A3B - 451,0 tok/s Generation, 3.878 tok/s Prefill, TTFT 14.664 ms (1 Lauf)Qwen-AgentWorld-35B-A...Qwen3.6-35B-A3B - 450,5 tok/s Generation, 3.632 tok/s Prefill, TTFT 14.999 ms (1 Lauf)Qwen3.6-35B-A3BQwen3.5-35B-A3B - 447,0 tok/s Generation, 3.645 tok/s Prefill, TTFT 15.139 ms (1 Lauf)Qwen3.5-35B-A3BQwen3-1.7B - 445,2 tok/s Generation, 20.524 tok/s Prefill, TTFT 1.278 ms (6 Laufe)Qwen3-1.7BQwen2.5-7B-Instruct - 442,0 tok/s Generation, 13.287 tok/s Prefill, TTFT 2.491 ms (3 Laufe)Qwen2.5-7B-InstructLlama-3.1-Nemotron-Nano-4B-v1.1 - 419,4 tok/s Generation, 10.593 tok/s Prefill, TTFT 2.091 ms (4 Laufe)Llama-3.1-Nemotron-Na...Meta-Llama-3.1-8B-Instruct - 405,0 tok/s Generation, 9.290 tok/s Prefill, TTFT 3.189 ms (6 Laufe)Meta-Llama-3.1-8B-Ins...Qwen2.5-3B-Instruct - 358,2 tok/s Generation, 20.309 tok/s Prefill, TTFT 1.714 ms (4 Laufe)Qwen2.5-3B-Instructgpt-oss-20b - 357,7 tok/s Generation, 4.658 tok/s Prefill, TTFT 3.407 ms (5 Laufe)gpt-oss-20bQwen3-Coder-30B-A3B-Instruct - 324,9 tok/s Generation, 7.283 tok/s Prefill, TTFT 4.335 ms (2 Laufe)Qwen3-Coder-30B-A3B-I...gemma-2-2b-it - 323,8 tok/s Generation, 16.639 tok/s Prefill, TTFT 2.239 ms (2 Laufe)gemma-2-2b-itQwen3-4B - 320,4 tok/s Generation, 13.241 tok/s Prefill, TTFT 2.798 ms (3 Laufe)Qwen3-4BGemma-4-26B-A4B-it - 315,5 tok/s Generation, 2.703 tok/s Prefill, TTFT 7.505 ms (1 Lauf)Gemma-4-26B-A4B-itQwen3-8B - 315,2 tok/s Generation, 8.802 tok/s Prefill, TTFT 4.049 ms (3 Laufe)Qwen3-8BQwen3-30B-A3B-Instruct-2507 - 314,0 tok/s Generation, 7.502 tok/s Prefill, TTFT 4.050 ms (1 Lauf)Qwen3-30B-A3B-Instruc...North-Mini-Code-1.0 - 312,7 tok/s Generation, 4.146 tok/s Prefill, TTFT 5.378 ms (1 Lauf)North-Mini-Code-1.0Qwen3-Omni-30B-A3B-Thinking - 305,4 tok/s Generation, 5.073 tok/s Prefill, TTFT 5.334 ms (1 Lauf)Qwen3-Omni-30B-A3B-Th...Qwen3-30B-A3B-Thinking-2507 - 303,1 tok/s Generation, 7.263 tok/s Prefill, TTFT 4.140 ms (1 Lauf)Qwen3-30B-A3B-Thinkin...Phi-3.5-mini-instruct - 302,0 tok/s Generation, 10.048 tok/s Prefill, TTFT 20.162 ms (2 Laufe)Phi-3.5-mini-instructQwen3-VL-30B-A3B-Instruct - 301,6 tok/s Generation, 7.030 tok/s Prefill, TTFT 4.327 ms (1 Lauf)Qwen3-VL-30B-A3B-Inst...Qwen3-14B - 280,8 tok/s Generation, 8.760 tok/s Prefill, TTFT 5.247 ms (1 Lauf)Qwen3-14Bgemma-3n-E4B-it - 273,1 tok/s Generation, 4.845 tok/s Prefill, TTFT 4.550 ms (2 Laufe)gemma-3n-E4B-itQwen2.5-Coder-7B-Instruct - 256,7 tok/s Generation, 10.123 tok/s Prefill, TTFT 3.280 ms (1 Lauf)Qwen2.5-Coder-7B-Inst...NVIDIA-Nemotron-3-Nano-30B-A3B - 244,9 tok/s Generation, 3.719 tok/s Prefill, TTFT 6.905 ms (1 Lauf)NVIDIA-Nemotron-3-Nan...Ornith-1.0-9B - 242,4 tok/s Generation, 4.069 tok/s Prefill, TTFT 5.516 ms (2 Laufe)Ornith-1.0-9B
Llama-3.2-1B-Instruct 717,6 tok/sSmolLM2-1.7B-Instruct 531,7 tok/sQwen3-0.6B 495,5 tok/sLaguna-XS-2.1 468,6 tok/sLlama-3.2-3B-Instruct 465,7 tok/sgemma-4-E2B-it 465,5 tok/sQwen-AgentWorld-35B-A3B 451,0 tok/sQwen3.6-35B-A3B 450,5 tok/sQwen3.5-35B-A3B 447,0 tok/sQwen3-1.7B 445,2 tok/sQwen2.5-7B-Instruct 442,0 tok/sLlama-3.1-Nemotron-Nano-4B-v1.1 419,4 tok/sMeta-Llama-3.1-8B-Instruct 405,0 tok/sQwen2.5-3B-Instruct 358,2 tok/sgpt-oss-20b 357,7 tok/sQwen3-Coder-30B-A3B-Instruct 324,9 tok/sgemma-2-2b-it 323,8 tok/sQwen3-4B 320,4 tok/sGemma-4-26B-A4B-it 315,5 tok/sQwen3-8B 315,2 tok/sQwen3-30B-A3B-Instruct-2507 314,0 tok/sNorth-Mini-Code-1.0 312,7 tok/sQwen3-Omni-30B-A3B-Thinking 305,4 tok/sQwen3-30B-A3B-Thinking-2507 303,1 tok/sPhi-3.5-mini-instruct 302,0 tok/sQwen3-VL-30B-A3B-Instruct 301,6 tok/sQwen3-14B 280,8 tok/sgemma-3n-E4B-it 273,1 tok/sQwen2.5-Coder-7B-Instruct 256,7 tok/sNVIDIA-Nemotron-3-Nano-30B-A3B 244,9 tok/sOrnith-1.0-9B 242,4 tok/s

ENGnach Engine

7947507076646216.19914.29222.38630.479Prefill (tok/s)Generation (tok/s)vLLM - 717,6 tok/s Generation, 26.114 tok/s Prefill, TTFT 1.816 ms (21 Laufe)vLLMllama.cpp - 696,8 tok/s Generation, 10.564 tok/s Prefill, TTFT 4.242 ms (59 Laufe)llama.cpp
vLLM 717,6 tok/sllama.cpp 696,8 tok/s

CPUnach Prozessor

81173766459051611.27013.03314.79516.557Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 3955WX 16-Cores - 717,6 tok/s Generation, 15.187 tok/s Prefill, TTFT 3.295 ms (63 Laufe)AMD Ryzen Threadrippe...Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 609,5 tok/s Generation, 12.640 tok/s Prefill, TTFT 4.757 ms (17 Laufe)Intel(R) Xeon(R) CPU ...
AMD Ryzen Threadripper PRO 3955WX 16-Cores 717,6 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 609,5 tok/s
Throughput & latency

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Radeon RX 7900 XTX.

In the leaderboard →
Metric:
Size
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
717,61 tok/s TG
Prefill 52.503 · TTFT 1.022 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
2Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
696,81 tok/s TG
Prefill 41.362 · TTFT 722 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
3Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
609,48 tok/s TG
Prefill 31.648 · TTFT 962 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
4SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
531,74 tok/s TG
Prefill 44.141 · TTFT 1.002 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
5Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
495,51 tok/s TG
Prefill 19.609 · TTFT 628 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
6Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
480,52 tok/s TG
Prefill 22.887 · TTFT 1.208 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
7Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
479,20 tok/s TG
Prefill 40.760 · TTFT 356 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
8Laguna-XS-2.133.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
468,61 tok/s TG
Prefill 4.836 · TTFT 11.175 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
9Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
465,73 tok/s TG
Prefill 23.398 · TTFT 1.915 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
10gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
465,47 tok/s TG
Prefill 8.435 · TTFT 2.408 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
11gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
455,35 tok/s TG
Prefill 8.245 · TTFT 2.462 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
12Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
451,00 tok/s TG
Prefill 3.878 · TTFT 14.664 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
13Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
450,54 tok/s TG
Prefill 3.632 · TTFT 14.999 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
14Qwen3.5-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
447,00 tok/s TG
Prefill 3.645 · TTFT 15.139 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
15Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
445,18 tok/s TG
Prefill 19.926 · TTFT 1.357 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
16Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
443,74 tok/s TG
Prefill 31.085 · TTFT 445 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
17Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
442,02 tok/s TG
Prefill 16.333 · TTFT 3.286 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
18Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
437,40 tok/s TG
Prefill 16.731 · TTFT 1.636 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
19Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
419,38 tok/s TG
Prefill 11.768 · TTFT 2.673 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
20Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
418,31 tok/s TG
Prefill 11.855 · TTFT 2.651 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
21Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
404,99 tok/s TG
Prefill 14.538 · TTFT 2.823 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
22Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
387,65 tok/s TG
Prefill 32.764 · TTFT 2.280 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
23Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
384,19 tok/s TG
Prefill 49.306 · TTFT 1.939 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
24Llama-3.2-1B-Instruct1BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
376,49 tok/s TG
Prefill 22.247 · TTFT 615 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
25Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
360,12 tok/s TG
Prefill 19.755 · TTFT 1.579 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
26Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
358,15 tok/s TG
Prefill 19.410 · TTFT 1.565 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
27gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
357,72 tok/s TG
Prefill 4.799 · TTFT 4.228 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
28Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
355,86 tok/s TG
Prefill 24.866 · TTFT 2.634 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
29Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
354,21 tok/s TG
Prefill 17.373 · TTFT 1.825 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
30gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
347,49 tok/s TG
Prefill 4.656 · TTFT 4.348 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
31SmolLM2-1.7B-Instruct1.7BHuggingFaceTB Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
338,72 tok/s TG
Prefill 33.135 · TTFT 574 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
32Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
333,18 tok/s TG
Prefill 17.060 · TTFT 1.879 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
33gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
331,51 tok/s TG
Prefill 6.908 · TTFT 1.433 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
34Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
326,73 tok/s TG
Prefill 13.426 · TTFT 1.202 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
35Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
324,87 tok/s TG
Prefill 7.451 · TTFT 4.042 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
36gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
323,81 tok/s TG
Prefill 6.071 · TTFT 3.506 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
37gemma-2-2b-it2BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
322,89 tok/s TG
Prefill 27.208 · TTFT 972 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
38Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
321,67 tok/s TG
Prefill 7.148 · TTFT 4.460 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
39Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
320,40 tok/s TG
Prefill 19.188 · TTFT 3.026 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
40Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,54 tok/s TG
Prefill 19.091 · TTFT 830 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
41Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
318,18 tok/s TG
Prefill 9.348 · TTFT 1.524 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
42gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
316,40 tok/s TG
Prefill 7.121 · TTFT 1.391 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
43Gemma-4-26B-A4B-it26BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
315,53 tok/s TG
Prefill 2.703 · TTFT 7.505 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
44Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
315,16 tok/s TG
Prefill 13.007 · TTFT 3.960 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
45gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
314,82 tok/s TG
Prefill 4.224 · TTFT 2.350 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
46Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
314,14 tok/s TG
Prefill 15.050 · TTFT 825 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
47Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
314,04 tok/s TG
Prefill 7.502 · TTFT 4.050 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
48North-Mini-Code-1.030.5BCohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
312,72 tok/s TG
Prefill 4.146 · TTFT 5.378 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
49gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
310,59 tok/s TG
Prefill 4.175 · TTFT 2.376 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
50Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
305,48 tok/s TG
Prefill 10.848 · TTFT 2.513 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
51Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
305,38 tok/s TG
Prefill 5.073 · TTFT 5.334 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
52Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
303,14 tok/s TG
Prefill 7.263 · TTFT 4.140 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
53Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
301,98 tok/s TG
Prefill 19.406 · TTFT 1.945 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
54Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
301,64 tok/s TG
Prefill 7.030 · TTFT 4.327 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
55Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
300,93 tok/s TG
Prefill 6.663 · TTFT 4.522 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
56Llama-3.1-Nemotron-Nano-4B-v1.14.5BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
294,88 tok/s TG
Prefill 9.401 · TTFT 1.516 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
57Qwen3-4B4BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
294,28 tok/s TG
Prefill 9.688 · TTFT 2.856 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
58Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
281,62 tok/s TG
Prefill 14.942 · TTFT 839 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
59Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
280,80 tok/s TG
Prefill 8.760 · TTFT 5.247 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
60Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
279,01 tok/s TG
Prefill 11.575 · TTFT 1.408 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
61gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
273,10 tok/s TG
Prefill 4.691 · TTFT 4.615 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
62Phi-3.5-mini-instruct3.8Bmicrosoft Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
272,93 tok/s TG
Prefill 691 · TTFT 38.379 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
63gemma-3n-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
271,11 tok/s TG
Prefill 4.998 · TTFT 4.486 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
64Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
268,79 tok/s TG
Prefill 12.537 · TTFT 993 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
65Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
266,70 tok/s TG
Prefill 10.161 · TTFT 3.360 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
66Qwen2.5-7B-Instruct7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
261,39 tok/s TG
Prefill 10.101 · TTFT 2.985 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
67Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
260,24 tok/s TG
Prefill 38.946 · TTFT 372 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
68Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
260,23 tok/s TG
Prefill 6.946 · TTFT 3.919 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
69Qwen2.5-Coder-7B-Instruct7.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
256,72 tok/s TG
Prefill 10.123 · TTFT 3.280 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
70Qwen2.5-3B-Instruct3BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
253,98 tok/s TG
Prefill 19.902 · TTFT 780 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
71Qwen3-8B8.2BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
252,78 tok/s TG
Prefill 6.452 · TTFT 4.269 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
72Qwen3-1.7B1.7BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
252,00 tok/s TG
Prefill 26.134 · TTFT 576 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclawDetails →
73gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
247,27 tok/s TG
Prefill 5.437 · TTFT 3.732 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
74NVIDIA-Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
244,91 tok/s TG
Prefill 3.719 · TTFT 6.905 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
75Qwen3-0.6B0.6BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
243,73 tok/s TG
Prefill 13.492 · TTFT 181 ms
1×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
76Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
242,44 tok/s TG
Prefill 3.921 · TTFT 5.712 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
77Llama-3.2-3B-Instruct3BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
241,23 tok/s TG
Prefill 15.447 · TTFT 931 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
78Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
237,33 tok/s TG
Prefill 4.217 · TTFT 5.319 ms
10×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ8_0Details →
79Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
234,08 tok/s TG
Prefill 7.116 · TTFT 4.629 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
80Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
230,12 tok/s TG
Prefill 5.654 · TTFT 2.560 ms
5×AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Radeon RX 7900 XTX.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – AMD Radeon RX 7900 XTX

HerstellerAMD
ArchitekturRDNA 3
VRAM24 GB
Tensor-Recheneinheiten192
Speicherbandbreite960 GB/s
TDP355 W
PCIe4.0
Release12/2022
Best generation717,6 tok/s
Best prefill52.503 tok/s
Models67
Messläufe (Performance)361