Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🧠
Processor

AMD EPYC 7203P 8-Core Processor

AMD
27Benchmarks
2Models
27Performance
0Harness
Best generation
388,1 tok/s
Ling-3.0-flash
∅ Generation
108,5 tok/s
Schnitt aus 27 Läufen
Best prefill
16.198 tok/s
Prompt processing
Best TTFT
606 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
Ling-3.0-flash läuft am schnellsten auf dieser CPU · 388,1 tok/s
Bester Prefill: 16.198 tok/s · 2 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf AMD EPYC 7203P 8-Core Processor – umschaltbar nach Generation, Prefill oder Kombiwert.

Ling-3.0-flash127.5B
388,1 tok/s
Qwen3.8-Flash-Next180B
71,7 tok/s
Performance profile

Durchsatz auf AMD EPYC 7203P 8-Core Processor

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

4903682451230,001.3202.6403.960Prefill (tok/s)Generation (tok/s)Ling-3.0-flash - 388,1 tok/s Generation, 3.235 tok/s Prefill, TTFT 7.234 ms (15 Laufe)Ling-3.0-flashQwen3.8-Flash-Next - 71,7 tok/s Generation, 282 tok/s Prefill, TTFT 43.934 ms (12 Laufe)Qwen3.8-Flash-Next
Ling-3.0-flash 388,1 tok/sQwen3.8-Flash-Next 71,7 tok/s

ENGnach Engine

46437929521012504.1168.23212.347Prefill (tok/s)Generation (tok/s)vLLM - 388,1 tok/s Generation, 10.088 tok/s Prefill, TTFT 1.544 ms (3 Laufe)vLLMllama.cpp - 201,3 tok/s Generation, 902 tok/s Prefill, TTFT 26.295 ms (24 Laufe)llama.cpp
vLLM 388,1 tok/sllama.cpp 201,3 tok/s

GPUnach Grafikkarte

4274073883693491.8071.8841.9612.038Prefill (tok/s)Generation (tok/s)NVIDIA RTX A6000 - 388,1 tok/s Generation, 1.922 tok/s Prefill, TTFT 23.545 ms (27 Laufe)NVIDIA RTX A6000
NVIDIA RTX A6000 388,1 tok/s
Platform

Mainboards with this CPU

Auf diesen Boards wurde AMD EPYC 7203P 8-Core Processor gemessen – anklicken für Board-Details mit CPUs und Modellen.

🧮ASRockRack ROMED8-2T/BCMASRock · 2 Modelle · 15 Läufe · bis 388,1 tok/s→🧮ASUSTeK COMPUTER INC. Pro WS WRX80E-SAGE SE WIFIASUS · 2 Modelle · 12 Läufe · bis 194,7 tok/s→
Throughput & latency

Performancebenchmark

27 veroeffentlichte Performance-Läufe auf AMD EPYC 7203P 8-Core Processor.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
388,05 tok/s TG
Prefill 16.198 · TTFT 2.053 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4Details →
2Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
343,90 tok/s TG
Prefill 9.629 · TTFT 1.973 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4Details →
3Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
201,32 tok/s TG
Prefill 2.330 · TTFT 11.380 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclawDetails →
4Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,94 tok/s TG
Prefill 2.288 · TTFT 11.557 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawQ4_K_MDetails →
5Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
194,68 tok/s TG
Prefill 1.934 · TTFT 12.719 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
6Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
190,45 tok/s TG
Prefill 1.680 · TTFT 6.722 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclawDetails →
7Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
190,09 tok/s TG
Prefill 1.655 · TTFT 6.827 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawQ4_K_MDetails →
8Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,78 tok/s TG
Prefill 1.567 · TTFT 7.199 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
9Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
99,60 tok/s TG
Prefill 4.438 · TTFT 606 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMvLLMgodclawINT4Details →
10Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
92,62 tok/s TG
Prefill 1.185 · TTFT 24.873 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
11Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,29 tok/s TG
Prefill 1.380 · TTFT 1.577 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclawDetails →
12Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,66 tok/s TG
Prefill 1.349 · TTFT 1.612 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawQ4_K_MDetails →
13Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
87,74 tok/s TG
Prefill 1.275 · TTFT 1.916 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
14Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,50 tok/s TG
Prefill 900 · TTFT 14.075 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
15Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
71,73 tok/s TG
Prefill 560 · TTFT 40.628 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
16Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
67,46 tok/s TG
Prefill 568 · TTFT 39.939 ms
10×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclawDetails →
17Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,89 tok/s TG
Prefill 409 · TTFT 24.788 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
18Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
55,85 tok/s TG
Prefill 415 · TTFT 24.406 ms
5×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclawDetails →
19Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
36,99 tok/s TG
Prefill 221 · TTFT 12.961 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 252 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
20Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
35,58 tok/s TG
Prefill 220 · TTFT 12.963 ms
1×2x NVIDIA RTX A6000 iAMD EPYC 7203P 8-Core Processor · 110 GB RAMllama.cppgodclawDetails →
21Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
35,44 tok/s TG
Prefill 249 · TTFT 90.371 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
22Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,77 tok/s TG
Prefill 160 · TTFT 63.351 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
23Ling-3.0-flash127.5BinclusionAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,41 tok/s TG
Prefill 713 · TTFT 3.416 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
24Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,97 tok/s TG
Prefill 204 · TTFT 110.341 ms
10×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XLDetails →
25Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
22,67 tok/s TG
Prefill 124 · TTFT 18.211 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
26Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
19,36 tok/s TG
Prefill 158 · TTFT 64.302 ms
5×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XLDetails →
27Qwen3.8-Flash-Next180BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,95 tok/s TG
Prefill 94 · TTFT 24.951 ms
1×2x NVIDIA RTX A6000AMD EPYC 7203P 8-Core Processor · 31 GB RAMllama.cppgodclawQ4_K_XLDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD EPYC 7203P 8-Core Processor.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – AMD EPYC 7203P 8-Core Processor

HerstellerAMD
Best generation388,1 tok/s
Best prefill16.198 tok/s
Models2
Messläufe (Performance)27