Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DeepSeek

DeepSeek-V4-Flash-284B-A13B284B

Benchmark profile and published results.

MoE284B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation385,9 tok/s
Min 0,0Ø 248,3Max 2.491,2
Ueber dem Durchschnitt · 3969 Systeme im Feld
Prefill2.421 tok/s
Min 4Ø 4.741Max 55.260
Unter dem Durchschnitt · 3969 Systeme im Feld
Time to First Token1.320 ms
Min 20Ø 33.962Max 535.235
Ueber dem Durchschnitt · 3967 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

5013762511250,008471.6952.542Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 385,9 tok/s Generation, 2.052 tok/s Prefill, TTFT 13.971 ms (6 Laufe)NVIDIA RTX PRO 6000 B...AMD Radeon AI PRO R9700 - 18,8 tok/s Generation, 58 tok/s Prefill, TTFT 165.244 ms (10 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 5070 Ti - 10,0 tok/s Generation, 69 tok/s Prefill, TTFT 132.055 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 5090 - 3,2 tok/s Generation, 27 tok/s Prefill, TTFT 240.091 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 2060 - 1,2 tok/s Generation, 14 tok/s Prefill, TTFT 148.315 ms (1 Lauf)NVIDIA GeForce RTX 20...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 385,9 tok/sAMD Radeon AI PRO R9700 18,8 tok/sNVIDIA GeForce RTX 5070 Ti 10,0 tok/sNVIDIA GeForce RTX 5090 3,2 tok/sNVIDIA GeForce RTX 2060 1,2 tok/s

CPUby processor

5013762511250,008471.6952.542Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 9965WX 24-Cores - 385,9 tok/s Generation, 2.052 tok/s Prefill, TTFT 13.971 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 18,8 tok/s Generation, 58 tok/s Prefill, TTFT 165.244 ms (10 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 10,0 tok/s Generation, 69 tok/s Prefill, TTFT 132.055 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 7 5800X3D 8-Core Processor - 3,2 tok/s Generation, 27 tok/s Prefill, TTFT 240.091 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 1,2 tok/s Generation, 14 tok/s Prefill, TTFT 148.315 ms (1 Lauf)Intel(R) Xeon(R) CPU ...
AMD Ryzen Threadripper PRO 9965WX 24-Cores 385,9 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 18,8 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 10,0 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 3,2 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 1,2 tok/s

ENGby engine

425405386367347539562585608Prefill (tok/s)Generation (tok/s)llama.cpp - 385,9 tok/s Generation, 574 tok/s Prefill, TTFT 130.479 ms (23 Laufe)llama.cpp
llama.cpp 385,9 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
385,91 tok/s TG
Prefill 2.350 · TTFT 30.012 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
2DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
382,08 tok/s TG
Prefill 2.421 · TTFT 30.058 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
3DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
206,50 tok/s TG
Prefill 2.080 · TTFT 10.489 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
4DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
204,88 tok/s TG
Prefill 2.064 · TTFT 10.570 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
5DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,33 tok/s TG
Prefill 1.735 · TTFT 1.320 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
6DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,03 tok/s TG
Prefill 1.664 · TTFT 1.377 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawUD-Q4_K_XL
7DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
18,80 tok/s TG
Prefill 53 · TTFT 260.849 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
8DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
17,96 tok/s TG
Prefill 53 · TTFT 258.695 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
9DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
17,47 tok/s TG
Prefill 53 · TTFT 259.739 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
10DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
10,87 tok/s TG
Prefill 50 · TTFT 231.913 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
11DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
10,76 tok/s TG
Prefill 50 · TTFT 232.851 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
12DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
10,35 tok/s TG
Prefill 50 · TTFT 233.256 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
13DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,95 tok/s TG
Prefill 72 · TTFT 174.547 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
14DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,13 tok/s TG
Prefill 69 · TTFT 186.352 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
15DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,49 tok/s TG
Prefill 43 · TTFT 53.506 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
16DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,46 tok/s TG
Prefill 43 · TTFT 53.421 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
17DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,41 tok/s TG
Prefill 42 · TTFT 53.991 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
18DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,29 tok/s TG
Prefill 65 · TTFT 35.268 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XL
19DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,27 tok/s TG
Prefill 144 · TTFT 14.222 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawUD-Q4_K_XL
20DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,23 tok/s TG
Prefill 28 · TTFT 318.564 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_XL
21DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,82 tok/s TG
Prefill 27 · TTFT 322.266 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_XL
22DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,20 tok/s TG
Prefill 14 · TTFT 148.315 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawUD-Q4_K_XL
23DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,97 tok/s TG
Prefill 27 · TTFT 79.443 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliUD-Q4_K_XL
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.