Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🎮
Grafikkarte

NVIDIA GeForce RTX 5070 Ti

NVIDIA16 GB VRAM
48Benchmarks
8Modelle
48Performance
0Harness
Beste Generation
1.608,5 tok/s
gemma-4-E2B-it
∅ Generation
275,2 tok/s
Schnitt aus 48 Läufen
Bester Prefill
31.452 tok/s
Prompt-Verarbeitung
Bester TTFT
179 ms
Time to First Token
Beste Harness-Quote
–%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser GPU · 1.608,5 tok/s
Bester Prefill: 31.452 tok/s · 8 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf NVIDIA GeForce RTX 5070 Ti – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it
1.608,5 tok/s
gemma-4-E4B-it
1.022,8 tok/s
Ministral-3-14B-Reasoning-2512
497,6 tok/s
gemma-4-12B-it
486,2 tok/s
Qwen3.6-35B-A3B
31,7 tok/s
Qwen3.5-35B-A3B
30,6 tok/s
Qwen3-VL-30B-A3B-Instruct
29,4 tok/s
gpt-oss-20b
24,7 tok/s
Performanceprofil

Durchsatz auf NVIDIA GeForce RTX 5070 Ti

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

2.0861.5651.0435220,009.07918.15727.236Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.608,5 tok/s Generation, 22.042 tok/s Prefill, TTFT 757 ms (6 Laufe)gemma-4-E2B-itgemma-4-E4B-it - 1.022,8 tok/s Generation, 13.200 tok/s Prefill, TTFT 1.096 ms (6 Laufe)gemma-4-E4B-itMinistral-3-14B-Reasoning-2512 - 497,6 tok/s Generation, 5.767 tok/s Prefill, TTFT 2.716 ms (6 Laufe)Ministral-3-14B-Reaso...gemma-4-12B-it - 486,2 tok/s Generation, 3.698 tok/s Prefill, TTFT 3.081 ms (6 Laufe)gemma-4-12B-itQwen3.6-35B-A3B - 31,7 tok/s Generation, 558 tok/s Prefill, TTFT 20.550 ms (6 Laufe)Qwen3.6-35B-A3BQwen3.5-35B-A3B - 30,6 tok/s Generation, 560 tok/s Prefill, TTFT 20.464 ms (6 Laufe)Qwen3.5-35B-A3BQwen3-VL-30B-A3B-Instruct - 29,4 tok/s Generation, 1.167 tok/s Prefill, TTFT 11.279 ms (6 Laufe)Qwen3-VL-30B-A3B-Inst...gpt-oss-20b - 24,7 tok/s Generation, 531 tok/s Prefill, TTFT 19.738 ms (6 Laufe)gpt-oss-20b
gemma-4-E2B-it 1.608,5 tok/sgemma-4-E4B-it 1.022,8 tok/sMinistral-3-14B-Reasoning-2512 497,6 tok/sgemma-4-12B-it 486,2 tok/sQwen3.6-35B-A3B 31,7 tok/sQwen3.5-35B-A3B 30,6 tok/sQwen3-VL-30B-A3B-Instruct 29,4 tok/sgpt-oss-20b 24,7 tok/s

ENGnach Engine

1.7691.6891.6081.5281.4485.5845.8216.0596.297Prefill (tok/s)Generation (tok/s)vLLM - 1.608,5 tok/s Generation, 5.940 tok/s Prefill, TTFT 9.960 ms (48 Laufe)vLLM
vLLM 1.608,5 tok/s

CPUnach Prozessor

1.7691.6891.6081.5281.4485.5845.8216.0596.297Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 5975WX 32-Cores - 1.608,5 tok/s Generation, 5.940 tok/s Prefill, TTFT 9.960 ms (48 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 5975WX 32-Cores 1.608,5 tok/s
Durchsatz & Latenz

Performancebenchmark

48 veroeffentlichte Performance-Läufe auf NVIDIA GeForce RTX 5070 Ti.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,46 tok/s TG
Prefill 31.452 · TTFT 1.633 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
2gemma-4-E2B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,46 tok/s TG
Prefill 31.452 · TTFT 1.633 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
3gemma-4-E4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.022,79 tok/s TG
Prefill 18.744 · TTFT 2.204 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
4gemma-4-E4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.022,79 tok/s TG
Prefill 18.744 · TTFT 2.204 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
5gemma-4-E2B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
973,54 tok/s TG
Prefill 23.599 · TTFT 460 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
6gemma-4-E2B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
973,54 tok/s TG
Prefill 23.599 · TTFT 460 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
7gemma-4-E4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
616,01 tok/s TG
Prefill 13.778 · TTFT 803 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
8gemma-4-E4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
616,01 tok/s TG
Prefill 13.778 · TTFT 803 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
9Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
497,64 tok/s TG
Prefill 8.340 · TTFT 5.360 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
10Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
497,64 tok/s TG
Prefill 8.340 · TTFT 5.360 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
11gemma-4-12B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
486,20 tok/s TG
Prefill 4.345 · TTFT 5.863 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
12gemma-4-12B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
486,20 tok/s TG
Prefill 4.345 · TTFT 5.863 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
13Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,66 tok/s TG
Prefill 5.742 · TTFT 2.122 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
14Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,66 tok/s TG
Prefill 5.742 · TTFT 2.122 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
15gemma-4-12B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
315,66 tok/s TG
Prefill 3.728 · TTFT 2.722 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
16gemma-4-12B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
315,66 tok/s TG
Prefill 3.728 · TTFT 2.722 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
17gemma-4-E2B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,18 tok/s TG
Prefill 11.075 · TTFT 179 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
18gemma-4-E2B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,18 tok/s TG
Prefill 11.075 · TTFT 179 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
19gemma-4-E4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
144,58 tok/s TG
Prefill 7.078 · TTFT 281 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
20gemma-4-E4B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
144,58 tok/s TG
Prefill 7.078 · TTFT 281 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
21Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
85,15 tok/s TG
Prefill 3.218 · TTFT 666 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
22Ministral-3-14B-Reasoning-2512Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
85,15 tok/s TG
Prefill 3.218 · TTFT 666 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
23gemma-4-12B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
75,04 tok/s TG
Prefill 3.021 · TTFT 659 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
24gemma-4-12B-itGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
75,04 tok/s TG
Prefill 3.021 · TTFT 659 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
25Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
31,73 tok/s TG
Prefill 816 · TTFT 35.129 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
26Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
31,73 tok/s TG
Prefill 816 · TTFT 35.129 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
27Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,59 tok/s TG
Prefill 819 · TTFT 35.012 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
28Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,59 tok/s TG
Prefill 819 · TTFT 35.012 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
29Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,41 tok/s TG
Prefill 1.525 · TTFT 19.257 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
30Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,41 tok/s TG
Prefill 1.525 · TTFT 19.257 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
31gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,73 tok/s TG
Prefill 660 · TTFT 34.336 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
32gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,73 tok/s TG
Prefill 660 · TTFT 34.336 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
33Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,64 tok/s TG
Prefill 1.305 · TTFT 10.957 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
34Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
22,64 tok/s TG
Prefill 1.305 · TTFT 10.957 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
35gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,13 tok/s TG
Prefill 488 · TTFT 20.357 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
36gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,13 tok/s TG
Prefill 488 · TTFT 20.357 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
37Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,05 tok/s TG
Prefill 517 · TTFT 20.708 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
38Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,05 tok/s TG
Prefill 517 · TTFT 20.708 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
39Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,94 tok/s TG
Prefill 516 · TTFT 20.783 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
40Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,94 tok/s TG
Prefill 516 · TTFT 20.783 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
41Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,34 tok/s TG
Prefill 672 · TTFT 3.622 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
42Qwen3-VL-30B-A3B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,34 tok/s TG
Prefill 672 · TTFT 3.622 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
43gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,29 tok/s TG
Prefill 446 · TTFT 4.523 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
44gpt-oss-20bOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,29 tok/s TG
Prefill 446 · TTFT 4.523 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
45Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,63 tok/s TG
Prefill 345 · TTFT 5.672 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
46Qwen3.5-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,63 tok/s TG
Prefill 345 · TTFT 5.672 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
47Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,61 tok/s TG
Prefill 342 · TTFT 5.738 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
48Qwen3.6-35B-A3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,61 tok/s TG
Prefill 342 · TTFT 5.738 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA GeForce RTX 5070 Ti.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware