Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🎮
Grafikkarte

NVIDIA GeForce RTX 5070 Ti

NVIDIA16 GB VRAM
★★★★★4,0/ 5 · Bewertung
222Benchmarks
50Modelle
222Performance
0Harness
300 WMax-Leistung
Beste Generation
1.744,0 tok/s
gemma-4-E2B-it
∅ Generation
167,7 tok/s
Schnitt aus 222 Läufen
Bester Prefill
31.452 tok/s
Prompt-Verarbeitung
Bester TTFT
179 ms
Time to First Token
Beste Harness-Quote
–%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser GPU · 1.744,0 tok/s
Bester Prefill: 31.452 tok/s · 50 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf NVIDIA GeForce RTX 5070 Ti – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
1.744,0 tok/s
gpt-oss-20b20B
1.210,3 tok/s
Nemotron-3-Nano-4B4B
1.197,0 tok/s
gemma-4-E4B-it8B
1.082,4 tok/s
Gemma-4-26B-A4B-it26B
1.009,0 tok/s
Meta-Llama-3.1-8B-Instruct8B
913,4 tok/s
Ornith-1.0-9B9B
883,4 tok/s
gemma-4-12B-it12B
677,5 tok/s
Ministral-3-14B-Reasoning-251214B
590,0 tok/s
Laguna-XS-2.1
319,0 tok/s
Anzeige
Performanceprofil

Durchsatz auf NVIDIA GeForce RTX 5070 Ti

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

2.2451.6841.1235610,006.38012.76019.139Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.744,0 tok/s Generation, 15.451 tok/s Prefill, TTFT 2.253 ms (8 Laufe)gemma-4-E2B-itgpt-oss-20b - 1.210,3 tok/s Generation, 8.556 tok/s Prefill, TTFT 3.792 ms (3 Laufe)gpt-oss-20bNemotron-3-Nano-4B - 1.197,0 tok/s Generation, 4.606 tok/s Prefill, TTFT 4.936 ms (3 Laufe)Nemotron-3-Nano-4Bgemma-4-E4B-it - 1.082,4 tok/s Generation, 9.183 tok/s Prefill, TTFT 2.840 ms (6 Laufe)gemma-4-E4B-itGemma-4-26B-A4B-it - 1.009,0 tok/s Generation, 3.578 tok/s Prefill, TTFT 5.953 ms (3 Laufe)Gemma-4-26B-A4B-itMeta-Llama-3.1-8B-Instruct - 913,4 tok/s Generation, 6.511 tok/s Prefill, TTFT 5.168 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...Ornith-1.0-9B - 883,4 tok/s Generation, 4.525 tok/s Prefill, TTFT 5.715 ms (3 Laufe)Ornith-1.0-9Bgemma-4-12B-it - 677,5 tok/s Generation, 3.422 tok/s Prefill, TTFT 8.363 ms (4 Laufe)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 590,0 tok/s Generation, 6.146 tok/s Prefill, TTFT 7.768 ms (4 Laufe)Ministral-3-14B-Reaso...Laguna-XS-2.1 - 319,0 tok/s Generation, 1.407 tok/s Prefill, TTFT 29.353 ms (12 Laufe)Laguna-XS-2.1Ornith-1.0-35B - 309,0 tok/s Generation, 1.030 tok/s Prefill, TTFT 29.122 ms (2 Laufe)Ornith-1.0-35BNemotron-3-Nano-30B-A3B - 263,3 tok/s Generation, 734 tok/s Prefill, TTFT 39.108 ms (2 Laufe)Nemotron-3-Nano-30B-A...Nemotron-3-Nano-Omni-30B-A3B-Reasoning - 262,5 tok/s Generation, 747 tok/s Prefill, TTFT 38.911 ms (2 Laufe)Nemotron-3-Nano-Omni-...Nemotron-Cascade-2-30B-A3B - 262,4 tok/s Generation, 1.415 tok/s Prefill, TTFT 15.119 ms (8 Laufe)Nemotron-Cascade-2-30...North-Mini-Code-1.0 - 169,0 tok/s Generation, 962 tok/s Prefill, TTFT 46.459 ms (2 Laufe)North-Mini-Code-1.0Magistral-Small-2509 - 159,0 tok/s Generation, 110 tok/s Prefill, TTFT 25.408 ms (1 Lauf)Magistral-Small-2509Qwen3-Coder-30B-A3B-Instruct - 157,0 tok/s Generation, 1.505 tok/s Prefill, TTFT 47.292 ms (2 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-Omni-30B-A3B-Thinking - 155,9 tok/s Generation, 989 tok/s Prefill, TTFT 52.114 ms (2 Laufe)Qwen3-Omni-30B-A3B-Th...Qwen3-30B-A3B-Thinking-2507 - 155,8 tok/s Generation, 1.070 tok/s Prefill, TTFT 50.953 ms (2 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-VL-30B-A3B-Instruct - 154,0 tok/s Generation, 1.366 tok/s Prefill, TTFT 49.256 ms (2 Laufe)Qwen3-VL-30B-A3B-Inst...Qwen3-30B-A3B-Instruct-2507 - 152,7 tok/s Generation, 1.518 tok/s Prefill, TTFT 48.542 ms (2 Laufe)Qwen3-30B-A3B-Instruc...Qwen3.6-35B-A3B - 142,9 tok/s Generation, 498 tok/s Prefill, TTFT 91.483 ms (1 Lauf)Qwen3.6-35B-A3BQwen3.5-35B-A3B - 142,2 tok/s Generation, 503 tok/s Prefill, TTFT 90.967 ms (1 Lauf)Qwen3.5-35B-A3BQwen-AgentWorld-35B-A3B - 140,1 tok/s Generation, 524 tok/s Prefill, TTFT 90.775 ms (1 Lauf)Qwen-AgentWorld-35B-A...Devstral-Small-2-24B-Instruct-2512 - 108,5 tok/s Generation, 2.121 tok/s Prefill, TTFT 85.480 ms (1 Lauf)Devstral-Small-2-24B-...
gemma-4-E2B-it 1.744,0 tok/sgpt-oss-20b 1.210,3 tok/sNemotron-3-Nano-4B 1.197,0 tok/sgemma-4-E4B-it 1.082,4 tok/sGemma-4-26B-A4B-it 1.009,0 tok/sMeta-Llama-3.1-8B-Instruct 913,4 tok/sOrnith-1.0-9B 883,4 tok/sgemma-4-12B-it 677,5 tok/sMinistral-3-14B-Reasoning-2512 590,0 tok/sLaguna-XS-2.1 319,0 tok/sOrnith-1.0-35B 309,0 tok/sNemotron-3-Nano-30B-A3B 263,3 tok/sNemotron-3-Nano-Omni-30B-A3B-Reasoning 262,5 tok/sNemotron-Cascade-2-30B-A3B 262,4 tok/sNorth-Mini-Code-1.0 169,0 tok/sMagistral-Small-2509 159,0 tok/sQwen3-Coder-30B-A3B-Instruct 157,0 tok/sQwen3-Omni-30B-A3B-Thinking 155,9 tok/sQwen3-30B-A3B-Thinking-2507 155,8 tok/sQwen3-VL-30B-A3B-Instruct 154,0 tok/sQwen3-30B-A3B-Instruct-2507 152,7 tok/sQwen3.6-35B-A3B 142,9 tok/sQwen3.5-35B-A3B 142,2 tok/sQwen-AgentWorld-35B-A3B 140,1 tok/sDevstral-Small-2-24B-Instruct-2512 108,5 tok/s

ENGnach Engine

1.9451.8111.6761.5421.4077115.56710.42415.280Prefill (tok/s)Generation (tok/s)llama.cpp - 1.744,0 tok/s Generation, 3.203 tok/s Prefill, TTFT 25.935 ms (70 Laufe)llama.cppvLLM - 1.608,5 tok/s Generation, 12.788 tok/s Prefill, TTFT 2.163 ms (10 Laufe)vLLM
llama.cpp 1.744,0 tok/svLLM 1.608,5 tok/s

CPUnach Prozessor

2.2231.6671.1125560,08142.3573.9005.443Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 5975WX 32-Cores - 1.744,0 tok/s Generation, 4.626 tok/s Prefill, TTFT 24.236 ms (74 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 7945HX with Radeon Graphics - 219,6 tok/s Generation, 1.631 tok/s Prefill, TTFT 7.274 ms (6 Laufe)AMD Ryzen 9 7945HX wi...
AMD Ryzen Threadripper PRO 5975WX 32-Cores 1.744,0 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 219,6 tok/s
Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf NVIDIA GeForce RTX 5070 Ti.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.743,96 tok/s TG
Prefill 13.641 · TTFT 5.790 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
2gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.743,14 tok/s TG
Prefill 12.148 · TTFT 5.881 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
3gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,46 tok/s TG
Prefill 31.452 · TTFT 1.633 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
4gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.210,29 tok/s TG
Prefill 9.745 · TTFT 8.399 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
5Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.196,98 tok/s TG
Prefill 6.074 · TTFT 10.280 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
6gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.082,39 tok/s TG
Prefill 6.941 · TTFT 9.659 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
7gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.022,79 tok/s TG
Prefill 18.744 · TTFT 2.204 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
8Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.009,04 tok/s TG
Prefill 4.090 · TTFT 12.734 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
9gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
973,54 tok/s TG
Prefill 23.599 · TTFT 460 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
10gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
971,35 tok/s TG
Prefill 9.983 · TTFT 2.015 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
11gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
969,62 tok/s TG
Prefill 12.437 · TTFT 1.852 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
12Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
913,39 tok/s TG
Prefill 8.119 · TTFT 11.247 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
13Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
883,39 tok/s TG
Prefill 5.377 · TTFT 12.467 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
14gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
710,36 tok/s TG
Prefill 8.954 · TTFT 2.695 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
15gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
677,50 tok/s TG
Prefill 2.978 · TTFT 18.549 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
16Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
676,42 tok/s TG
Prefill 5.367 · TTFT 3.579 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
17gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
616,01 tok/s TG
Prefill 13.778 · TTFT 803 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
18gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
592,13 tok/s TG
Prefill 5.662 · TTFT 3.385 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
19Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
590,01 tok/s TG
Prefill 5.490 · TTFT 17.999 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
20Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
585,92 tok/s TG
Prefill 3.535 · TTFT 4.487 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
21Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
497,64 tok/s TG
Prefill 8.340 · TTFT 5.360 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
22Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
489,71 tok/s TG
Prefill 8.631 · TTFT 3.252 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
23gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
486,20 tok/s TG
Prefill 4.345 · TTFT 5.863 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
24Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
468,02 tok/s TG
Prefill 4.949 · TTFT 4.084 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
25gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
360,92 tok/s TG
Prefill 2.636 · TTFT 6.319 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
26Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
319,02 tok/s TG
Prefill 1.498 · TTFT 42.331 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
27Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,94 tok/s TG
Prefill 1.446 · TTFT 42.781 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
28Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,66 tok/s TG
Prefill 5.742 · TTFT 2.122 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawAWQDetails →
29Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,47 tok/s TG
Prefill 1.427 · TTFT 42.816 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
30Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
318,17 tok/s TG
Prefill 1.479 · TTFT 42.546 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
31Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
316,35 tok/s TG
Prefill 1.470 · TTFT 42.801 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
32Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
316,28 tok/s TG
Prefill 1.496 · TTFT 42.551 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
33gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
315,66 tok/s TG
Prefill 3.728 · TTFT 2.722 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
34Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
312,21 tok/s TG
Prefill 5.010 · TTFT 5.594 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
35Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
309,02 tok/s TG
Prefill 1.120 · TTFT 42.243 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
36gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
276,28 tok/s TG
Prefill 9.272 · TTFT 213 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
37Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
263,34 tok/s TG
Prefill 784 · TTFT 55.800 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
38Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
262,45 tok/s TG
Prefill 811 · TTFT 55.388 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
39Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
262,44 tok/s TG
Prefill 822 · TTFT 55.319 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
40gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
242,32 tok/s TG
Prefill 6.971 · TTFT 284 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
41Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
233,69 tok/s TG
Prefill 2.376 · TTFT 950 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
42gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,18 tok/s TG
Prefill 11.075 · TTFT 179 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
43Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
219,59 tok/s TG
Prefill 2.273 · TTFT 11.329 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
44Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
205,50 tok/s TG
Prefill 1.351 · TTFT 15.992 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
45Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
205,02 tok/s TG
Prefill 1.348 · TTFT 16.034 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
46Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
205,02 tok/s TG
Prefill 1.327 · TTFT 16.066 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
47Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
204,44 tok/s TG
Prefill 1.300 · TTFT 16.378 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
48Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
204,31 tok/s TG
Prefill 1.375 · TTFT 15.932 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
49Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
203,41 tok/s TG
Prefill 1.372 · TTFT 16.012 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
50Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
190,25 tok/s TG
Prefill 1.859 · TTFT 13.867 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
51Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
189,07 tok/s TG
Prefill 3.110 · TTFT 638 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
52Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,38 tok/s TG
Prefill 940 · TTFT 16.001 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
53North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,98 tok/s TG
Prefill 1.029 · TTFT 69.564 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
54gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
165,04 tok/s TG
Prefill 2.897 · TTFT 711 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
55Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
163,13 tok/s TG
Prefill 683 · TTFT 22.415 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
56Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
163,13 tok/s TG
Prefill 684 · TTFT 22.434 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
57Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
162,55 tok/s TG
Prefill 715 · TTFT 21.986 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
58Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
159,03 tok/s TG
Prefill 110 · TTFT 25.408 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
59Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
157,50 tok/s TG
Prefill 1.715 · TTFT 6.606 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
60Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
157,00 tok/s TG
Prefill 1.473 · TTFT 72.295 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
61Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,26 tok/s TG
Prefill 1.343 · TTFT 8.459 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
62Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
155,85 tok/s TG
Prefill 1.036 · TTFT 78.057 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
63Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
155,77 tok/s TG
Prefill 1.107 · TTFT 76.761 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
64Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
153,96 tok/s TG
Prefill 1.395 · TTFT 74.722 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
65Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
152,65 tok/s TG
Prefill 1.613 · TTFT 73.900 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
66gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
144,58 tok/s TG
Prefill 7.078 · TTFT 281 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclawDetails →
67Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
142,87 tok/s TG
Prefill 498 · TTFT 91.483 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
68Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
142,20 tok/s TG
Prefill 503 · TTFT 90.967 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
69Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
140,90 tok/s TG
Prefill 2.783 · TTFT 1.005 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
70Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
140,11 tok/s TG
Prefill 524 · TTFT 90.775 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
71Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
138,75 tok/s TG
Prefill 1.439 · TTFT 1.508 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
72Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
129,00 tok/s TG
Prefill 3.247 · TTFT 594 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
73Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
120,01 tok/s TG
Prefill 1.155 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
74Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
118,55 tok/s TG
Prefill 1.537 · TTFT 22.290 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
75North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
118,36 tok/s TG
Prefill 895 · TTFT 23.355 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
76Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
118,04 tok/s TG
Prefill 1.033 · TTFT 25.146 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
77Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
117,91 tok/s TG
Prefill 941 · TTFT 26.171 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
78Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
116,57 tok/s TG
Prefill 1.336 · TTFT 23.791 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
79Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
115,20 tok/s TG
Prefill 1.424 · TTFT 23.184 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
80Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
108,50 tok/s TG
Prefill 2.121 · TTFT 85.480 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA GeForce RTX 5070 Ti.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – NVIDIA GeForce RTX 5070 Ti

HerstellerNVIDIA
ArchitekturBlackwell
VRAM16 GB
Tensor-Recheneinheiten280
Speicherbandbreite896 GB/s
TDP300 W
PCIe5.0
Release02/2025
Bewertung★★★★★4,0
Beste Generation1.744,0 tok/s
Bester Prefill31.452 tok/s
Modelle50
Messläufe (Performance)222