Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🎮
Graphics card

NVIDIA GeForce RTX 2060

NVIDIA6 GB VRAM
39Benchmarks
7Models
39Performance
0Harness
Best generation
133,7 tok/s
gemma-4-E4B-it
∅ Generation
68,6 tok/s
Schnitt aus 39 Läufen
Best prefill
4.122 tok/s
Prompt processing
Best TTFT
1.088 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
gemma-4-E4B-it läuft am schnellsten auf dieser GPU · 133,7 tok/s
Bester Prefill: 4.122 tok/s · 7 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf NVIDIA GeForce RTX 2060 – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E4B-it8B
133,7 tok/s
Meta-Llama-3.1-8B-Instruct8B
130,9 tok/s
Nemotron-3-Nano-4B4B
125,7 tok/s
Ornith-1.0-9B9B
108,0 tok/s
gemma-4-12B-it12B
89,8 tok/s
Ministral-3-14B-Reasoning-251214B
60,4 tok/s
gemma-4-E2B-it5B
15,3 tok/s
Anzeige
Performance profile

Durchsatz auf NVIDIA GeForce RTX 2060

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

17112885,442,70,03541.1621.9702.777Prefill (tok/s)Generation (tok/s)gemma-4-E4B-it - 133,7 tok/s Generation, 1.452 tok/s Prefill, TTFT 6.849 ms (6 Laufe)gemma-4-E4B-itMeta-Llama-3.1-8B-Instruct - 130,9 tok/s Generation, 2.353 tok/s Prefill, TTFT 3.410 ms (7 Laufe)Meta-Llama-3.1-8B-Ins...Nemotron-3-Nano-4B - 125,7 tok/s Generation, 1.395 tok/s Prefill, TTFT 8.754 ms (9 Laufe)Nemotron-3-Nano-4BOrnith-1.0-9B - 108,0 tok/s Generation, 1.606 tok/s Prefill, TTFT 6.161 ms (6 Laufe)Ornith-1.0-9Bgemma-4-12B-it - 89,8 tok/s Generation, 779 tok/s Prefill, TTFT 13.058 ms (3 Laufe)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 60,4 tok/s Generation, 1.290 tok/s Prefill, TTFT 5.121 ms (2 Laufe)Ministral-3-14B-Reaso...gemma-4-E2B-it - 15,3 tok/s Generation, 1.440 tok/s Prefill, TTFT 8.790 ms (6 Laufe)gemma-4-E2B-it
gemma-4-E4B-it 133,7 tok/sMeta-Llama-3.1-8B-Instruct 130,9 tok/sNemotron-3-Nano-4B 125,7 tok/sOrnith-1.0-9B 108,0 tok/sgemma-4-12B-it 89,8 tok/sMinistral-3-14B-Reasoning-2512 60,4 tok/sgemma-4-E2B-it 15,3 tok/s

ENGnach Engine

1471401341271201.4691.5311.5941.656Prefill (tok/s)Generation (tok/s)llama.cpp - 133,7 tok/s Generation, 1.562 tok/s Prefill, TTFT 7.253 ms (39 Laufe)llama.cpp
llama.cpp 133,7 tok/s

CPUnach Prozessor

1471401341271201.4691.5311.5941.656Prefill (tok/s)Generation (tok/s)Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz - 133,7 tok/s Generation, 1.562 tok/s Prefill, TTFT 7.253 ms (39 Laufe)Intel(R) Core(TM) i5-...
Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz 133,7 tok/s
Throughput & latency

Performancebenchmark

39 veroeffentlichte Performance-Läufe auf NVIDIA GeForce RTX 2060.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E4B-it8BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
133,73 tok/s TG
Prefill 1.652 · TTFT 12.206 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
2Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
130,88 tok/s TG
Prefill 4.122 · TTFT 7.946 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
3Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
125,68 tok/s TG
Prefill 2.208 · TTFT 11.151 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
4gemma-4-E4B-it8BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,06 tok/s TG
Prefill 1.687 · TTFT 12.063 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
5Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
116,24 tok/s TG
Prefill 1.891 · TTFT 5.975 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
6Ornith-1.0-9B9BQ4_K_MDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
108,03 tok/s TG
Prefill 2.184 · TTFT 10.407 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
7Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
106,92 tok/s TG
Prefill 1.319 · TTFT 18.921 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
8Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,11 tok/s TG
Prefill 1.440 · TTFT 17.007 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
9Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
100,31 tok/s TG
Prefill 1.092 · TTFT 10.399 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
10Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,04 tok/s TG
Prefill 1.231 · TTFT 9.195 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
11Ornith-1.0-9B9BQ8_0DeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
97,31 tok/s TG
Prefill 2.232 · TTFT 10.125 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
12gemma-4-E4B-it8BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
95,22 tok/s TG
Prefill 1.480 · TTFT 6.689 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
13gemma-4-E4B-it8BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
93,25 tok/s TG
Prefill 1.437 · TTFT 6.874 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
14Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,37 tok/s TG
Prefill 3.202 · TTFT 4.555 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
15gemma-4-12B-it12BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,80 tok/s TG
Prefill 877 · TTFT 23.528 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
16Meta-Llama-3.1-8B-Instruct8BQ8_0Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,46 tok/s TG
Prefill 3.210 · TTFT 4.511 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
17Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
80,94 tok/s TG
Prefill 1.564 · TTFT 1.376 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
18Ornith-1.0-9B9BQ4_K_MDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,74 tok/s TG
Prefill 1.579 · TTFT 6.372 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
19Ornith-1.0-9B9BQ8_0DeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,89 tok/s TG
Prefill 1.619 · TTFT 6.216 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
20Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
72,37 tok/s TG
Prefill 865 · TTFT 2.489 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
21Nemotron-3-Nano-4B4BQ4_K_MNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
71,70 tok/s TG
Prefill 945 · TTFT 2.277 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
22gemma-4-12B-it12BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,61 tok/s TG
Prefill 776 · TTFT 12.750 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
23Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,39 tok/s TG
Prefill 1.497 · TTFT 8.155 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
24gemma-4-E4B-it8BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
53,35 tok/s TG
Prefill 1.366 · TTFT 1.447 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
25Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
48,95 tok/s TG
Prefill 1.278 · TTFT 1.932 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
26Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,41 tok/s TG
Prefill 1.800 · TTFT 1.368 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
27Meta-Llama-3.1-8B-Instruct8BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
45,73 tok/s TG
Prefill 1.206 · TTFT 2.050 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
28Ornith-1.0-9B9BQ4_K_MDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
42,36 tok/s TG
Prefill 986 · TTFT 1.973 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
29gemma-4-E4B-it8BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
38,32 tok/s TG
Prefill 1.088 · TTFT 1.818 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
30Meta-Llama-3.1-8B-Instruct8BQ8_0Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,83 tok/s TG
Prefill 1.653 · TTFT 1.506 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
31gemma-4-12B-it12BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,34 tok/s TG
Prefill 684 · TTFT 2.896 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
32Ornith-1.0-9B9BQ8_0DeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,62 tok/s TG
Prefill 1.037 · TTFT 1.873 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
33Ministral-3-14B-Reasoning-251214BQ4_K_MMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,08 tok/s TG
Prefill 1.083 · TTFT 2.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
34gemma-4-E2B-it5BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,30 tok/s TG
Prefill 1.816 · TTFT 1.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
35gemma-4-E2B-it5BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,49 tok/s TG
Prefill 1.763 · TTFT 1.123 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
36gemma-4-E2B-it5BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,45 tok/s TG
Prefill 1.249 · TTFT 8.044 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
37gemma-4-E2B-it5BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,43 tok/s TG
Prefill 1.220 · TTFT 8.133 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
38gemma-4-E2B-it5BQ8_0Google Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,73 tok/s TG
Prefill 1.306 · TTFT 16.890 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
39gemma-4-E2B-it5BQ4_K_MGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,84 tok/s TG
Prefill 1.286 · TTFT 17.461 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA GeForce RTX 2060.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – NVIDIA GeForce RTX 2060

HerstellerNVIDIA
VRAM6 GB
Best generation133,7 tok/s
Best prefill4.122 tok/s
Models7
Messläufe (Performance)39