Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
🎮
Graphics card

NVIDIA GeForce RTX 2060

NVIDIA6 GB VRAM
77Benchmarks
23Models
77Performance
0Harness
10 WIdle power
160 WMax power
Best generation
133,7 tok/s
gemma-4-E4B-it
∅ Generation
36,8 tok/s
Schnitt aus 77 Läufen
Best prefill
4.122 tok/s
Prompt processing
Best TTFT
569 ms
Time to First Token
Best harness rate
–%
noch kein Harness
🏆
gemma-4-E4B-it läuft am schnellsten auf dieser GPU · 133,7 tok/s
Bester Prefill: 4.122 tok/s · 23 Modelle getestet

Top models

Bester gemessener Durchsatz je Modell auf NVIDIA GeForce RTX 2060 – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E4B-it8B
133,7 tok/s
Meta-Llama-3.1-8B-Instruct8B
130,9 tok/s
Nemotron-3-Nano-4B4B
125,7 tok/s
Ornith-1.0-9B9B
108,0 tok/s
gemma-4-12B-it12B
89,8 tok/s
Ministral-3-14B-Reasoning-251214B
60,4 tok/s
gemma-4-E2B-it5B
15,3 tok/s
gpt-oss-20b20B
14,5 tok/s
Qwen3-30B-A3B-Thinking-250730B
8,5 tok/s
Qwen3-30B-A3B-Instruct-250730B
7,1 tok/s
Anzeige
Performance profile

Durchsatz auf NVIDIA GeForce RTX 2060

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

17413086,843,40,008521.7052.557Prefill (tok/s)Generation (tok/s)gemma-4-E4B-it - 133,7 tok/s Generation, 1.452 tok/s Prefill, TTFT 6.849 ms (6 Laufe)gemma-4-E4B-itMeta-Llama-3.1-8B-Instruct - 130,9 tok/s Generation, 2.063 tok/s Prefill, TTFT 10.364 ms (8 Laufe)Meta-Llama-3.1-8B-Ins...Nemotron-3-Nano-4B - 125,7 tok/s Generation, 1.062 tok/s Prefill, TTFT 41.388 ms (12 Laufe)Nemotron-3-Nano-4BOrnith-1.0-9B - 108,0 tok/s Generation, 1.606 tok/s Prefill, TTFT 6.161 ms (6 Laufe)Ornith-1.0-9Bgemma-4-12B-it - 89,8 tok/s Generation, 779 tok/s Prefill, TTFT 13.058 ms (3 Laufe)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 60,4 tok/s Generation, 1.290 tok/s Prefill, TTFT 5.121 ms (2 Laufe)Ministral-3-14B-Reaso...gemma-4-E2B-it - 15,3 tok/s Generation, 1.440 tok/s Prefill, TTFT 8.790 ms (6 Laufe)gemma-4-E2B-itgpt-oss-20b - 14,5 tok/s Generation, 88 tok/s Prefill, TTFT 122.346 ms (3 Laufe)gpt-oss-20bQwen3-30B-A3B-Thinking-2507 - 8,5 tok/s Generation, 74 tok/s Prefill, TTFT 134.321 ms (3 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-30B-A3B-Instruct-2507 - 7,1 tok/s Generation, 102 tok/s Prefill, TTFT 109.338 ms (3 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-Coder-30B-A3B-Instruct - 6,7 tok/s Generation, 103 tok/s Prefill, TTFT 107.342 ms (3 Laufe)Qwen3-Coder-30B-A3B-I...Nemotron-3-Nano-30B-A3B - 6,6 tok/s Generation, 72 tok/s Prefill, TTFT 131.051 ms (3 Laufe)Nemotron-3-Nano-30B-A...Nemotron-Cascade-2-30B-A3B - 5,9 tok/s Generation, 72 tok/s Prefill, TTFT 130.288 ms (3 Laufe)Nemotron-Cascade-2-30...gpt-oss-120b - 5,3 tok/s Generation, 42 tok/s Prefill, TTFT 165.568 ms (3 Laufe)gpt-oss-120bNorth-Mini-Code-1.0 - 5,1 tok/s Generation, 89 tok/s Prefill, TTFT 113.797 ms (3 Laufe)North-Mini-Code-1.0Qwen3.6-35B-A3B - 4,3 tok/s Generation, 62 tok/s Prefill, TTFT 31.435 ms (1 Lauf)Qwen3.6-35B-A3BMiniMax-M2.7 - 2,6 tok/s Generation, 24 tok/s Prefill, TTFT 193.311 ms (3 Laufe)MiniMax-M2.7Qwen2.5-72B-Instruct - 2,3 tok/s Generation, 81 tok/s Prefill, TTFT 569 ms (1 Lauf)Qwen2.5-72B-InstructGLM-4.5-Air - 2,1 tok/s Generation, 18 tok/s Prefill, TTFT 117.963 ms (1 Lauf)GLM-4.5-AirDeepSeek-V4-Flash-284B-A13B - 1,2 tok/s Generation, 14 tok/s Prefill, TTFT 148.315 ms (1 Lauf)DeepSeek-V4-Flash-284...OpenReasoning-Nemotron-32B - 1,1 tok/s Generation, 8 tok/s Prefill, TTFT 266.668 ms (1 Lauf)OpenReasoning-Nemotro...Seed-OSS-36B-Instruct - 1,0 tok/s Generation, 8 tok/s Prefill, TTFT 240.790 ms (1 Lauf)Seed-OSS-36B-InstructMiniMax-M2.5 - 0,8 tok/s Generation, 22 tok/s Prefill, TTFT 98.716 ms (1 Lauf)MiniMax-M2.5
gemma-4-E4B-it 133,7 tok/sMeta-Llama-3.1-8B-Instruct 130,9 tok/sNemotron-3-Nano-4B 125,7 tok/sOrnith-1.0-9B 108,0 tok/sgemma-4-12B-it 89,8 tok/sMinistral-3-14B-Reasoning-2512 60,4 tok/sgemma-4-E2B-it 15,3 tok/sgpt-oss-20b 14,5 tok/sQwen3-30B-A3B-Thinking-2507 8,5 tok/sQwen3-30B-A3B-Instruct-2507 7,1 tok/sQwen3-Coder-30B-A3B-Instruct 6,7 tok/sNemotron-3-Nano-30B-A3B 6,6 tok/sNemotron-Cascade-2-30B-A3B 5,9 tok/sgpt-oss-120b 5,3 tok/sNorth-Mini-Code-1.0 5,1 tok/sQwen3.6-35B-A3B 4,3 tok/sMiniMax-M2.7 2,6 tok/sQwen2.5-72B-Instruct 2,3 tok/sGLM-4.5-Air 2,1 tok/sDeepSeek-V4-Flash-284B-A13B 1,2 tok/sOpenReasoning-Nemotron-32B 1,1 tok/sSeed-OSS-36B-Instruct 1,0 tok/sMiniMax-M2.5 0,8 tok/s

ENGnach Engine

147140134127120773806839872Prefill (tok/s)Generation (tok/s)llama.cpp - 133,7 tok/s Generation, 823 tok/s Prefill, TTFT 68.653 ms (77 Laufe)llama.cpp
llama.cpp 133,7 tok/s

CPUnach Prozessor

17313086,743,30,006421.2841.926Prefill (tok/s)Generation (tok/s)Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz - 133,7 tok/s Generation, 1.562 tok/s Prefill, TTFT 7.253 ms (39 Laufe)Intel(R) Core(TM) i5-...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 14,5 tok/s Generation, 64 tok/s Prefill, TTFT 135.213 ms (37 Laufe)Intel(R) Xeon(R) CPU ...Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 2,3 tok/s Generation, 81 tok/s Prefill, TTFT 569 ms (1 Lauf)Intel(R) Xeon(R) CPU ...
Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz 133,7 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 14,5 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 2,3 tok/s
Throughput & latency

Performancebenchmark

77 veroeffentlichte Performance-Läufe auf NVIDIA GeForce RTX 2060.

In the leaderboard →
Metric:
Size
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
133,73 tok/s TG
Prefill 1.652 · TTFT 12.206 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
2Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
130,88 tok/s TG
Prefill 4.122 · TTFT 7.946 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
3Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,68 tok/s TG
Prefill 2.208 · TTFT 11.151 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
4gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,06 tok/s TG
Prefill 1.687 · TTFT 12.063 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
5Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
116,24 tok/s TG
Prefill 1.891 · TTFT 5.975 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
6Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
108,03 tok/s TG
Prefill 2.184 · TTFT 10.407 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
7Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,92 tok/s TG
Prefill 1.319 · TTFT 18.921 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
8Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,11 tok/s TG
Prefill 1.440 · TTFT 17.007 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
9Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,31 tok/s TG
Prefill 1.092 · TTFT 10.399 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
10Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
100,04 tok/s TG
Prefill 1.231 · TTFT 9.195 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
11Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
97,31 tok/s TG
Prefill 2.232 · TTFT 10.125 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
12gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
95,22 tok/s TG
Prefill 1.480 · TTFT 6.689 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
13gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
93,25 tok/s TG
Prefill 1.437 · TTFT 6.874 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
14Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,37 tok/s TG
Prefill 3.202 · TTFT 4.555 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
15gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,80 tok/s TG
Prefill 877 · TTFT 23.528 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
16Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
89,46 tok/s TG
Prefill 3.210 · TTFT 4.511 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
17Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,94 tok/s TG
Prefill 1.564 · TTFT 1.376 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
18Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
80,74 tok/s TG
Prefill 1.579 · TTFT 6.372 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
19Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
73,89 tok/s TG
Prefill 1.619 · TTFT 6.216 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
20Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
72,37 tok/s TG
Prefill 865 · TTFT 2.489 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
21Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
71,70 tok/s TG
Prefill 945 · TTFT 2.277 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
22gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,61 tok/s TG
Prefill 776 · TTFT 12.750 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
23Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
60,39 tok/s TG
Prefill 1.497 · TTFT 8.155 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
24gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
53,35 tok/s TG
Prefill 1.366 · TTFT 1.447 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
25Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,95 tok/s TG
Prefill 1.278 · TTFT 1.932 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
26Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,41 tok/s TG
Prefill 1.800 · TTFT 1.368 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
27Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
45,73 tok/s TG
Prefill 1.206 · TTFT 2.050 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
28Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
42,36 tok/s TG
Prefill 986 · TTFT 1.973 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
29gemma-4-E4B-it8BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
38,32 tok/s TG
Prefill 1.088 · TTFT 1.818 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
30Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,83 tok/s TG
Prefill 1.653 · TTFT 1.506 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
31gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
30,34 tok/s TG
Prefill 684 · TTFT 2.896 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
32Ornith-1.0-9B9BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,62 tok/s TG
Prefill 1.037 · TTFT 1.873 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
33Ministral-3-14B-Reasoning-251214BMistral AI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,08 tok/s TG
Prefill 1.083 · TTFT 2.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
34gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,30 tok/s TG
Prefill 1.816 · TTFT 1.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
35gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,49 tok/s TG
Prefill 1.763 · TTFT 1.123 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
36gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,47 tok/s TG
Prefill 97 · TTFT 222.547 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
37gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,45 tok/s TG
Prefill 1.249 · TTFT 8.044 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
38gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,43 tok/s TG
Prefill 1.220 · TTFT 8.133 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
39gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,77 tok/s TG
Prefill 89 · TTFT 119.492 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
40gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,73 tok/s TG
Prefill 1.306 · TTFT 16.890 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0Details →
41Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,52 tok/s TG
Prefill 71 · TTFT 152.830 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
42Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,97 tok/s TG
Prefill 72 · TTFT 153.653 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
43Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,14 tok/s TG
Prefill 69 · TTFT 35.318 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
44gemma-4-E2B-it5BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,84 tok/s TG
Prefill 1.286 · TTFT 17.461 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
45Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,74 tok/s TG
Prefill 74 · TTFT 32.942 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
46Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,64 tok/s TG
Prefill 73 · TTFT 33.548 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
47Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,60 tok/s TG
Prefill 73 · TTFT 150.849 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
48gpt-oss-20b20BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,46 tok/s TG
Prefill 79 · TTFT 25.000 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
49Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,09 tok/s TG
Prefill 100 · TTFT 121.223 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
50Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,05 tok/s TG
Prefill 104 · TTFT 116.729 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
51Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,88 tok/s TG
Prefill 61 · TTFT 35.422 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
52Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,86 tok/s TG
Prefill 61 · TTFT 35.481 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
53Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,33 tok/s TG
Prefill 74 · TTFT 150.609 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
54gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,29 tok/s TG
Prefill 56 · TTFT 189.966 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
55North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,05 tok/s TG
Prefill 71 · TTFT 28.002 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
56Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,94 tok/s TG
Prefill 41 · TTFT 62.079 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
57gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,46 tok/s TG
Prefill 50 · TTFT 39.304 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
58Qwen3.6-35B-A3B35BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,29 tok/s TG
Prefill 62 · TTFT 31.435 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
59North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,20 tok/s TG
Prefill 86 · TTFT 127.307 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
60Meta-Llama-3.1-8B-Instruct8BMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,55 tok/s TG
Prefill 36 · TTFT 59.044 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
61North-Mini-Code-1.0Cohere Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,16 tok/s TG
Prefill 109 · TTFT 186.084 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
62MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,62 tok/s TG
Prefill 15 · TTFT 156.050 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
63Qwen2.5-72B-Instruct72BQwen (Alibaba) Performance benchmarkPerformancetest Small 1.0
2,28 tok/s TG
Prefill 81 · TTFT 569 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
64GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,13 tok/s TG
Prefill 18 · TTFT 117.963 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
65DeepSeek-V4-Flash-284B-A13B284BDeepSeek Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,20 tok/s TG
Prefill 14 · TTFT 148.315 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawUD-Q4_K_XLDetails →
66OpenReasoning-Nemotron-32B32BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,10 tok/s TG
Prefill 8 · TTFT 266.668 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
67Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,04 tok/s TG
Prefill 137 · TTFT 171.473 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
68Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,99 tok/s TG
Prefill 130 · TTFT 172.354 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
69Seed-OSS-36B-Instruct36BByteDance Seed Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,97 tok/s TG
Prefill 8 · TTFT 240.790 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
70MiniMax-M2.5230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,84 tok/s TG
Prefill 22 · TTFT 98.716 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
71Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,58 tok/s TG
Prefill 77 · TTFT 216.585 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
72Nemotron-3-Nano-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,27 tok/s TG
Prefill 81 · TTFT 206.882 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
73Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,27 tok/s TG
Prefill 82 · TTFT 204.776 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
74Nemotron-3-Nano-4B4BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,25 tok/s TG
Prefill 75 · TTFT 202.135 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
75gpt-oss-120b120BOpenAI Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,05 tok/s TG
Prefill 20 · TTFT 267.436 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
76MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,04 tok/s TG
Prefill 29 · TTFT 211.132 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
77MiniMax-M2.7230BMiniMax Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,03 tok/s TG
Prefill 28 · TTFT 212.753 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawUD-Q4_K_MDetails →
Agent & chat rating

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA GeForce RTX 2060.

In the leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← All hardware

Technische Daten

Technische Daten – NVIDIA GeForce RTX 2060

HerstellerNVIDIA
ArchitekturTuring
VRAM6 GB
Tensor-Recheneinheiten240
Speicherbandbreite336 GB/s
TDP160 W
PCIe3.0
Release01/2019
Best generation133,7 tok/s
Best prefill4.122 tok/s
Models23
Messläufe (Performance)77