Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Google

gemma-4-E2B-it5B

Benchmarkprofil und veröffentlichte Ergebnisse.

Dense5B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation2.491,2 tok/s
Min 0,1Ø 429,9Max 2.491,2
Spitzenwert im Feld · 218 Systeme im Feld
Prefill15.814 tok/s
Min 7Ø 4.548Max 37.116
Ueber dem Durchschnitt · 218 Systeme im Feld
Time to First Token602 ms
Min 119Ø 65.147Max 328.995
Ueber dem Durchschnitt · 218 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

3.2362.4271.6188090,007.11714.23521.352Prefill (tok/s)Generation (tok/s)NVIDIA GeForce RTX 5090 - 2.491,2 tok/s Generation, 11.148 tok/s Prefill, TTFT 2.175 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 2.414,4 tok/s Generation, 16.315 tok/s Prefill, TTFT 1.871 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 2.143,6 tok/s Generation, 11.441 tok/s Prefill, TTFT 2.226 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5070 Ti - 1.744,0 tok/s Generation, 15.451 tok/s Prefill, TTFT 2.253 ms (8 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX A6000 - 1.568,0 tok/s Generation, 17.428 tok/s Prefill, TTFT 1.938 ms (27 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 3090 Ti - 1.492,8 tok/s Generation, 13.345 tok/s Prefill, TTFT 1.694 ms (8 Laufe)NVIDIA GeForce RTX 30...NVIDIA GB10 - 903,3 tok/s Generation, 6.421 tok/s Prefill, TTFT 7.548 ms (4 Laufe)NVIDIA GB10Intel Arc Pro B70 - 826,2 tok/s Generation, 2.623 tok/s Prefill, TTFT 7.541 ms (3 Laufe)Intel Arc Pro B70AMD Radeon PRO W7800 48GB - 702,9 tok/s Generation, 5.006 tok/s Prefill, TTFT 2.435 ms (11 Laufe)AMD Radeon PRO W7800 ...Tesla V100-PCIE-32GB - 361,8 tok/s Generation, 5.868 tok/s Prefill, TTFT 1.823 ms (6 Laufe)Tesla V100-PCIE-32GBNVIDIA GeForce RTX 2060 - 15,3 tok/s Generation, 1.440 tok/s Prefill, TTFT 8.790 ms (6 Laufe)NVIDIA GeForce RTX 20...
NVIDIA GeForce RTX 5090 2.491,2 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 2.414,4 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 2.143,6 tok/sNVIDIA GeForce RTX 5070 Ti 1.744,0 tok/sNVIDIA RTX A6000 1.568,0 tok/sNVIDIA GeForce RTX 3090 Ti 1.492,8 tok/sNVIDIA GB10 903,3 tok/sIntel Arc Pro B70 826,2 tok/sAMD Radeon PRO W7800 48GB 702,9 tok/sTesla V100-PCIE-32GB 361,8 tok/sNVIDIA GeForce RTX 2060 15,3 tok/s

CPUnach Prozessor

3.2362.4271.6188090,007.11714.23521.352Prefill (tok/s)Generation (tok/s)AMD Ryzen 7 5800X3D 8-Core Processor - 2.491,2 tok/s Generation, 11.148 tok/s Prefill, TTFT 2.175 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 9950X 16-Core Processor - 2.414,4 tok/s Generation, 16.315 tok/s Prefill, TTFT 1.871 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 2.143,6 tok/s Generation, 11.441 tok/s Prefill, TTFT 2.226 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 1.744,0 tok/s Generation, 9.404 tok/s Prefill, TTFT 2.358 ms (19 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 1.568,0 tok/s Generation, 17.428 tok/s Prefill, TTFT 1.938 ms (27 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 1.492,8 tok/s Generation, 9.978 tok/s Prefill, TTFT 3.182 ms (3 Laufe)AMD Ryzen 9 8945HX wi...NVIDIA Grace - 903,3 tok/s Generation, 6.421 tok/s Prefill, TTFT 7.548 ms (4 Laufe)NVIDIA GraceAMD Ryzen 9 7945HX with Radeon Graphics - 826,2 tok/s Generation, 2.623 tok/s Prefill, TTFT 7.541 ms (3 Laufe)AMD Ryzen 9 7945HX wi...AMD Ryzen 5 5600X 6-Core Processor - 451,1 tok/s Generation, 15.366 tok/s Prefill, TTFT 801 ms (5 Laufe)AMD Ryzen 5 5600X 6-C...AMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics - 361,8 tok/s Generation, 5.868 tok/s Prefill, TTFT 1.823 ms (6 Laufe)AMD Ryzen 3 PRO 3200G...Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz - 15,3 tok/s Generation, 1.440 tok/s Prefill, TTFT 8.790 ms (6 Laufe)Intel(R) Core(TM) i5-...
AMD Ryzen 7 5800X3D 8-Core Processor 2.491,2 tok/sAMD Ryzen 9 9950X 16-Core Processor 2.414,4 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 2.143,6 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 1.744,0 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 1.568,0 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 1.492,8 tok/sNVIDIA Grace 903,3 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 826,2 tok/sAMD Ryzen 5 5600X 6-Core Processor 451,1 tok/sAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics 361,8 tok/sIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz 15,3 tok/s

ENGnach Engine

2.9172.4832.0501.6161.1833.15612.24721.33930.430Prefill (tok/s)Generation (tok/s)llama.cpp - 2.491,2 tok/s Generation, 7.899 tok/s Prefill, TTFT 3.638 ms (65 Laufe)llama.cppvLLM - 1.608,5 tok/s Generation, 25.687 tok/s Prefill, TTFT 558 ms (17 Laufe)vLLM
llama.cpp 2.491,2 tok/svLLM 1.608,5 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.491,20 tok/s TG
Prefill 15.814 · TTFT 4.382 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
2gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.414,37 tok/s TG
Prefill 20.277 · TTFT 4.107 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
3gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2.143,55 tok/s TG
Prefill 13.632 · TTFT 4.819 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.743,96 tok/s TG
Prefill 13.641 · TTFT 5.790 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
5gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.743,14 tok/s TG
Prefill 12.148 · TTFT 5.881 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
6gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.608,46 tok/s TG
Prefill 31.452 · TTFT 1.633 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
7gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.567,98 tok/s TG
Prefill 55.260 · TTFT 492 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
8gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.492,78 tok/s TG
Prefill 11.476 · TTFT 7.075 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
9gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.359,09 tok/s TG
Prefill 47.158 · TTFT 587 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
10gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.349,34 tok/s TG
Prefill 18.159 · TTFT 1.302 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
11gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.301,91 tok/s TG
Prefill 13.076 · TTFT 1.540 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
12gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.195,72 tok/s TG
Prefill 13.905 · TTFT 1.561 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
13gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.122,50 tok/s TG
Prefill 38.712 · TTFT 690 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
14gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
973,54 tok/s TG
Prefill 23.599 · TTFT 460 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
15gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
971,35 tok/s TG
Prefill 9.983 · TTFT 2.015 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
16gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
969,62 tok/s TG
Prefill 12.437 · TTFT 1.852 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
17gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
909,00 tok/s TG
Prefill 43.093 · TTFT 288 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
18gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
903,30 tok/s TG
Prefill 6.960 · TTFT 11.382 ms
10×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
19gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
860,88 tok/s TG
Prefill 6.641 · TTFT 11.413 ms
10×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
20gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
827,28 tok/s TG
Prefill 9.803 · TTFT 2.242 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
21gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
826,24 tok/s TG
Prefill 3.229 · TTFT 15.223 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
22gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
803,18 tok/s TG
Prefill 35.757 · TTFT 347 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
23gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
702,86 tok/s TG
Prefill 5.157 · TTFT 6.385 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
24gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
668,00 tok/s TG
Prefill 11.047 · TTFT 1.802 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
25gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
631,69 tok/s TG
Prefill 29.259 · TTFT 405 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
26gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
600,60 tok/s TG
Prefill 11.197 · TTFT 1.774 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
27gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
505,77 tok/s TG
Prefill 5.745 · TTFT 7.265 ms
10×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
28gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
478,55 tok/s TG
Prefill 6.243 · TTFT 3.601 ms
5×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
29gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
462,78 tok/s TG
Prefill 10.812 · TTFT 917 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
30gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
461,54 tok/s TG
Prefill 5.838 · TTFT 3.795 ms
5×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppgodclawQ4_K_M
31gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
451,05 tok/s TG
Prefill 32.005 · TTFT 864 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
32gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
436,25 tok/s TG
Prefill 3.526 · TTFT 5.370 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
33gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
429,79 tok/s TG
Prefill 10.850 · TTFT 916 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
34gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
378,60 tok/s TG
Prefill 10.510 · TTFT 205 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
35gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
377,61 tok/s TG
Prefill 4.553 · TTFT 602 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
36gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
361,84 tok/s TG
Prefill 7.233 · TTFT 2.750 ms
10×Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAMllama.cppgodclawQ8_0
37gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
357,48 tok/s TG
Prefill 11.574 · TTFT 9.330 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
38gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
353,85 tok/s TG
Prefill 4.758 · TTFT 4.353 ms
10×Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAMllama.cppgodclawQ4_K_M
39gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
343,94 tok/s TG
Prefill 6.786 · TTFT 299 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
40gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
340,29 tok/s TG
Prefill 10.252 · TTFT 9.825 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
41gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
336,96 tok/s TG
Prefill 10.238 · TTFT 9.917 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
42gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
322,68 tok/s TG
Prefill 11.269 · TTFT 9.346 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
43gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
276,28 tok/s TG
Prefill 9.272 · TTFT 213 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
44gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
275,62 tok/s TG
Prefill 6.734 · TTFT 1.481 ms
5×Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAMllama.cppgodclawQ8_0
45gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
255,41 tok/s TG
Prefill 6.332 · TTFT 1.575 ms
5×Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAMllama.cppgodclawQ4_K_M
46gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
253,35 tok/s TG
Prefill 5.135 · TTFT 1.933 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
47gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,53 tok/s TG
Prefill 6.897 · TTFT 1.885 ms
5×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
48gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
235,80 tok/s TG
Prefill 8.654 · TTFT 230 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
49gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,18 tok/s TG
Prefill 11.075 · TTFT 179 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMvLLMgodclaw
50gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
228,02 tok/s TG
Prefill 11.489 · TTFT 2.605 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
51gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
201,08 tok/s TG
Prefill 16.859 · TTFT 117 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
52gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
194,48 tok/s TG
Prefill 8.378 · TTFT 236 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
53gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
186,74 tok/s TG
Prefill 10.029 · TTFT 990 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
54gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
185,43 tok/s TG
Prefill 10.974 · TTFT 905 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
55gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
185,42 tok/s TG
Prefill 10.123 · TTFT 978 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
56gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,54 tok/s TG
Prefill 14.420 · TTFT 137 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
57gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,09 tok/s TG
Prefill 10.766 · TTFT 922 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
58gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
153,69 tok/s TG
Prefill 8.308 · TTFT 239 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0
59gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
137,31 tok/s TG
Prefill 13.203 · TTFT 149 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
60gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
134,26 tok/s TG
Prefill 1.113 · TTFT 2.031 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
61gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
131,94 tok/s TG
Prefill 3.904 · TTFT 521 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
62gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
128,96 tok/s TG
Prefill 4.924 · TTFT 402 ms
1×Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAMllama.cppgodclawQ4_K_M
63gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,99 tok/s TG
Prefill 7.722 · TTFT 257 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
64gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
123,34 tok/s TG
Prefill 7.324 · TTFT 270 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
65gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
117,98 tok/s TG
Prefill 5.227 · TTFT 378 ms
1×Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAMllama.cppgodclawQ8_0
66gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
114,56 tok/s TG
Prefill 4.326 · TTFT 459 ms
1×AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
67gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
113,83 tok/s TG
Prefill 7.554 · TTFT 264 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
68gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
113,50 tok/s TG
Prefill 8.429 · TTFT 235 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
69gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
101,23 tok/s TG
Prefill 5.351 · TTFT 3.702 ms
10×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
70gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
89,88 tok/s TG
Prefill 5.543 · TTFT 1.786 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
71gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
73,09 tok/s TG
Prefill 3.852 · TTFT 519 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ4_K_M
72gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,56 tok/s TG
Prefill 4.021 · TTFT 494 ms
1×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
73gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
47,58 tok/s TG
Prefill 10.520 · TTFT 189 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmBF16
74gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,20 tok/s TG
Prefill 11.058 · TTFT 180 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllm
75gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
46,01 tok/s TG
Prefill 11.757 · TTFT 169 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMvllmBF16
76gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,39 tok/s TG
Prefill 5.134 · TTFT 1.838 ms
5×2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAMllama.cppgodclawQ8_0
77gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,30 tok/s TG
Prefill 1.816 · TTFT 1.088 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
78gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
14,49 tok/s TG
Prefill 1.763 · TTFT 1.123 ms
1×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0
79gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,45 tok/s TG
Prefill 1.249 · TTFT 8.044 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0
80gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,43 tok/s TG
Prefill 1.220 · TTFT 8.133 ms
5×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
81gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,73 tok/s TG
Prefill 1.306 · TTFT 16.890 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ8_0
82gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,84 tok/s TG
Prefill 1.286 · TTFT 17.461 ms
10×2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAMllama.cppopenclaw_cliQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.