Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Google

gemma-4-31B-it31B

Benchmarkprofil und veröffentlichte Ergebnisse.

Dense31B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation251,1 tok/s
Min 5,0Ø 252,9Max 1.568,0
Unter dem Durchschnitt · 992 Systeme im Feld
Prefill7.025 tok/s
Min 172Ø 8.649Max 55.260
Unter dem Durchschnitt · 992 Systeme im Feld
Time to First Token751 ms
Min 117Ø 4.699Max 124.920
Ueber dem Durchschnitt · 992 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

32224116180,40,001.0322.0653.097Prefill (tok/s)Generation (tok/s)NVIDIA RTX A6000 - 251,1 tok/s Generation, 2.529 tok/s Prefill, TTFT 12.576 ms (30 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 3090 Ti - 174,1 tok/s Generation, 821 tok/s Prefill, TTFT 31.157 ms (7 Laufe)NVIDIA GeForce RTX 30...AMD Radeon PRO W7900 Dual Slot - 101,9 tok/s Generation, 351 tok/s Prefill, TTFT 52.767 ms (6 Laufe)AMD Radeon PRO W7900 ...AMD Radeon AI PRO R9700 - 24,4 tok/s Generation, 219 tok/s Prefill, TTFT 271 ms (8 Laufe)AMD Radeon AI PRO R97...
NVIDIA RTX A6000 251,1 tok/sNVIDIA GeForce RTX 3090 Ti 174,1 tok/sAMD Radeon PRO W7900 Dual Slot 101,9 tok/sAMD Radeon AI PRO R9700 24,4 tok/s

CPUnach Prozessor

32224216180,60,008241.6482.472Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 251,1 tok/s Generation, 2.043 tok/s Prefill, TTFT 9.985 ms (38 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 5 5600X 6-Core Processor - 174,1 tok/s Generation, 901 tok/s Prefill, TTFT 22.889 ms (6 Laufe)AMD Ryzen 5 5600X 6-C...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 101,9 tok/s Generation, 351 tok/s Prefill, TTFT 52.767 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 19,5 tok/s Generation, 339 tok/s Prefill, TTFT 80.766 ms (1 Lauf)AMD Ryzen 9 8945HX wi...
AMD Ryzen Threadripper PRO 7955WX 16-Cores 251,1 tok/sAMD Ryzen 5 5600X 6-Core Processor 174,1 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 101,9 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 19,5 tok/s

ENGnach Engine

32224216180,60,001.2272.4543.682Prefill (tok/s)Generation (tok/s)vLLM - 251,1 tok/s Generation, 3.018 tok/s Prefill, TTFT 5.447 ms (22 Laufe)vLLMunbekannt - 174,1 tok/s Generation, 628 tok/s Prefill, TTFT 13.842 ms (10 Laufe)unbekanntllama.cpp - 129,2 tok/s Generation, 692 tok/s Prefill, TTFT 31.952 ms (18 Laufe)llama.cppllm - 19,5 tok/s Generation, 339 tok/s Prefill, TTFT 80.766 ms (1 Lauf)llm
vLLM 251,1 tok/sunbekannt 174,1 tok/sllama.cpp 129,2 tok/sllm 19,5 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
251,07 tok/s TG
Prefill 7.025 · TTFT 4.495 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
2gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,35 tok/s TG
Prefill 6.513 · TTFT 4.844 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
3gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,03 tok/s TG
Prefill 5.472 · TTFT 5.845 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
4gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
222,83 tok/s TG
Prefill 5.037 · TTFT 6.267 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
5gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
174,07 tok/s TG
Prefill 1.206 · TTFT 16.925 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacpp
6gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
156,49 tok/s TG
Prefill 182 · TTFT 97.092 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllama.cpp q3_k_m, q4-kv
7gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
152,19 tok/s TG
Prefill 5.535 · TTFT 2.477 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
8gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
145,41 tok/s TG
Prefill 5.094 · TTFT 2.683 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
9gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,75 tok/s TG
Prefill 4.220 · TTFT 3.249 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
10gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
140,87 tok/s TG
Prefill 3.732 · TTFT 25.360 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
11gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
138,37 tok/s TG
Prefill 2.284 · TTFT 42.505 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
12gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
137,92 tok/s TG
Prefill 3.964 · TTFT 3.462 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
13gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
129,24 tok/s TG
Prefill 622 · TTFT 48.720 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
14gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
128,36 tok/s TG
Prefill 621 · TTFT 48.995 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
15gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,17 tok/s TG
Prefill 646 · TTFT 44.975 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
16gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,05 tok/s TG
Prefill 641 · TTFT 45.163 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
17gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
101,94 tok/s TG
Prefill 176 · TTFT 112.412 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
18gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,95 tok/s TG
Prefill 166 · TTFT 119.519 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
19gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
81,35 tok/s TG
Prefill 998 · TTFT 9.924 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacpp
20gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,79 tok/s TG
Prefill 1.062 · TTFT 9.322 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllama.cpp q3_k_m, q4-kv
21gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
74,56 tok/s TG
Prefill 3.148 · TTFT 4.375 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
22gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
72,98 tok/s TG
Prefill 351 · TTFT 36.215 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
23gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
70,54 tok/s TG
Prefill 2.088 · TTFT 6.294 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
24gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
69,09 tok/s TG
Prefill 846 · TTFT 16.044 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
25gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,74 tok/s TG
Prefill 843 · TTFT 15.945 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
26gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
54,15 tok/s TG
Prefill 435 · TTFT 38.812 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
27gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
52,97 tok/s TG
Prefill 874 · TTFT 15.734 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
28gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
52,93 tok/s TG
Prefill 870 · TTFT 15.730 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
29gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
36,87 tok/s TG
Prefill 2.641 · TTFT 751 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
30gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
35,35 tok/s TG
Prefill 2.414 · TTFT 821 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8
31gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
34,84 tok/s TG
Prefill 1.988 · TTFT 997 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
32gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
33,60 tok/s TG
Prefill 1.857 · TTFT 1.065 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
33gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,10 tok/s TG
Prefill 1.020 · TTFT 1.964 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllama.cpp q3_k_m, q4-kv
34gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,74 tok/s TG
Prefill 938 · TTFT 2.110 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMllamacpp
35gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,45 tok/s TG
Prefill 1.090 · TTFT 1.818 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
36gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
28,44 tok/s TG
Prefill 1.083 · TTFT 1.829 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
37gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,81 tok/s TG
Prefill 701 · TTFT 2.818 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
38gemma-4-31B-it31BGoogle PerformancebenchmarkPerformancetest Small 1.0
24,36 tok/s TG
Prefill 309 · TTFT 91 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT8
39gemma-4-31B-it31BGoogle Performancebenchmark
24,36 tok/s TG
Prefill 309 · TTFT 91 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawINT8
40gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,50 tok/s TG
Prefill 339 · TTFT 80.766 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllmcodex_cli
41gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,44 tok/s TG
Prefill 276 · TTFT 6.828 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
42gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,78 tok/s TG
Prefill 1.111 · TTFT 1.784 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
43gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
18,77 tok/s TG
Prefill 1.107 · TTFT 1.793 ms
1×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
44gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,73 tok/s TG
Prefill 1.490 · TTFT 1.332 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8
45gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,81 tok/s TG
Prefill 1.027 · TTFT 1.929 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQ
46gemma-4-31B-it31BGoogle PerformancebenchmarkPerformancetest Small 1.0
12,45 tok/s TG
Prefill 208 · TTFT 135 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT8
47gemma-4-31B-it31BGoogle Performancebenchmark
12,45 tok/s TG
Prefill 208 · TTFT 135 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawINT8
48gemma-4-31B-it31BGoogle PerformancebenchmarkTimebench 2 - Token-Generation / Output-Durchsatz
11,19 tok/s TG
Prefill 162 · TTFT 716 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT8
49gemma-4-31B-it31BGoogle Performancebenchmark
11,19 tok/s TG
Prefill 162 · TTFT 716 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawINT8
50gemma-4-31B-it31BGoogle PerformancebenchmarkPerformancetest Small 1.0
10,54 tok/s TG
Prefill 199 · TTFT 141 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawINT8
51gemma-4-31B-it31BGoogle Performancebenchmark
10,54 tok/s TG
Prefill 199 · TTFT 141 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawINT8
Agent- & Chat-Bewertung

Harnessbenchmark

Messwert:
#Modell / HerstellerMesswerteGPU / CPU / RAMRuntime
1gemma-4-31B-it31BGoogle HarnessbenchmarkTool Usage Standard 1.0
298 Pkt
10,0% · 16/16 Aufg. · 9.625,0 s
AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 123 GB RAMopenclaw_cli