Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Google

gemma-4-26B-A4B-it-assistant

Benchmark profile and published results.

MoE26B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation56,4 tok/s
Min 0,0Ø 270,4Max 1.443,9
Unter dem Durchschnitt · 996 Systeme im Feld
Prefill3.250 tok/s
Min 6Ø 5.568Max 39.029
Unter dem Durchschnitt · 995 Systeme im Feld
Time to First Token1.069 ms
Min 91Ø 9.777Max 299.591
Ueber dem Durchschnitt · 997 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

62,059,256,453,550,72.3322.4312.5312.630Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 56,4 tok/s Generation, 2.481 tok/s Prefill, TTFT 3.821 ms (12 Laufe)NVIDIA RTX PRO 6000 B...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 56,4 tok/s

CPUby processor

62,059,256,453,550,72.3322.4312.5312.630Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 9965WX 24-Cores - 56,4 tok/s Generation, 2.481 tok/s Prefill, TTFT 3.821 ms (12 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 9965WX 24-Cores 56,4 tok/s

ENGby engine

62,059,256,453,550,72.3322.4312.5312.630Prefill (tok/s)Generation (tok/s)llama.cpp - 56,4 tok/s Generation, 2.481 tok/s Prefill, TTFT 3.821 ms (12 Laufe)llama.cpp
llama.cpp 56,4 tok/s
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
56,35 tok/s TG
Prefill 3.024 · TTFT 6.689 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
2gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
56,07 tok/s TG
Prefill 3.246 · TTFT 6.318 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
3gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
55,65 tok/s TG
Prefill 3.140 · TTFT 6.494 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
55,52 tok/s TG
Prefill 3.250 · TTFT 6.278 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
46,36 tok/s TG
Prefill 2.850 · TTFT 3.474 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
45,84 tok/s TG
Prefill 2.722 · TTFT 3.650 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
7gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,64 tok/s TG
Prefill 2.647 · TTFT 3.761 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
8gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
27,39 tok/s TG
Prefill 2.522 · TTFT 3.934 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
9gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,34 tok/s TG
Prefill 1.857 · TTFT 1.069 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,34 tok/s TG
Prefill 1.741 · TTFT 1.136 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,33 tok/s TG
Prefill 1.732 · TTFT 1.142 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12gemma-4-26B-A4B-it-assistantGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,15 tok/s TG
Prefill 1.040 · TTFT 1.910 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M