Google

gemma-2-9b-it9B

Name: gemma-2-9b-it
Author: Google

Benchmark profile and published results.

Dense9B

Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation171,6 tok/s

Min 0,0Ø 235,6Max 2.491,2

Unter dem Durchschnitt · 4705 Systeme im Feld

Prefill1.337 tok/s

Min 4Ø 4.785Max 112.346

Unter dem Durchschnitt · 4696 Systeme im Feld

Time to First Token1.405 ms

Min 20Ø 32.984Max 535.235

Ueber dem Durchschnitt · 4703 Systeme im Feld

Performance profile

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

AMD Radeon RX 7900 XTX 171,6 tok/s

Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 171,6 tok/s

llama.cpp 171,6 tok/s

Throughput & latency

Metric:

#	Model / Maker	Metrics	Parallel	GPU / CPU / RAM	Runtime
1	gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	171,56 tok/s TG Prefill 378 · TTFT 49.531 ms	10×	2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM	llama.cppgodclawQ4_K_M	Details →
2	gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	111,81 tok/s TG Prefill 1.178 · TTFT 15.636 ms	5×	2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM	llama.cppgodclawQ4_K_M	Details →
3	gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	56,49 tok/s TG Prefill 1.337 · TTFT 1.405 ms	1×	2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM	llama.cppgodclawQ4_K_M	Details →

Agent & chat rating

Noch keine Harnessbenchmarks fuer dieses Modell.