Google

gemma-2-9b-it9B

Name: gemma-2-9b-it
Author: Google

Benchmark profile and published results.

Dense9B

Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation171,6 tok/s

Min 0,1Ø 159,1Max 717,6

Ueber dem Durchschnitt · 361 Systeme im Feld

Prefill1.337 tok/s

Min 39Ø 5.819Max 52.503

Unter dem Durchschnitt · 361 Systeme im Feld

Time to First Token1.405 ms

Min 156Ø 18.353Max 354.928

Ueber dem Durchschnitt · 361 Systeme im Feld

Performance profile

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

AMD Radeon RX 7900 XTX 171,6 tok/s

Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 171,6 tok/s

llama.cpp 171,6 tok/s

Throughput & latency

Metric:

#	Model / Maker	Metrics	Parallel	GPU / CPU / RAM	Runtime
1	gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	171,56 tok/s TG Prefill 378 · TTFT 49.531 ms	10×	2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM	llama.cppgodclawQ4_K_M	Details →
2	gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	111,81 tok/s TG Prefill 1.178 · TTFT 15.636 ms	5×	2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM	llama.cppgodclawQ4_K_M	Details →
3	gemma-2-9b-it9BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	56,49 tok/s TG Prefill 1.337 · TTFT 1.405 ms	1×	2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM	llama.cppgodclawQ4_K_M	Details →

Agent & chat rating

Noch keine Harnessbenchmarks fuer dieses Modell.