Google
gemma-4-12B-it12B
Benchmark profile and published results.
Dense12B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation1.104,3 tok/s
Min 0,0Ø 235,6Max 2.491,2
Ueber dem Durchschnitt · 4705 Systeme im Feld
Prefill16.822 tok/s
Min 4Ø 4.785Max 112.346
Ueber dem Durchschnitt · 4696 Systeme im Feld
Time to First Token251 ms
Min 20Ø 32.984Max 535.235
Ueber dem Durchschnitt · 4703 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
GPUby graphics card
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.104,3 tok/sNVIDIA GeForce RTX 5090 1.058,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.041,8 tok/sNVIDIA RTX A6000 681,8 tok/sNVIDIA GeForce RTX 5070 Ti 677,5 tok/sNVIDIA GeForce RTX 3090 Ti 654,9 tok/sAMD Radeon RX 7900 XTX 212,9 tok/sAMD Radeon PRO W7800 48GB 202,0 tok/sAMD Radeon AI PRO R9700 188,8 tok/sNVIDIA Tesla V100 PCIe 32GB 186,2 tok/sNVIDIA GeForce RTX 2060 89,8 tok/sNVIDIA Tesla P100 PCIe 16GB 45,8 tok/s
CPUby processor
AMD Ryzen 9 9950X 16-Core Processor 1.104,3 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 1.058,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 1.041,8 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 861,4 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 681,8 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 677,5 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 654,9 tok/sAMD Ryzen 5 5600X 6-Core Processor 372,4 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 212,9 tok/sAMD Ryzen 3 3100 4-Core Processor 188,8 tok/sAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics 186,2 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 179,4 tok/sIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz 89,8 tok/s
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.104,30 tok/s TG Prefill 5.032 · TTFT 11.207 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 2 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.058,85 tok/s TG Prefill 3.506 · TTFT 13.704 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_XL | Details → | |
| 3 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.041,78 tok/s TG Prefill 6.137 · TTFT 11.038 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 4 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.007,10 tok/s TG Prefill 5.796 · TTFT 11.242 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 5 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 947,51 tok/s TG Prefill 4.705 · TTFT 12.271 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 6 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 861,40 tok/s TG Prefill 15.615 · TTFT 1.677 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 7 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 681,82 tok/s TG Prefill 16.224 · TTFT 1.899 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 8 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 677,50 tok/s TG Prefill 2.978 · TTFT 18.549 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 9 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 654,86 tok/s TG Prefill 2.799 · TTFT 19.412 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_XL | Details → | |
| 10 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 610,99 tok/s TG Prefill 14.285 · TTFT 2.134 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 11 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 588,32 tok/s TG Prefill 4.584 · TTFT 3.743 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 12 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 581,69 tok/s TG Prefill 3.094 · TTFT 4.745 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_XL | Details → | |
| 13 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 561,51 tok/s TG Prefill 16.822 · TTFT 1.831 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 14 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 559,05 tok/s TG Prefill 5.356 · TTFT 3.602 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 15 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 558,93 tok/s TG Prefill 5.734 · TTFT 3.497 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 16 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 543,78 tok/s TG Prefill 12.359 · TTFT 959 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 17 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 542,70 tok/s TG Prefill 4.275 · TTFT 4.086 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 18 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 513,46 tok/s TG Prefill 15.021 · TTFT 2.056 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 19 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 486,20 tok/s TG Prefill 4.345 · TTFT 5.863 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 20 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 437,98 tok/s TG Prefill 12.559 · TTFT 1.057 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 21 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 398,25 tok/s TG Prefill 11.255 · TTFT 1.183 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 22 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 383,05 tok/s TG Prefill 9.509 · TTFT 3.275 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 23 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 372,40 tok/s TG Prefill 1.508 · TTFT 13.832 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 24 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 360,92 tok/s TG Prefill 2.636 · TTFT 6.319 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 25 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 355,09 tok/s TG Prefill 2.494 · TTFT 6.574 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_XL | Details → | |
| 26 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 338,81 tok/s TG Prefill 13.627 · TTFT 983 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 27 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 315,66 tok/s TG Prefill 3.728 · TTFT 2.722 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 28 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 314,80 tok/s TG Prefill 11.946 · TTFT 1.124 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 29 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 303,92 tok/s TG Prefill 2.979 · TTFT 14.486 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 30 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,82 tok/s TG Prefill 3.172 · TTFT 13.078 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 31 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,27 tok/s TG Prefill 10.207 · TTFT 3.065 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 32 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,24 tok/s TG Prefill 3.136 · TTFT 13.119 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 33 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 287,31 tok/s TG Prefill 2.955 · TTFT 14.471 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 34 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 242,39 tok/s TG Prefill 7.441 · TTFT 1.813 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 35 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 212,89 tok/s TG Prefill 638 · TTFT 31.124 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 209,09 tok/s TG Prefill 646 · TTFT 30.756 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 37 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 201,99 tok/s TG Prefill 1.186 · TTFT 16.972 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 38 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 191,85 tok/s TG Prefill 1.344 · TTFT 15.099 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 188,76 tok/s TG Prefill 629 · TTFT 31.617 ms | 10× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 40 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 186,18 tok/s TG Prefill 1.748 · TTFT 10.113 ms | 10× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 41 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,69 tok/s TG Prefill 2.125 · TTFT 4.654 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 42 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 179,37 tok/s TG Prefill 755 · TTFT 26.574 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 177,72 tok/s TG Prefill 8.073 · TTFT 1.688 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 44 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 170,69 tok/s TG Prefill 2.902 · TTFT 11.434 ms | 10× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 45 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 169,36 tok/s TG Prefill 2.126 · TTFT 9.527 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 46 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,81 tok/s TG Prefill 2.576 · TTFT 3.993 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 47 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,04 tok/s TG Prefill 2.822 · TTFT 700 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_XL | Details → | |
| 48 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,28 tok/s TG Prefill 3.109 · TTFT 3.185 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 49 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,61 tok/s TG Prefill 3.086 · TTFT 3.207 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 50 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,50 tok/s TG Prefill 4.094 · TTFT 483 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 51 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 144,40 tok/s TG Prefill 3.978 · TTFT 497 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 52 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,90 tok/s TG Prefill 5.078 · TTFT 389 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 53 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,72 tok/s TG Prefill 5.291 · TTFT 375 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 54 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 140,99 tok/s TG Prefill 1.453 · TTFT 6.814 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 55 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,86 tok/s TG Prefill 1.753 · TTFT 5.039 ms | 5× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 56 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,10 tok/s TG Prefill 1.505 · TTFT 6.576 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 57 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 126,12 tok/s TG Prefill 7.867 · TTFT 251 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | vLLMgodclawAWQ | Details → | |
| 58 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,92 tok/s TG Prefill 3.070 · TTFT 3.252 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 59 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,77 tok/s TG Prefill 3.226 · TTFT 3.070 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 60 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 120,20 tok/s TG Prefill 1.360 · TTFT 7.318 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 61 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,76 tok/s TG Prefill 2.532 · TTFT 3.916 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 62 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 112,91 tok/s TG Prefill 1.213 · TTFT 8.186 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 63 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 112,83 tok/s TG Prefill 1.430 · TTFT 6.923 ms | 5× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 64 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,51 tok/s TG Prefill 5.707 · TTFT 346 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 65 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,19 tok/s TG Prefill 5.094 · TTFT 388 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 66 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,86 tok/s TG Prefill 1.586 · TTFT 6.256 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 67 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 93,10 tok/s TG Prefill 2.557 · TTFT 773 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_XL | Details → | |
| 68 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,78 tok/s TG Prefill 2.595 · TTFT 761 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 69 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,04 tok/s TG Prefill 1.121 · TTFT 21.054 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 70 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 90,43 tok/s TG Prefill 1.328 · TTFT 7.107 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 71 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,80 tok/s TG Prefill 877 · TTFT 23.528 ms | 10× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 72 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 83,56 tok/s TG Prefill 2.303 · TTFT 859 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 73 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 80,45 tok/s TG Prefill 6.028 · TTFT 328 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 74 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,54 tok/s TG Prefill 5.274 · TTFT 375 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 75 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,04 tok/s TG Prefill 3.021 · TTFT 659 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 76 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 65,88 tok/s TG Prefill 2.577 · TTFT 768 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 77 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 65,84 tok/s TG Prefill 2.551 · TTFT 776 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 78 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,61 tok/s TG Prefill 2.561 · TTFT 774 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 79 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,61 tok/s TG Prefill 776 · TTFT 12.750 ms | 5× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 80 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,38 tok/s TG Prefill 1.447 · TTFT 1.381 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 81 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,21 tok/s TG Prefill 3.371 · TTFT 586 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 82 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 58,59 tok/s TG Prefill 1.147 · TTFT 1.541 ms | 1× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 83 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 51,06 tok/s TG Prefill 1.138 · TTFT 1.779 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 84 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 50,69 tok/s TG Prefill 1.580 · TTFT 1.250 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 85 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,35 tok/s TG Prefill 778 · TTFT 25.706 ms | 10× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 86 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,87 tok/s TG Prefill 1.491 · TTFT 7.113 ms | 5× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 87 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,42 tok/s TG Prefill 1.172 · TTFT 1.691 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 88 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,18 tok/s TG Prefill 1.183 · TTFT 1.672 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 89 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,04 tok/s TG Prefill 1.508 · TTFT 1.312 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 90 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,75 tok/s TG Prefill 305 · TTFT 32.520 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 91 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 2.629 · TTFT 754 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 92 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 2.633 · TTFT 753 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 93 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,89 tok/s TG Prefill 1.110 · TTFT 1.590 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 94 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,69 tok/s TG Prefill 3.677 · TTFT 538 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 95 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,86 tok/s TG Prefill 1.094 · TTFT 1.814 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 96 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,07 tok/s TG Prefill 2.535 · TTFT 781 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 97 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,37 tok/s TG Prefill 928 · TTFT 13.981 ms | 1× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 98 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,34 tok/s TG Prefill 684 · TTFT 2.896 ms | 1× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 99 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,04 tok/s TG Prefill 333 · TTFT 61.247 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 100 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,30 tok/s TG Prefill 298 · TTFT 6.721 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.