Google
gemma-4-12B-it12B
Benchmark profile and published results.
Dense12B
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation1.104,3 tok/s
Min 0,0Ø 247,5Max 2.491,2
Ueber dem Durchschnitt · 3999 Systeme im Feld
Prefill16.822 tok/s
Min 4Ø 4.728Max 55.260
Ueber dem Durchschnitt · 3999 Systeme im Feld
Time to First Token328 ms
Min 20Ø 33.752Max 535.235
Ueber dem Durchschnitt · 3997 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
GPUby graphics card
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.104,3 tok/sNVIDIA GeForce RTX 5090 1.058,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.041,8 tok/sNVIDIA RTX A6000 681,8 tok/sNVIDIA GeForce RTX 5070 Ti 677,5 tok/sNVIDIA GeForce RTX 3090 Ti 654,9 tok/sAMD Radeon PRO W7800 48GB 202,0 tok/sTesla V100-PCIE-32GB 186,2 tok/sNVIDIA GeForce RTX 2060 89,8 tok/sNVIDIA Tesla P100 PCIe 16GB 45,8 tok/s
CPUby processor
AMD Ryzen 9 9950X 16-Core Processor 1.104,3 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 1.058,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 1.041,8 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 681,8 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 677,5 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 654,9 tok/sAMD Ryzen 5 5600X 6-Core Processor 372,4 tok/sAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics 186,2 tok/sIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz 89,8 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 45,8 tok/s
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.104,30 tok/s TG Prefill 5.032 · TTFT 11.207 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 2 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.058,85 tok/s TG Prefill 3.506 · TTFT 13.704 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_XL | Details → | |
| 3 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.041,78 tok/s TG Prefill 6.137 · TTFT 11.038 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 4 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.007,10 tok/s TG Prefill 5.796 · TTFT 11.242 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 5 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 947,51 tok/s TG Prefill 4.705 · TTFT 12.271 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 6 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 681,82 tok/s TG Prefill 16.224 · TTFT 1.899 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 7 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 677,50 tok/s TG Prefill 2.978 · TTFT 18.549 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 8 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 654,86 tok/s TG Prefill 2.799 · TTFT 19.412 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_XL | Details → | |
| 9 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 610,99 tok/s TG Prefill 14.285 · TTFT 2.134 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 10 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 588,32 tok/s TG Prefill 4.584 · TTFT 3.743 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 11 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 581,69 tok/s TG Prefill 3.094 · TTFT 4.745 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_XL | Details → | |
| 12 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 561,51 tok/s TG Prefill 16.822 · TTFT 1.831 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 13 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 559,05 tok/s TG Prefill 5.356 · TTFT 3.602 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 14 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 558,93 tok/s TG Prefill 5.734 · TTFT 3.497 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 15 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 542,70 tok/s TG Prefill 4.275 · TTFT 4.086 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 16 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 513,46 tok/s TG Prefill 15.021 · TTFT 2.056 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 17 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 486,20 tok/s TG Prefill 4.345 · TTFT 5.863 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 18 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 437,98 tok/s TG Prefill 12.559 · TTFT 1.057 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 19 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 398,25 tok/s TG Prefill 11.255 · TTFT 1.183 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 20 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 383,05 tok/s TG Prefill 9.509 · TTFT 3.275 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 21 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 372,40 tok/s TG Prefill 1.508 · TTFT 13.832 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMllamacppAWQ | Details → | |
| 22 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 360,92 tok/s TG Prefill 2.636 · TTFT 6.319 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 23 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 355,09 tok/s TG Prefill 2.494 · TTFT 6.574 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_XL | Details → | |
| 24 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 338,81 tok/s TG Prefill 13.627 · TTFT 983 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 25 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 315,66 tok/s TG Prefill 3.728 · TTFT 2.722 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 26 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 314,80 tok/s TG Prefill 11.946 · TTFT 1.124 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 27 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 303,92 tok/s TG Prefill 2.979 · TTFT 14.486 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,82 tok/s TG Prefill 3.172 · TTFT 13.078 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 29 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,27 tok/s TG Prefill 10.207 · TTFT 3.065 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 30 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,24 tok/s TG Prefill 3.136 · TTFT 13.119 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 31 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 287,31 tok/s TG Prefill 2.955 · TTFT 14.471 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 32 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 242,39 tok/s TG Prefill 7.441 · TTFT 1.813 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 33 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 201,99 tok/s TG Prefill 1.186 · TTFT 16.972 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 34 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 191,85 tok/s TG Prefill 1.344 · TTFT 15.099 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 186,18 tok/s TG Prefill 1.748 · TTFT 10.113 ms | 10× | Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,69 tok/s TG Prefill 2.125 · TTFT 4.654 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMllamacppAWQ | Details → | |
| 37 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 177,72 tok/s TG Prefill 8.073 · TTFT 1.688 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 38 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 170,69 tok/s TG Prefill 2.902 · TTFT 11.434 ms | 10× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 169,36 tok/s TG Prefill 2.126 · TTFT 9.527 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 40 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,81 tok/s TG Prefill 2.576 · TTFT 3.993 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 41 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,04 tok/s TG Prefill 2.822 · TTFT 700 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_XL | Details → | |
| 42 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,28 tok/s TG Prefill 3.109 · TTFT 3.185 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,61 tok/s TG Prefill 3.086 · TTFT 3.207 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 44 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,50 tok/s TG Prefill 4.094 · TTFT 483 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 45 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 144,40 tok/s TG Prefill 3.978 · TTFT 497 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 46 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,90 tok/s TG Prefill 5.078 · TTFT 389 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 47 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 143,72 tok/s TG Prefill 5.291 · TTFT 375 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 48 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 139,86 tok/s TG Prefill 1.753 · TTFT 5.039 ms | 5× | Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 49 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,92 tok/s TG Prefill 3.070 · TTFT 3.252 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 50 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 121,77 tok/s TG Prefill 3.226 · TTFT 3.070 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 51 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 120,20 tok/s TG Prefill 1.360 · TTFT 7.318 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 52 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,76 tok/s TG Prefill 2.532 · TTFT 3.916 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 53 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,51 tok/s TG Prefill 5.707 · TTFT 346 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 54 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 99,19 tok/s TG Prefill 5.094 · TTFT 388 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 55 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 94,86 tok/s TG Prefill 1.586 · TTFT 6.256 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 56 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 93,10 tok/s TG Prefill 2.557 · TTFT 773 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_XL | Details → | |
| 57 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,78 tok/s TG Prefill 2.595 · TTFT 761 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_XL | Details → | |
| 58 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 92,04 tok/s TG Prefill 1.121 · TTFT 21.054 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 59 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 90,43 tok/s TG Prefill 1.328 · TTFT 7.107 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 60 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,80 tok/s TG Prefill 877 · TTFT 23.528 ms | 10× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 61 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 83,56 tok/s TG Prefill 2.303 · TTFT 859 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAM | vLLMllamacppAWQ | Details → | |
| 62 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 80,45 tok/s TG Prefill 6.028 · TTFT 328 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 63 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,54 tok/s TG Prefill 5.274 · TTFT 375 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 64 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,04 tok/s TG Prefill 3.021 · TTFT 659 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | vLLMgodclaw | Details → | |
| 65 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 65,88 tok/s TG Prefill 2.577 · TTFT 768 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 66 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 65,84 tok/s TG Prefill 2.551 · TTFT 776 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 67 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,61 tok/s TG Prefill 2.561 · TTFT 774 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 68 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,61 tok/s TG Prefill 776 · TTFT 12.750 ms | 5× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 69 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,21 tok/s TG Prefill 3.371 · TTFT 586 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 70 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 58,59 tok/s TG Prefill 1.147 · TTFT 1.541 ms | 1× | Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 71 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 49,35 tok/s TG Prefill 778 · TTFT 25.706 ms | 10× | Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 72 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,87 tok/s TG Prefill 1.491 · TTFT 7.113 ms | 5× | Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 73 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,42 tok/s TG Prefill 1.172 · TTFT 1.691 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 74 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 46,18 tok/s TG Prefill 1.183 · TTFT 1.672 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 75 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,75 tok/s TG Prefill 305 · TTFT 32.520 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 76 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 2.629 · TTFT 754 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 77 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,99 tok/s TG Prefill 2.633 · TTFT 753 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 78 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,89 tok/s TG Prefill 1.110 · TTFT 1.590 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 79 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,69 tok/s TG Prefill 3.677 · TTFT 538 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 80 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,86 tok/s TG Prefill 1.094 · TTFT 1.814 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 81 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 40,07 tok/s TG Prefill 2.535 · TTFT 781 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 82 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 36,37 tok/s TG Prefill 928 · TTFT 13.981 ms | 1× | Tesla V100-PCIE-32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 83 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 30,34 tok/s TG Prefill 684 · TTFT 2.896 ms | 1× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 84 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,04 tok/s TG Prefill 333 · TTFT 61.247 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 85 | gemma-4-12B-it12BGoogle Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 22,30 tok/s TG Prefill 298 · TTFT 6.721 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.