🏆
Ranglisten
LLM Leaderboard
Reale Messergebnisse aller getesteten Sprachmodelle auf echter, benannter Hardware – bewertet nach roher Geschwindigkeit (Performance in Token pro Sekunde, Prefill und Zeit bis zum ersten Token) und nach praktischer Aufgaben-Qualität in vollständigen Agenten- und Chat-Abläufen (Harness). Wähle unten einen Benchmark-Typ oder filtere nach Modell, Hersteller und Hardware, um genau zu sehen, was jeweils geprüft wird und wie die Ergebnisse zustande kommen.
⚡ Performance (tok/s)🤖 Harness-Qualität👥 Concurrency🖥️ echte Hardware
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.593,10 tok/s TG Prefill 16.376 · TTFT 6.849 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliQ4_K_M | Details → | |
| 2 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.532,95 tok/s TG Prefill 17.861 · TTFT 6.225 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.432,98 tok/s TG Prefill 21.012 · TTFT 6.892 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 4 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.383,23 tok/s TG Prefill 17.796 · TTFT 7.072 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.267,62 tok/s TG Prefill 13.497 · TTFT 8.310 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 6 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1.026,44 tok/s TG Prefill 26.805 · TTFT 1.371 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 7 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 913,39 tok/s TG Prefill 8.119 · TTFT 11.247 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 8 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 876,87 tok/s TG Prefill 11.325 · TTFT 2.242 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 9 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 837,85 tok/s TG Prefill 9.559 · TTFT 12.952 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 10 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 832,96 tok/s TG Prefill 27.508 · TTFT 1.327 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 11 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 823,64 tok/s TG Prefill 12.521 · TTFT 2.492 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliQ4_K_M | Details → | |
| 12 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 774,67 tok/s TG Prefill 20.868 · TTFT 2.009 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 13 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 766,19 tok/s TG Prefill 15.268 · TTFT 2.352 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 14 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 717,61 tok/s TG Prefill 52.503 · TTFT 1.022 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 15 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 699,71 tok/s TG Prefill 13.042 · TTFT 2.524 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 16 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 696,81 tok/s TG Prefill 41.362 · TTFT 722 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 675,29 tok/s TG Prefill 20.479 · TTFT 781 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 18 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 609,48 tok/s TG Prefill 31.648 · TTFT 962 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 576,78 tok/s TG Prefill 14.305 · TTFT 2.330 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 20 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 534,82 tok/s TG Prefill 11.826 · TTFT 7.114 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 21 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 518,27 tok/s TG Prefill 13.775 · TTFT 18.702 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 22 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 510,30 tok/s TG Prefill 21.461 · TTFT 752 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 23 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 508,08 tok/s TG Prefill 5.204 · TTFT 21.109 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 24 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 499,39 tok/s TG Prefill 11.446 · TTFT 7.175 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 25 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 489,72 tok/s TG Prefill 21.352 · TTFT 2.183 ms | 10× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 26 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 489,71 tok/s TG Prefill 8.631 · TTFT 3.252 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 27 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 489,43 tok/s TG Prefill 10.618 · TTFT 18.898 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 482,61 tok/s TG Prefill 12.125 · TTFT 5.913 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 29 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 479,20 tok/s TG Prefill 40.760 · TTFT 356 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 30 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 467,83 tok/s TG Prefill 11.804 · TTFT 6.038 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 31 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 465,73 tok/s TG Prefill 23.398 · TTFT 1.915 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 32 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 456,70 tok/s TG Prefill 8.966 · TTFT 3.773 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 33 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 444,58 tok/s TG Prefill 15.076 · TTFT 2.208 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 34 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 443,74 tok/s TG Prefill 31.085 · TTFT 445 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 404,99 tok/s TG Prefill 14.538 · TTFT 2.823 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 36 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 397,16 tok/s TG Prefill 14.911 · TTFT 2.001 ms | 10× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 37 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 387,59 tok/s TG Prefill 10.645 · TTFT 1.347 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 38 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 376,49 tok/s TG Prefill 22.247 · TTFT 615 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 360,12 tok/s TG Prefill 19.755 · TTFT 1.579 ms | 10× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 354,21 tok/s TG Prefill 17.373 · TTFT 1.825 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 41 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 343,70 tok/s TG Prefill 9.999 · TTFT 3.230 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 42 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 323,12 tok/s TG Prefill 5.337 · TTFT 5.911 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 43 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 322,77 tok/s TG Prefill 5.717 · TTFT 5.160 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 44 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 321,67 tok/s TG Prefill 7.148 · TTFT 4.460 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 45 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 318,54 tok/s TG Prefill 19.091 · TTFT 830 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 46 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 300,93 tok/s TG Prefill 6.663 · TTFT 4.522 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 47 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 281,80 tok/s TG Prefill 10.273 · TTFT 5.323 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 48 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 279,01 tok/s TG Prefill 11.575 · TTFT 1.408 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 49 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 276,49 tok/s TG Prefill 9.874 · TTFT 3.124 ms | 10× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 50 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 275,72 tok/s TG Prefill 13.406 · TTFT 4.952 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 51 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 274,94 tok/s TG Prefill 6.188 · TTFT 6.209 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 52 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 274,89 tok/s TG Prefill 8.972 · TTFT 1.446 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 53 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 272,75 tok/s TG Prefill 11.264 · TTFT 1.275 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 54 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 266,70 tok/s TG Prefill 10.161 · TTFT 3.360 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 55 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 262,93 tok/s TG Prefill 8.472 · TTFT 4.535 ms | 10× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 56 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 261,48 tok/s TG Prefill 13.512 · TTFT 1.061 ms | 5× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 57 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 258,77 tok/s TG Prefill 9.631 · TTFT 3.487 ms | 10× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 58 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 254,69 tok/s TG Prefill 14.644 · TTFT 1.771 ms | 5× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 59 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 253,38 tok/s TG Prefill 9.752 · TTFT 1.444 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 60 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 246,17 tok/s TG Prefill 6.676 · TTFT 369 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliQ4_K_M | Details → | |
| 61 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 241,23 tok/s TG Prefill 15.447 · TTFT 931 ms | 5× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 62 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 239,32 tok/s TG Prefill 11.230 · TTFT 219 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 63 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 237,04 tok/s TG Prefill 7.169 · TTFT 1.831 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 64 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 230,12 tok/s TG Prefill 5.654 · TTFT 2.560 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 65 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 226,59 tok/s TG Prefill 9.526 · TTFT 3.488 ms | 10× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 66 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 225,01 tok/s TG Prefill 9.669 · TTFT 257 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 67 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 222,93 tok/s TG Prefill 8.663 · TTFT 286 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 68 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 218,94 tok/s TG Prefill 5.830 · TTFT 2.480 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 69 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 215,97 tok/s TG Prefill 9.775 · TTFT 3.283 ms | 10× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 70 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 212,79 tok/s TG Prefill 8.116 · TTFT 304 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 71 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 209,03 tok/s TG Prefill 11.184 · TTFT 257 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 72 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 208,70 tok/s TG Prefill 9.730 · TTFT 1.396 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 73 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 207,12 tok/s TG Prefill 7.688 · TTFT 400 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 74 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 199,09 tok/s TG Prefill 2.520 · TTFT 2.032 ms | 10× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCmQ4_K_M | Details → | |
| 75 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 197,82 tok/s TG Prefill 3.730 · TTFT 3.658 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 76 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 197,34 tok/s TG Prefill 6.940 · TTFT 1.849 ms | 5× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 77 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 196,57 tok/s TG Prefill 12.975 · TTFT 1.133 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 78 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 189,29 tok/s TG Prefill 10.070 · TTFT 1.358 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 79 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 182,69 tok/s TG Prefill 1.099 · TTFT 18.308 ms | 10× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 80 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 181,22 tok/s TG Prefill 9.264 · TTFT 266 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawAWQ | Details → | |
| 81 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 173,08 tok/s TG Prefill 7.158 · TTFT 2.024 ms | 5× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 82 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 171,83 tok/s TG Prefill 1.188 · TTFT 16.950 ms | 10× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 83 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 168,96 tok/s TG Prefill 3.010 · TTFT 18.082 ms | 10× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | vLLMgodclawAWQ | Details → | |
| 84 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,55 tok/s TG Prefill 3.112 · TTFT 1.645 ms | 10× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCmQ8_0 | Details → | |
| 85 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,48 tok/s TG Prefill 4.475 · TTFT 2.882 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 86 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,90 tok/s TG Prefill 7.616 · TTFT 1.908 ms | 5× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 87 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 156,61 tok/s TG Prefill 3.757 · TTFT 4.751 ms | 10× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 88 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 155,73 tok/s TG Prefill 4.994 · TTFT 7.150 ms | 10× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 89 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 152,06 tok/s TG Prefill 7.328 · TTFT 1.967 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 90 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 151,97 tok/s TG Prefill 7.125 · TTFT 2.029 ms | 5× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 91 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 148,21 tok/s TG Prefill 5.615 · TTFT 439 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 92 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,19 tok/s TG Prefill 6.653 · TTFT 2.534 ms | 5× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 93 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 140,90 tok/s TG Prefill 2.783 · TTFT 1.005 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 94 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 138,90 tok/s TG Prefill 3.102 · TTFT 4.748 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 95 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 130,88 tok/s TG Prefill 4.122 · TTFT 7.946 ms | 10× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 96 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 127,43 tok/s TG Prefill 9.480 · TTFT 260 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 97 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,88 tok/s TG Prefill 2.387 · TTFT 7.059 ms | 5× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | vLLMgodclawAWQ | Details → | |
| 98 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,55 tok/s TG Prefill 5.151 · TTFT 2.489 ms | 5× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 99 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,07 tok/s TG Prefill 3.576 · TTFT 3.191 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 100 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,23 tok/s TG Prefill 4.923 · TTFT 502 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 101 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 116,02 tok/s TG Prefill 4.973 · TTFT 496 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 102 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,96 tok/s TG Prefill 5.072 · TTFT 529 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 103 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 108,60 tok/s TG Prefill 3.037 · TTFT 811 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 104 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 107,15 tok/s TG Prefill 6.505 · TTFT 397 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 105 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,38 tok/s TG Prefill 7.256 · TTFT 344 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 106 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,47 tok/s TG Prefill 4.866 · TTFT 508 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 107 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 102,39 tok/s TG Prefill 5.871 · TTFT 419 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 108 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,62 tok/s TG Prefill 3.646 · TTFT 677 ms | 1× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 109 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 98,26 tok/s TG Prefill 15.904 · TTFT 156 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 110 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 90,37 tok/s TG Prefill 3.202 · TTFT 4.555 ms | 5× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 111 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 90,08 tok/s TG Prefill 978 · TTFT 10.061 ms | 5× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 112 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 89,46 tok/s TG Prefill 3.210 · TTFT 4.511 ms | 5× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 113 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 87,92 tok/s TG Prefill 4.116 · TTFT 600 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 114 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 87,03 tok/s TG Prefill 3.930 · TTFT 629 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 115 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,98 tok/s TG Prefill 6.398 · TTFT 386 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 116 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 85,68 tok/s TG Prefill 3.508 · TTFT 4.145 ms | 5× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 117 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 84,89 tok/s TG Prefill 8.039 · TTFT 307 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 118 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 84,05 tok/s TG Prefill 2.716 · TTFT 943 ms | 5× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCmQ8_0 | Details → | |
| 119 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 83,10 tok/s TG Prefill 6.957 · TTFT 7.450 ms | 10× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 120 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,79 tok/s TG Prefill 2.200 · TTFT 1.164 ms | 5× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCmQ4_K_M | Details → | |
| 121 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 82,52 tok/s TG Prefill 2.347 · TTFT 1.048 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 122 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,91 tok/s TG Prefill 2.340 · TTFT 1.052 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 123 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 80,98 tok/s TG Prefill 3.303 · TTFT 746 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 124 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 78,20 tok/s TG Prefill 3.205 · TTFT 784 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 125 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,28 tok/s TG Prefill 2.774 · TTFT 8.886 ms | 10× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawBF16 | Details → | |
| 126 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,09 tok/s TG Prefill 4.946 · TTFT 499 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 127 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 75,09 tok/s TG Prefill 5.190 · TTFT 476 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 128 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,58 tok/s TG Prefill 1.050 · TTFT 9.383 ms | 5× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 129 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 72,25 tok/s TG Prefill 1.990 · TTFT 1.240 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 130 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,69 tok/s TG Prefill 3.840 · TTFT 645 ms | 1× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 131 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,93 tok/s TG Prefill 2.843 · TTFT 920 ms | 1× | NVIDIA Tesla V100 PCIe 32GBAMD Ryzen 3 PRO 3200GE w/ Radeon Vega Graphics · 61 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 132 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,35 tok/s TG Prefill 8.149 · TTFT 302 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 133 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 69,31 tok/s TG Prefill 1.997 · TTFT 1.235 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | llama.cppgodclawQ8_0 | Details → | |
| 134 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 67,58 tok/s TG Prefill 888 · TTFT 15.224 ms | 5× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 135 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,99 tok/s TG Prefill 5.119 · TTFT 482 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 136 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,46 tok/s TG Prefill 6.040 · TTFT 408 ms | 1× | NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMopenclaw_cliFP8 | Details → | |
| 137 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 66,43 tok/s TG Prefill 898 · TTFT 2.781 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 138 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 61,51 tok/s TG Prefill 1.097 · TTFT 2.256 ms | 1× | 2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | vLLMgodclawAWQ | Details → | |
| 139 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 60,55 tok/s TG Prefill 5.171 · TTFT 476 ms | 1× | 2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | vLLMgodclaw | Details → | |
| 140 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 55,43 tok/s TG Prefill 4.133 · TTFT 598 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 141 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 53,50 tok/s TG Prefill 7.717 · TTFT 319 ms | 1× | NVIDIA GeForce RTX 4090AMD Ryzen 3 3100 4-Core Processor · 61 GB RAM | vLLMopenclaw_cliAWQ | Details → | |
| 142 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 48,95 tok/s TG Prefill 1.278 · TTFT 1.932 ms | 1× | 2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 143 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,41 tok/s TG Prefill 1.800 · TTFT 1.368 ms | 1× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 144 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 45,73 tok/s TG Prefill 1.206 · TTFT 2.050 ms | 1× | 2x NVIDIA GeForce RTX 2060 iIntel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 145 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 43,17 tok/s TG Prefill 281 · TTFT 8.805 ms | 1× | AMD Liverpool (PlayStation 4)AMD Jaguar 8-Core (PlayStation 4) · 5 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 146 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,11 tok/s TG Prefill 821 · TTFT 2.298 ms | 1× | Intel Arc Pro B70 iAMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAM | openclaw_cli | Details → | |
| 147 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 41,70 tok/s TG Prefill 2.092 · TTFT 5.044 ms | 5× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawBF16 | Details → | |
| 148 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,33 tok/s TG Prefill 927 · TTFT 2.113 ms | 1× | AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 149 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 37,29 tok/s TG Prefill 1.115 · TTFT 27.826 ms | 10× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 150 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 35,46 tok/s TG Prefill 589 · TTFT 4.189 ms | 1× | NVIDIA Tesla P100 PCIe 16GBAMD Ryzen 9 7945HX with Radeon Graphics · 60 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 151 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,53 tok/s TG Prefill 2.874 · TTFT 857 ms | 1× | 2x AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 152 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,83 tok/s TG Prefill 1.653 · TTFT 1.506 ms | 1× | 2x NVIDIA GeForce RTX 2060Intel(R) Core(TM) i5-7400 CPU @ 3.00GHz · 7 GB RAM | llama.cppopenclaw_cliQ8_0 | Details → | |
| 153 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,00 tok/s TG Prefill 1.219 · TTFT 420 ms | 1× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCmQ4_K_M | Details → | |
| 154 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 27,32 tok/s TG Prefill 999 · TTFT 1.966 ms | 1× | AMD Radeon AI PRO R9700AMD Ryzen 3 3100 4-Core Processor · 31 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 155 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,56 tok/s TG Prefill 2.006 · TTFT 1.227 ms | 1× | AMD Radeon PRO W7800 48GBAMD Ryzen Threadripper PRO 5975WX 32-Cores · 62 GB RAM | vLLMgodclawAWQ | Details → | |
| 156 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 17,92 tok/s TG Prefill 1.520 · TTFT 337 ms | 1× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppopenclaw_cli batched-bench ROCmQ8_0 | Details → | |
| 157 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,17 tok/s TG Prefill 122 · TTFT 228.054 ms | 10× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 158 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,93 tok/s TG Prefill 95 · TTFT 136.105 ms | 5× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 159 | Muse-Glimmer-30B30BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 8,16 tok/s TG Prefill 1.213 · TTFT 1.622 ms | 1× | 4x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawBF16 | Details → | |
| 160 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 7,33 tok/s TG Prefill 65 · TTFT 38.290 ms | 1× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 161 | Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,91 tok/s TG Prefill 193 · TTFT 12.786 ms | 1× | Keine GPU (CPU-only)AMD Jaguar 8-Core (PlayStation 4) · 5 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 162 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,55 tok/s TG Prefill 36 · TTFT 59.044 ms | 1× | Keine GPU (CPU-only)4x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 163 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,46 tok/s TG Prefill 35 · TTFT 360.878 ms | 5× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 164 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1,99 tok/s TG Prefill 22 · TTFT 104.643 ms | 1× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 165 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 1,19 tok/s TG Prefill 9 · TTFT 227.569 ms | 1× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 166 | Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 0,09 tok/s TG Prefill 31 · TTFT 347.304 ms | 10× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 167 | Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 0,02 tok/s TG Prefill 7 · TTFT 453.619 ms | 5× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |