Hardware
Hardware overview
All tested graphics cards and CPUs with throughput metrics (tokens/s) from the published performance benchmarks. Click a hardware entry for details.
🎮 Graphics cards
All runs →GPUs (14)
| Graphics card | VRAM | Models | Runs | Ø Generation | Max | Prefill | |
|---|---|---|---|---|---|---|---|
| NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA | 96 GB | 49 | 512 | 555,4 tok/s | 2.143,6 tok/s | 21.843 tok/s | Details → |
| NVIDIA RTX PRO 6000 Blackwell Workstation EditionNVIDIA | 96 GB | 52 | 244 | 518,2 tok/s | 2.414,4 tok/s | 39.029 tok/s | Details → |
| NVIDIA GeForce RTX 5090NVIDIA | 32 GB | 50 | 218 | 429,9 tok/s | 2.491,2 tok/s | 37.116 tok/s | Details → |
| NVIDIA GeForce RTX 3090 TiNVIDIA | 24 GB | 49 | 264 | 256,4 tok/s | 1.492,8 tok/s | 32.005 tok/s | Details → |
| NVIDIA RTX A6000NVIDIA | 48 GB | 43 | 992 | 252,9 tok/s | 1.568,0 tok/s | 55.260 tok/s | Details → |
| NVIDIA GeForce RTX 5070 TiNVIDIA | 16 GB | 50 | 222 | 167,7 tok/s | 1.744,0 tok/s | 31.452 tok/s | Details → |
| NVIDIA GB10 (DGX Spark)NVIDIA | 128 GB | 18 | 82 | 148,9 tok/s | 903,3 tok/s | 7.470 tok/s | Details → |
| Intel Arc Pro B70Intel | 32 GB | 10 | 32 | 141,6 tok/s | 826,2 tok/s | 3.526 tok/s | Details → |
| AMD Radeon PRO W7800 48GBAMD | 48 GB | 24 | 149 | 130,3 tok/s | 702,9 tok/s | 13.392 tok/s | Details → |
| AMD Radeon PRO W7900 Dual SlotAMD | 48 GB | 25 | 241 | 106,5 tok/s | 344,1 tok/s | 8.218 tok/s | Details → |
| AMD Radeon AI PRO R9700AMD | 32 GB | 53 | 855 | 65,8 tok/s | 667,0 tok/s | 35.719 tok/s | Details → |
| AMD Radeon 8060S GraphicsAMD | - | 14 | 47 | 61,0 tok/s | 326,9 tok/s | 3.208 tok/s | Details → |
| NVIDIA Tesla P100 PCIe 16GBNVIDIA | 16 GB | 11 | 28 | 40,0 tok/s | 111,1 tok/s | 1.115 tok/s | Details → |
| NVIDIA GeForce RTX 2060NVIDIA | 6 GB | 23 | 77 | 36,8 tok/s | 133,7 tok/s | 4.122 tok/s | Details → |
📄 Directory
Graphics card directory (83)
All catalogued cards with technical specs – regardless of existing benchmarks.
| ⇆ | Graphics card | Architecture | VRAM | TDP | Tensor | Bandwidth | PCIe | Release | Best tokens | Rating |
|---|---|---|---|---|---|---|---|---|---|---|
| AMD Radeon 8060S GraphicsAMD | RDNA 3.5 | – | 120 W | – | 256 GB/s | PCIe 4.0 | 01/2025 | 326,9 tok/s | – | |
| AMD Radeon AI PRO R9700AMD | RDNA 4 | 32 GB | 300 W | 128 | 640 GB/s | PCIe 5.0 | 07/2025 | 667,0 tok/s | ||
| AMD Radeon PRO V340AMD | Vega (GCN 5) | 32 GB | 300 W | – | 968 GB/s | PCIe 3.0 | 08/2018 | – | – | |
| AMD Radeon PRO V520AMD | RDNA 1 | 8 GB | 225 W | – | 512 GB/s | PCIe 4.0 | 12/2020 | – | – | |
| AMD Radeon PRO V620AMD | RDNA 2 | 32 GB | 300 W | – | 512 GB/s | PCIe 4.0 | 11/2021 | – | – | |
| AMD Radeon PRO V710AMD | RDNA 3 | 28 GB | 158 W | – | 448 GB/s | PCIe 4.0 | 10/2024 | – | – | |
| AMD Radeon PRO W7800 48GBAMD | RDNA 3 | 48 GB | 260 W | 140 | 576 GB/s | PCIe 4.0 | 04/2024 | 702,9 tok/s | – | |
| AMD Radeon PRO W7900AMD | RDNA 3 | 48 GB | 295 W | 192 | 864 GB/s | PCIe 4.0 | 04/2023 | – | – | |
| AMD Radeon PRO W7900 Dual SlotAMD | RDNA 3 | 48 GB | 295 W | 192 | 864 GB/s | PCIe 4.0 | 04/2024 | 344,1 tok/s | – | |
| AMD Radeon RX 7600AMD | RDNA 3 | 8 GB | 165 W | 64 | 288 GB/s | PCIe 4.0 | 05/2023 | – | – | |
| AMD Radeon RX 7600 XTAMD | RDNA 3 | 16 GB | 190 W | 64 | 288 GB/s | PCIe 4.0 | 01/2024 | – | – | |
| AMD Radeon RX 7700 XTAMD | RDNA 3 | 12 GB | 245 W | 108 | 432 GB/s | PCIe 4.0 | 09/2023 | – | – | |
| AMD Radeon RX 7800 XTAMD | RDNA 3 | 16 GB | 263 W | 120 | 624 GB/s | PCIe 4.0 | 09/2023 | – | – | |
| AMD Radeon RX 7900 GREAMD | RDNA 3 | 16 GB | 260 W | 160 | 576 GB/s | PCIe 4.0 | 02/2024 | – | – | |
| AMD Radeon RX 7900 XTAMD | RDNA 3 | 20 GB | 315 W | 168 | 800 GB/s | PCIe 4.0 | 12/2022 | – | – | |
| AMD Radeon RX 7900 XTXAMD | RDNA 3 | 24 GB | 355 W | 192 | 960 GB/s | PCIe 4.0 | 12/2022 | – | – | |
| AMD Radeon RX 9060 XT 16GBAMD | RDNA 4 | 16 GB | 160 W | 64 | 320 GB/s | PCIe 5.0 | 06/2025 | – | – | |
| AMD Radeon RX 9060 XT 8GBAMD | RDNA 4 | 8 GB | 150 W | 64 | 320 GB/s | PCIe 5.0 | 06/2025 | – | – | |
| AMD Radeon RX 9070AMD | RDNA 4 | 16 GB | 220 W | 112 | 640 GB/s | PCIe 5.0 | 03/2025 | – | – | |
| AMD Radeon RX 9070 XTAMD | RDNA 4 | 16 GB | 304 W | 128 | 640 GB/s | PCIe 5.0 | 03/2025 | – | – | |
| Intel Arc A380Intel | Xe-HPG (Alchemist) | 6 GB | 75 W | 128 | 186 GB/s | PCIe 4.0 | 06/2022 | – | – | |
| Intel Arc A580Intel | Xe-HPG (Alchemist) | 8 GB | 175 W | 384 | 512 GB/s | PCIe 4.0 | 10/2023 | – | – | |
| Intel Arc A750Intel | Xe-HPG (Alchemist) | 8 GB | 225 W | 448 | 512 GB/s | PCIe 4.0 | 10/2022 | – | – | |
| Intel Arc A770 16GBIntel | Xe-HPG (Alchemist) | 16 GB | 225 W | 512 | 560 GB/s | PCIe 4.0 | 10/2022 | – | – | |
| Intel Arc A770 8GBIntel | Xe-HPG (Alchemist) | 8 GB | 225 W | 512 | 512 GB/s | PCIe 4.0 | 10/2022 | – | – | |
| Intel Arc B570Intel | Xe2 (Battlemage) | 10 GB | 150 W | 144 | 380 GB/s | PCIe 4.0 | 01/2025 | – | – | |
| Intel Arc B580Intel | Xe2 (Battlemage) | 12 GB | 190 W | 160 | 456 GB/s | PCIe 4.0 | 12/2024 | – | – | |
| Intel Arc Pro A40Intel | Xe-HPG (Alchemist) | 6 GB | 50 W | 128 | 112 GB/s | PCIe 4.0 | 08/2022 | – | – | |
| Intel Arc Pro A50Intel | Xe-HPG (Alchemist) | 6 GB | 75 W | 256 | 112 GB/s | PCIe 4.0 | 01/2023 | – | – | |
| Intel Arc Pro A60Intel | Xe-HPG (Alchemist) | 12 GB | 130 W | 256 | 192 GB/s | PCIe 4.0 | 06/2023 | – | – | |
| Intel Arc Pro B50Intel | Xe2 (Battlemage) | 16 GB | 70 W | 128 | 224 GB/s | PCIe 4.0 | 08/2025 | – | – | |
| Intel Arc Pro B60Intel | Xe2 (Battlemage) | 24 GB | 200 W | 160 | 456 GB/s | PCIe 4.0 | 06/2025 | – | – | |
| Intel Arc Pro B60 Dual 48GBIntel | Xe2 (Battlemage) | 48 GB | 475 W | 320 | 456 GB/s | PCIe 5.0 | 06/2025 | – | – | |
| Intel Arc Pro B70Intel | Xe2 (Battlemage) | 32 GB | 230 W | 256 | 608 GB/s | PCIe 5.0 | 03/2026 | 826,2 tok/s | ||
| Intel Data Center GPU Flex 140Intel | Xe-HPG (Arctic Sound-M) | 12 GB | 75 W | 256 | 336 GB/s | PCIe 4.0 | 08/2022 | – | – | |
| Intel Data Center GPU Flex 170Intel | Xe-HPG (Arctic Sound-M) | 16 GB | 150 W | 512 | 512 GB/s | PCIe 4.0 | 08/2022 | – | – | |
| Intel Data Center GPU Max 1100Intel | Xe-HPC (Ponte Vecchio) | 48 GB | 300 W | 448 | 1.229 GB/s | PCIe 5.0 | 01/2023 | – | – | |
| Intel Data Center GPU Max 1350Intel | Xe-HPC (Ponte Vecchio) | 96 GB | 450 W | 896 | 3.277 GB/s | PCIe 5.0 | 01/2023 | – | – | |
| Intel Data Center GPU Max 1550Intel | Xe-HPC (Ponte Vecchio) | 128 GB | 600 W | 1.024 | 3.277 GB/s | PCIe 5.0 | 01/2023 | – | – | |
| NVIDIA GB10 (DGX Spark)NVIDIA | Grace Blackwell | 128 GB | 140 W | – | 273 GB/s | – | 05/2025 | 903,3 tok/s | – | |
| NVIDIA GeForce RTX 2060NVIDIA | Turing | 6 GB | 160 W | 240 | 336 GB/s | PCIe 3.0 | 01/2019 | 133,7 tok/s | – | |
| NVIDIA GeForce RTX 3090NVIDIA | Ampere | 24 GB | 350 W | 328 | 936 GB/s | PCIe 4.0 | 09/2020 | – | – | |
| NVIDIA GeForce RTX 3090 TiNVIDIA | Ampere | 24 GB | 450 W | 336 | 1.008 GB/s | PCIe 4.0 | 03/2022 | 1.492,8 tok/s | ||
| NVIDIA GeForce RTX 4060NVIDIA | Ada Lovelace | 8 GB | 115 W | 96 | 272 GB/s | PCIe 4.0 | 06/2023 | – | – | |
| NVIDIA GeForce RTX 4060 Ti 16GBNVIDIA | Ada Lovelace | 16 GB | 165 W | 136 | 288 GB/s | PCIe 4.0 | 07/2023 | – | – | |
| NVIDIA GeForce RTX 4060 Ti 8GBNVIDIA | Ada Lovelace | 8 GB | 160 W | 136 | 288 GB/s | PCIe 4.0 | 05/2023 | – | – | |
| NVIDIA GeForce RTX 4070NVIDIA | Ada Lovelace | 12 GB | 200 W | 184 | 504 GB/s | PCIe 4.0 | 04/2023 | – | – | |
| NVIDIA GeForce RTX 4070 SuperNVIDIA | Ada Lovelace | 12 GB | 220 W | 224 | 504 GB/s | PCIe 4.0 | 01/2024 | – | – | |
| NVIDIA GeForce RTX 4070 TiNVIDIA | Ada Lovelace | 12 GB | 285 W | 240 | 504 GB/s | PCIe 4.0 | 01/2023 | – | – | |
| NVIDIA GeForce RTX 4070 Ti SuperNVIDIA | Ada Lovelace | 16 GB | 285 W | 264 | 672 GB/s | PCIe 4.0 | 01/2024 | – | – | |
| NVIDIA GeForce RTX 4080NVIDIA | Ada Lovelace | 16 GB | 320 W | 304 | 717 GB/s | PCIe 4.0 | 11/2022 | – | – | |
| NVIDIA GeForce RTX 4080 SuperNVIDIA | Ada Lovelace | 16 GB | 320 W | 320 | 736 GB/s | PCIe 4.0 | 01/2024 | – | – | |
| NVIDIA GeForce RTX 4090NVIDIA | Ada Lovelace | 24 GB | 450 W | 512 | 1.008 GB/s | PCIe 4.0 | 10/2022 | – | – | |
| NVIDIA GeForce RTX 5060NVIDIA | Blackwell | 8 GB | 145 W | 96 | 448 GB/s | PCIe 5.0 | 05/2025 | – | – | |
| NVIDIA GeForce RTX 5060 Ti 16GBNVIDIA | Blackwell | 16 GB | 180 W | 144 | 448 GB/s | PCIe 5.0 | 04/2025 | – | – | |
| NVIDIA GeForce RTX 5060 Ti 8GBNVIDIA | Blackwell | 8 GB | 180 W | 144 | 448 GB/s | PCIe 5.0 | 04/2025 | – | – | |
| NVIDIA GeForce RTX 5070NVIDIA | Blackwell | 12 GB | 250 W | 192 | 672 GB/s | PCIe 5.0 | 03/2025 | – | ||
| NVIDIA GeForce RTX 5070 TiNVIDIA | Blackwell | 16 GB | 300 W | 280 | 896 GB/s | PCIe 5.0 | 02/2025 | 1.744,0 tok/s | ||
| NVIDIA GeForce RTX 5080NVIDIA | Blackwell | 16 GB | 360 W | 336 | 960 GB/s | PCIe 5.0 | 01/2025 | – | – | |
| NVIDIA GeForce RTX 5090NVIDIA | Blackwell | 32 GB | 575 W | 680 | 1.792 GB/s | PCIe 5.0 | 01/2025 | 2.491,2 tok/s | ||
| NVIDIA RTX 2000 Ada GenerationNVIDIA | Ada Lovelace | 16 GB | 70 W | 88 | 224 GB/s | PCIe 4.0 | 02/2024 | – | – | |
| NVIDIA RTX 4000 Ada GenerationNVIDIA | Ada Lovelace | 20 GB | 130 W | 192 | 360 GB/s | PCIe 4.0 | 08/2023 | – | – | |
| NVIDIA RTX 4000 SFF Ada GenerationNVIDIA | Ada Lovelace | 20 GB | 70 W | 192 | 280 GB/s | PCIe 4.0 | 03/2023 | – | – | |
| NVIDIA RTX 4500 Ada GenerationNVIDIA | Ada Lovelace | 24 GB | 210 W | 240 | 432 GB/s | PCIe 4.0 | 08/2023 | – | – | |
| NVIDIA RTX 5000 Ada GenerationNVIDIA | Ada Lovelace | 32 GB | 250 W | 400 | 576 GB/s | PCIe 4.0 | 08/2023 | – | – | |
| NVIDIA RTX 5880 Ada GenerationNVIDIA | Ada Lovelace | 48 GB | 285 W | 440 | 960 GB/s | PCIe 4.0 | 01/2024 | – | – | |
| NVIDIA RTX 6000 Ada GenerationNVIDIA | Ada Lovelace | 48 GB | 300 W | 568 | 960 GB/s | PCIe 4.0 | 12/2022 | – | – | |
| NVIDIA RTX A6000NVIDIA | Ampere | 48 GB | 300 W | 336 | 768 GB/s | PCIe 4.0 | 10/2020 | 1.568,0 tok/s | – | |
| NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionNVIDIA | Blackwell | 96 GB | 300 W | 752 | 1.792 GB/s | PCIe 5.0 | 03/2025 | 2.143,6 tok/s | ||
| NVIDIA RTX PRO 6000 Blackwell Workstation EditionNVIDIA | Blackwell | 96 GB | 600 W | 752 | 1.792 GB/s | PCIe 5.0 | 03/2025 | 2.414,4 tok/s | ||
| NVIDIA Tesla K40NVIDIA | Kepler | 12 GB | 235 W | – | 288 GB/s | PCIe 3.0 | 10/2013 | – | – | |
| NVIDIA Tesla K80NVIDIA | Kepler | 24 GB | 300 W | – | 480 GB/s | PCIe 3.0 | 11/2014 | – | – | |
| NVIDIA Tesla M40 24GBNVIDIA | Maxwell | 24 GB | 250 W | – | 288 GB/s | PCIe 3.0 | 11/2015 | – | – | |
| NVIDIA Tesla M60NVIDIA | Maxwell | 16 GB | 300 W | – | 320 GB/s | PCIe 3.0 | 08/2015 | – | – | |
| NVIDIA Tesla P100 PCIe 12GBNVIDIA | Pascal | 12 GB | 250 W | – | 549 GB/s | PCIe 3.0 | 06/2016 | – | – | |
| NVIDIA Tesla P100 PCIe 16GBNVIDIA | Pascal | 16 GB | 250 W | – | 732 GB/s | PCIe 3.0 | 06/2016 | 111,1 tok/s | – | |
| NVIDIA Tesla P4NVIDIA | Pascal | 8 GB | 75 W | – | 192 GB/s | PCIe 3.0 | 09/2016 | – | – | |
| NVIDIA Tesla P40NVIDIA | Pascal | 24 GB | 250 W | – | 346 GB/s | PCIe 3.0 | 09/2016 | – | – | |
| NVIDIA Tesla T4NVIDIA | Turing | 16 GB | 70 W | 320 | 320 GB/s | PCIe 3.0 | 09/2018 | – | – | |
| NVIDIA Tesla V100 PCIe 16GBNVIDIA | Volta | 16 GB | 250 W | 640 | 900 GB/s | PCIe 3.0 | 06/2017 | – | – | |
| NVIDIA Tesla V100 PCIe 32GBNVIDIA | Volta | 32 GB | 250 W | 640 | 900 GB/s | PCIe 3.0 | 03/2018 | – | – | |
| NVIDIA Tesla V100S PCIe 32GBNVIDIA | Volta | 32 GB | 250 W | 640 | 1.134 GB/s | PCIe 3.0 | 11/2019 | – | – | |
| Keine GPU (CPU-only)Other | – | – | – | – | – | – | – | 70,9 tok/s | – |