Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🎮
Grafikkarte

NVIDIA RTX A6000

NVIDIA48 GB VRAM
1028Benchmarks
45Modelle
1028Performance
0Harness
15 WIdle-Leistung
300 WMax-Leistung
Beste Generation
1.568,0 tok/s
gemma-4-E2B-it
∅ Generation
249,4 tok/s
Schnitt aus 1028 Läufen
Bester Prefill
55.260 tok/s
Prompt-Verarbeitung
Bester TTFT
117 ms
Time to First Token
Beste Harness-Quote
–%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser GPU · 1.568,0 tok/s
Bester Prefill: 55.260 tok/s · 45 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf NVIDIA RTX A6000 – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
1.568,0 tok/s
Nemotron-3-Nano-4B4B
1.485,1 tok/s
Qwen3.8-Flash-Next180B
1.171,8 tok/s
Ornith-1.0-9B9B
1.062,5 tok/s
Meta-Llama-3.1-8B-Instruct8B
1.026,4 tok/s
Qwen3.5-35B-A3B35B
842,1 tok/s
Gemma-4-26B-A4B-it26B
841,8 tok/s
Laguna-XS-2.1
836,4 tok/s
Qwen3.6-35B-A3B35B
800,4 tok/s
Qwen-AgentWorld-35B-A3B35B
799,7 tok/s
Anzeige
Performanceprofil

Durchsatz auf NVIDIA RTX A6000

Jede Blase steht für ein Modell, eine Engine bzw. eine CPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

1.9131.5051.097689281013.89927.79841.697Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.568,0 tok/s Generation, 33.935 tok/s Prefill, TTFT 798 ms (8 Laufe)gemma-4-E2B-itNemotron-3-Nano-4B - 1.485,1 tok/s Generation, 33.698 tok/s Prefill, TTFT 805 ms (3 Laufe)Nemotron-3-Nano-4BQwen3.8-Flash-Next - 1.171,8 tok/s Generation, 2.126 tok/s Prefill, TTFT 33.223 ms (2 Laufe)Qwen3.8-Flash-NextOrnith-1.0-9B - 1.062,5 tok/s Generation, 18.369 tok/s Prefill, TTFT 1.318 ms (5 Laufe)Ornith-1.0-9BMeta-Llama-3.1-8B-Instruct - 1.026,4 tok/s Generation, 24.931 tok/s Prefill, TTFT 1.159 ms (3 Laufe)Meta-Llama-3.1-8B-Ins...Qwen3.5-35B-A3B - 842,1 tok/s Generation, 21.017 tok/s Prefill, TTFT 5.093 ms (6 Laufe)Qwen3.5-35B-A3BGemma-4-26B-A4B-it - 841,8 tok/s Generation, 28.153 tok/s Prefill, TTFT 1.058 ms (4 Laufe)Gemma-4-26B-A4B-itLaguna-XS-2.1 - 836,4 tok/s Generation, 26.282 tok/s Prefill, TTFT 4.694 ms (7 Laufe)Laguna-XS-2.1Qwen3.6-35B-A3B - 800,4 tok/s Generation, 20.714 tok/s Prefill, TTFT 5.924 ms (6 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 799,7 tok/s Generation, 30.088 tok/s Prefill, TTFT 894 ms (2 Laufe)Qwen-AgentWorld-35B-A...Qwen3-Coder-30B-A3B-Instruct - 789,2 tok/s Generation, 28.705 tok/s Prefill, TTFT 2.367 ms (4 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-VL-30B-A3B-Instruct - 763,5 tok/s Generation, 33.064 tok/s Prefill, TTFT 1.075 ms (2 Laufe)Qwen3-VL-30B-A3B-Inst...Qwen3-30B-A3B-Instruct-2507 - 758,7 tok/s Generation, 32.859 tok/s Prefill, TTFT 1.069 ms (2 Laufe)Qwen3-30B-A3B-Instruc...Nemotron-3-Nano-30B-A3B - 756,7 tok/s Generation, 11.340 tok/s Prefill, TTFT 10.216 ms (3 Laufe)Nemotron-3-Nano-30B-A...Qwen3-30B-A3B-Thinking-2507 - 751,7 tok/s Generation, 31.426 tok/s Prefill, TTFT 1.213 ms (2 Laufe)Qwen3-30B-A3B-Thinkin...Ministral-3-14B-Reasoning-2512 - 735,1 tok/s Generation, 15.874 tok/s Prefill, TTFT 2.078 ms (2 Laufe)Ministral-3-14B-Reaso...Nemotron-Cascade-2-30B-A3B - 723,7 tok/s Generation, 11.365 tok/s Prefill, TTFT 10.330 ms (3 Laufe)Nemotron-Cascade-2-30...gpt-oss-20b - 703,8 tok/s Generation, 8.973 tok/s Prefill, TTFT 5.347 ms (4 Laufe)gpt-oss-20bgemma-4-12B-it - 681,8 tok/s Generation, 15.255 tok/s Prefill, TTFT 2.017 ms (2 Laufe)gemma-4-12B-itNorth-Mini-Code-1.0 - 648,5 tok/s Generation, 18.445 tok/s Prefill, TTFT 4.022 ms (4 Laufe)North-Mini-Code-1.0Qwen3-Coder-Next - 629,8 tok/s Generation, 24.446 tok/s Prefill, TTFT 1.439 ms (2 Laufe)Qwen3-Coder-NextOrnith-1.5-35B-A3B - 626,4 tok/s Generation, 16.135 tok/s Prefill, TTFT 4.286 ms (4 Laufe)Ornith-1.5-35B-A3B
gemma-4-E2B-it 1.568,0 tok/sNemotron-3-Nano-4B 1.485,1 tok/sQwen3.8-Flash-Next 1.171,8 tok/sOrnith-1.0-9B 1.062,5 tok/sMeta-Llama-3.1-8B-Instruct 1.026,4 tok/sQwen3.5-35B-A3B 842,1 tok/sGemma-4-26B-A4B-it 841,8 tok/sLaguna-XS-2.1 836,4 tok/sQwen3.6-35B-A3B 800,4 tok/sQwen-AgentWorld-35B-A3B 799,7 tok/sQwen3-Coder-30B-A3B-Instruct 789,2 tok/sQwen3-VL-30B-A3B-Instruct 763,5 tok/sQwen3-30B-A3B-Instruct-2507 758,7 tok/sNemotron-3-Nano-30B-A3B 756,7 tok/sQwen3-30B-A3B-Thinking-2507 751,7 tok/sMinistral-3-14B-Reasoning-2512 735,1 tok/sNemotron-Cascade-2-30B-A3B 723,7 tok/sgpt-oss-20b 703,8 tok/sgemma-4-12B-it 681,8 tok/sNorth-Mini-Code-1.0 648,5 tok/sQwen3-Coder-Next 629,8 tok/sOrnith-1.5-35B-A3B 626,4 tok/s

ENGnach Engine

1.8701.5371.205873540011.80223.60435.406Prefill (tok/s)Generation (tok/s)vLLM - 1.568,0 tok/s Generation, 28.862 tok/s Prefill, TTFT 1.096 ms (57 Laufe)vLLMunbekannt - 1.171,8 tok/s Generation, 2.126 tok/s Prefill, TTFT 33.223 ms (2 Laufe)unbekanntllama.cpp - 842,1 tok/s Generation, 7.820 tok/s Prefill, TTFT 9.756 ms (21 Laufe)llama.cpp
vLLM 1.568,0 tok/sunbekannt 1.171,8 tok/sllama.cpp 842,1 tok/s

CPUnach Prozessor

1.8041.5871.3701.15393609.46018.92128.381Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 1.568,0 tok/s Generation, 23.197 tok/s Prefill, TTFT 3.428 ms (78 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 3945WX 12-Cores - 1.171,8 tok/s Generation, 2.126 tok/s Prefill, TTFT 33.223 ms (2 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 7955WX 16-Cores 1.568,0 tok/sAMD Ryzen Threadripper PRO 3945WX 12-Cores 1.171,8 tok/s
Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf NVIDIA RTX A6000.

Im Leaderboard →
Messwert:
Größe
GPUs
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.567,98 tok/s TG
Prefill 55.260 · TTFT 492 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
2Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.485,14 tok/s TG
Prefill 44.171 · TTFT 717 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
3gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.359,09 tok/s TG
Prefill 47.158 · TTFT 587 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
4Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.171,75 tok/s TG
Prefill 2.132 · TTFT 45.396 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XSDetails →
5gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.122,50 tok/s TG
Prefill 38.712 · TTFT 690 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
6Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.062,52 tok/s TG
Prefill 21.965 · TTFT 1.226 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
7Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.026,44 tok/s TG
Prefill 26.805 · TTFT 1.371 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
8gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
909,00 tok/s TG
Prefill 43.093 · TTFT 288 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
9Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
899,41 tok/s TG
Prefill 30.214 · TTFT 473 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
10Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
881,75 tok/s TG
Prefill 22.565 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
11Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
842,08 tok/s TG
Prefill 6.029 · TTFT 13.332 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
12Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
841,75 tok/s TG
Prefill 32.027 · TTFT 923 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
13Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
838,55 tok/s TG
Prefill 6.016 · TTFT 13.397 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
14Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
836,37 tok/s TG
Prefill 39.157 · TTFT 1.033 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
15Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
832,96 tok/s TG
Prefill 27.508 · TTFT 1.327 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
16Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
810,27 tok/s TG
Prefill 7.685 · TTFT 13.735 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
17Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
806,94 tok/s TG
Prefill 7.252 · TTFT 13.902 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
18gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
803,18 tok/s TG
Prefill 35.757 · TTFT 347 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
19Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
800,39 tok/s TG
Prefill 32.313 · TTFT 827 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
20Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
799,65 tok/s TG
Prefill 31.954 · TTFT 834 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
21Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
791,54 tok/s TG
Prefill 26.710 · TTFT 1.226 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
22Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
789,24 tok/s TG
Prefill 37.676 · TTFT 952 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
23Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
787,25 tok/s TG
Prefill 32.522 · TTFT 826 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
24Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
786,19 tok/s TG
Prefill 19.249 · TTFT 1.376 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
25Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
771,80 tok/s TG
Prefill 34.194 · TTFT 1.184 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
26Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
763,50 tok/s TG
Prefill 35.900 · TTFT 987 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
27Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
758,69 tok/s TG
Prefill 34.913 · TTFT 992 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
28Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
756,69 tok/s TG
Prefill 7.030 · TTFT 14.551 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
29Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
755,10 tok/s TG
Prefill 6.964 · TTFT 14.586 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
30Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
754,69 tok/s TG
Prefill 26.306 · TTFT 1.120 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
31Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
751,67 tok/s TG
Prefill 32.340 · TTFT 1.271 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
32Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
735,14 tok/s TG
Prefill 16.886 · TTFT 1.945 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
33Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
732,27 tok/s TG
Prefill 28.221 · TTFT 955 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
34Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
729,28 tok/s TG
Prefill 27.628 · TTFT 966 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
35Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
723,68 tok/s TG
Prefill 7.027 · TTFT 14.700 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
36Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
723,16 tok/s TG
Prefill 7.058 · TTFT 14.771 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
37Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
720,92 tok/s TG
Prefill 30.926 · TTFT 1.138 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
38Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
718,47 tok/s TG
Prefill 28.493 · TTFT 951 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
39Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
712,04 tok/s TG
Prefill 35.143 · TTFT 1.137 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
40gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
703,79 tok/s TG
Prefill 8.617 · TTFT 5.459 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
41Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
697,04 tok/s TG
Prefill 30.227 · TTFT 1.164 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
42Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
691,32 tok/s TG
Prefill 30.805 · TTFT 1.147 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
43Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
690,88 tok/s TG
Prefill 29.513 · TTFT 1.000 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
44gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
687,53 tok/s TG
Prefill 9.035 · TTFT 5.288 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
45gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
685,28 tok/s TG
Prefill 9.018 · TTFT 5.356 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
46gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
681,82 tok/s TG
Prefill 16.224 · TTFT 1.899 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
47gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
680,00 tok/s TG
Prefill 9.221 · TTFT 5.286 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
48Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
679,07 tok/s TG
Prefill 5.945 · TTFT 15.921 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
49Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
675,29 tok/s TG
Prefill 20.479 · TTFT 781 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
50Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
673,19 tok/s TG
Prefill 30.512 · TTFT 1.156 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
51Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
669,65 tok/s TG
Prefill 6.004 · TTFT 15.775 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
52gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
668,00 tok/s TG
Prefill 11.047 · TTFT 1.802 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
53Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
664,59 tok/s TG
Prefill 27.704 · TTFT 965 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
54Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
658,68 tok/s TG
Prefill 27.910 · TTFT 964 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
55Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,42 tok/s TG
Prefill 30.671 · TTFT 1.283 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
56Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
655,08 tok/s TG
Prefill 14.863 · TTFT 2.211 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
57North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
648,52 tok/s TG
Prefill 29.491 · TTFT 1.310 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
58Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
647,82 tok/s TG
Prefill 16.265 · TTFT 725 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
59gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
631,69 tok/s TG
Prefill 29.259 · TTFT 405 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
60Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
630,94 tok/s TG
Prefill 24.767 · TTFT 1.191 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
61Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
629,83 tok/s TG
Prefill 26.016 · TTFT 1.347 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
62Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
626,41 tok/s TG
Prefill 28.681 · TTFT 928 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
63Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
622,29 tok/s TG
Prefill 24.690 · TTFT 1.093 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
64Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
611,40 tok/s TG
Prefill 11.799 · TTFT 2.083 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
65gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
610,99 tok/s TG
Prefill 14.285 · TTFT 2.134 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
66Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
610,90 tok/s TG
Prefill 25.129 · TTFT 1.087 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
67Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
603,66 tok/s TG
Prefill 5.250 · TTFT 7.504 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
68Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
600,91 tok/s TG
Prefill 5.037 · TTFT 7.660 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
69gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
600,60 tok/s TG
Prefill 11.197 · TTFT 1.774 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
70North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
598,90 tok/s TG
Prefill 30.083 · TTFT 948 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
71Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
593,67 tok/s TG
Prefill 14.572 · TTFT 6.256 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
72Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
592,35 tok/s TG
Prefill 20.010 · TTFT 1.519 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
73North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
592,34 tok/s TG
Prefill 6.822 · TTFT 6.994 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
74North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
589,57 tok/s TG
Prefill 7.384 · TTFT 6.836 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
75Qwen3.8-Flash-Next180BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
589,46 tok/s TG
Prefill 2.120 · TTFT 21.049 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 3945WX 12-CoresstrataIQ2_XSDetails →
76Ornith-1.5-35B-A3B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
588,56 tok/s TG
Prefill 25.569 · TTFT 1.053 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
77Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
588,46 tok/s TG
Prefill 20.028 · TTFT 1.512 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
78Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
587,94 tok/s TG
Prefill 22.877 · TTFT 1.531 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
79Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
582,71 tok/s TG
Prefill 31.647 · TTFT 1.123 ms
10×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawFP8Details →
80Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
580,46 tok/s TG
Prefill 29.873 · TTFT 587 ms
5×2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf NVIDIA RTX A6000.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – NVIDIA RTX A6000

HerstellerNVIDIA
ArchitekturAmpere
VRAM48 GB
Tensor-Recheneinheiten336
Speicherbandbreite768 GB/s
TDP300 W
PCIe4.0
Release10/2020
Beste Generation1.568,0 tok/s
Bester Prefill55.260 tok/s
Modelle45
Messläufe (Performance)1028