Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Anmelden Registrieren
Beta
🧮
Mainboard

Dell Inc. PowerEdge R820

Dell2 CPUs252 Benchmarks⚡ 10 W Idle
CPUs
2
Modelle
65
Benchmarks
252
Beste Generation
609,5 tok/s
🏆
Llama-3.2-1B-Instruct läuft am schnellsten auf diesem Board · 609,5 tok/s
65 Modelle mit Performance-Daten getestet

Top-Modelle nach Token-Generierung

Bester gemessener Generierungs-Durchsatz je Modell auf Dell Inc. PowerEdge R820 (tok/s) – klicken für Leaderboard-Filter.

Llama-3.2-1B-Instruct1B
609,5 tok/s
Qwen3-0.6B0.6B
480,5 tok/s
Qwen3-1.7B1.7B
437,4 tok/s
Llama-3.2-3B-Instruct3B
354,2 tok/s
Qwen2.5-3B-Instruct3B
333,2 tok/s
gemma-2-2b-it2B
323,8 tok/s
Qwen3-4B4B
294,3 tok/s
Phi-3.5-mini-instruct3.8B
272,9 tok/s
Meta-Llama-3.1-8B-Instruct8B
266,7 tok/s
Qwen2.5-Coder-7B-Instruct
256,7 tok/s
Qwen3-8B8.2B
252,8 tok/s
gpt-oss-20b20B
247,3 tok/s
Anzeige
Modell-Vergleich

Getestete Modelle im Vergleich

Jede Blase ist ein Modell auf Dell Inc. PowerEdge R820 – Position: Prompt-Verarbeitung (X) × Ausgabe-Geschwindigkeit (Y), Blasengröße: Anzahl Messläufe. Naeher an der oberen rechten Ecke = schneller.

MODnach Modell

7925943961980,008.48416.96825.452Prefill (tok/s)Generation (tok/s)Llama-3.2-1B-Instruct - 609,5 tok/s Generation, 20.528 tok/s Prefill, TTFT 659 ms (3 Laufe)Llama-3.2-1B-InstructQwen3-0.6B - 480,5 tok/s Generation, 14.980 tok/s Prefill, TTFT 819 ms (3 Laufe)Qwen3-0.6BQwen3-1.7B - 437,4 tok/s Generation, 11.792 tok/s Prefill, TTFT 1.033 ms (3 Laufe)Qwen3-1.7BLlama-3.2-3B-Instruct - 354,2 tok/s Generation, 8.553 tok/s Prefill, TTFT 1.723 ms (9 Laufe)Llama-3.2-3B-InstructQwen2.5-3B-Instruct - 333,2 tok/s Generation, 8.401 tok/s Prefill, TTFT 1.712 ms (9 Laufe)Qwen2.5-3B-Instructgemma-2-2b-it - 323,8 tok/s Generation, 4.880 tok/s Prefill, TTFT 1.976 ms (3 Laufe)gemma-2-2b-itQwen3-4B - 294,3 tok/s Generation, 6.880 tok/s Prefill, TTFT 1.765 ms (3 Laufe)Qwen3-4BPhi-3.5-mini-instruct - 272,9 tok/s Generation, 3.348 tok/s Prefill, TTFT 16.986 ms (3 Laufe)Phi-3.5-mini-instructMeta-Llama-3.1-8B-Instruct - 266,7 tok/s Generation, 3.889 tok/s Prefill, TTFT 13.221 ms (7 Laufe)Meta-Llama-3.1-8B-Ins...Qwen2.5-Coder-7B-Instruct - 256,7 tok/s Generation, 6.945 tok/s Prefill, TTFT 1.988 ms (3 Laufe)Qwen2.5-Coder-7B-Inst...Qwen3-8B - 252,8 tok/s Generation, 4.717 tok/s Prefill, TTFT 2.583 ms (3 Laufe)Qwen3-8Bgpt-oss-20b - 247,3 tok/s Generation, 2.229 tok/s Prefill, TTFT 62.264 ms (6 Laufe)gpt-oss-20bNemotron-3-Nano-30B-A3B - 244,9 tok/s Generation, 980 tok/s Prefill, TTFT 139.704 ms (9 Laufe)Nemotron-3-Nano-30B-A...Qwen3-Coder-30B-A3B-Instruct - 234,1 tok/s Generation, 2.611 tok/s Prefill, TTFT 55.051 ms (6 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-30B-A3B - 227,0 tok/s Generation, 3.706 tok/s Prefill, TTFT 3.355 ms (3 Laufe)Qwen3-30B-A3BQwen3-30B-A3B-Thinking-2507 - 223,3 tok/s Generation, 2.303 tok/s Prefill, TTFT 68.519 ms (6 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-VL-30B-A3B-Instruct - 221,6 tok/s Generation, 4.500 tok/s Prefill, TTFT 2.992 ms (3 Laufe)Qwen3-VL-30B-A3B-Inst...gemma-3n-E4B-it - 220,8 tok/s Generation, 2.894 tok/s Prefill, TTFT 3.558 ms (3 Laufe)gemma-3n-E4B-itQwen3-30B-A3B-Instruct-2507 - 218,5 tok/s Generation, 1.992 tok/s Prefill, TTFT 56.518 ms (6 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-Omni-30B-A3B-Thinking - 218,1 tok/s Generation, 3.565 tok/s Prefill, TTFT 3.465 ms (3 Laufe)Qwen3-Omni-30B-A3B-Th...Laguna-XS-2.1 - 212,4 tok/s Generation, 3.322 tok/s Prefill, TTFT 4.445 ms (3 Laufe)Laguna-XS-2.1North-Mini-Code-1.0 - 208,8 tok/s Generation, 1.385 tok/s Prefill, TTFT 58.810 ms (6 Laufe)North-Mini-Code-1.0Ornith-1.0-9B - 207,5 tok/s Generation, 3.166 tok/s Prefill, TTFT 3.227 ms (3 Laufe)Ornith-1.0-9BMinistral-3-14B-Reasoning-2512 - 204,9 tok/s Generation, 4.083 tok/s Prefill, TTFT 3.010 ms (3 Laufe)Ministral-3-14B-Reaso...Qwen3-Coder-Next - 197,7 tok/s Generation, 2.483 tok/s Prefill, TTFT 5.437 ms (3 Laufe)Qwen3-Coder-NextQwen3-14B - 186,9 tok/s Generation, 3.038 tok/s Prefill, TTFT 4.101 ms (3 Laufe)Qwen3-14BGemma-4-26B-A4B-it - 185,7 tok/s Generation, 1.898 tok/s Prefill, TTFT 5.506 ms (3 Laufe)Gemma-4-26B-A4B-itQwen3.5-35B-A3B - 184,4 tok/s Generation, 2.897 tok/s Prefill, TTFT 3.598 ms (3 Laufe)Qwen3.5-35B-A3BQwen3.6-35B-A3B - 181,7 tok/s Generation, 1.408 tok/s Prefill, TTFT 83.377 ms (7 Laufe)Qwen3.6-35B-A3Bgemma-4-12B-it - 179,4 tok/s Generation, 1.035 tok/s Prefill, TTFT 12.180 ms (3 Laufe)gemma-4-12B-itQwen-AgentWorld-35B-A3B - 177,0 tok/s Generation, 3.087 tok/s Prefill, TTFT 3.336 ms (3 Laufe)Qwen-AgentWorld-35B-A...gemma-2-9b-it - 171,6 tok/s Generation, 964 tok/s Prefill, TTFT 22.191 ms (3 Laufe)gemma-2-9b-itMistral-Small-3.1-24B-Instruct-2503 - 170,1 tok/s Generation, 3.446 tok/s Prefill, TTFT 4.020 ms (3 Laufe)Mistral-Small-3.1-24B...Magistral-Small-2509 - 170,0 tok/s Generation, 2.661 tok/s Prefill, TTFT 4.579 ms (3 Laufe)Magistral-Small-2509Devstral-Small-2-24B-Instruct-2512 - 162,7 tok/s Generation, 3.316 tok/s Prefill, TTFT 3.929 ms (3 Laufe)Devstral-Small-2-24B-...Devstral-Small-2507 - 161,8 tok/s Generation, 4.199 tok/s Prefill, TTFT 4.615 ms (3 Laufe)Devstral-Small-2507Qwen2.5-7B-Instruct - 160,3 tok/s Generation, 3.649 tok/s Prefill, TTFT 3.816 ms (3 Laufe)Qwen2.5-7B-InstructCodestral-22B-v0.1 - 154,1 tok/s Generation, 3.258 tok/s Prefill, TTFT 5.089 ms (3 Laufe)Codestral-22B-v0.1Mistral-Small-24B-Instruct-2501 - 153,1 tok/s Generation, 3.108 tok/s Prefill, TTFT 4.107 ms (3 Laufe)Mistral-Small-24B-Ins...OpenReasoning-Nemotron-32B - 124,6 tok/s Generation, 1.099 tok/s Prefill, TTFT 110.156 ms (6 Laufe)OpenReasoning-Nemotro...Seed-OSS-36B-Instruct - 117,5 tok/s Generation, 697 tok/s Prefill, TTFT 105.025 ms (6 Laufe)Seed-OSS-36B-InstructQwen3-32B - 117,2 tok/s Generation, 1.494 tok/s Prefill, TTFT 8.453 ms (3 Laufe)Qwen3-32BQwen2.5-Coder-32B-Instruct - 113,9 tok/s Generation, 1.280 tok/s Prefill, TTFT 62.404 ms (5 Laufe)Qwen2.5-Coder-32B-Ins...gemma-2-27b-it - 113,0 tok/s Generation, 615 tok/s Prefill, TTFT 31.225 ms (3 Laufe)gemma-2-27b-itLlama-3.3-Nemotron-Super-49B-v1.5 - 108,3 tok/s Generation, 654 tok/s Prefill, TTFT 40.487 ms (4 Laufe)Llama-3.3-Nemotron-Su...gemma-4-31B-it - 108,0 tok/s Generation, 399 tok/s Prefill, TTFT 62.261 ms (3 Laufe)gemma-4-31B-itQwen3.6-27B - 95,6 tok/s Generation, 1.151 tok/s Prefill, TTFT 9.312 ms (3 Laufe)Qwen3.6-27BNemotron-3-Nano-Omni-30B-A3B-Reasoning - 76,7 tok/s Generation, 2.234 tok/s Prefill, TTFT 966 ms (1 Lauf)Nemotron-3-Nano-Omni-...gemma-4-E2B-it - 68,3 tok/s Generation, 3.544 tok/s Prefill, TTFT 2.872 ms (6 Laufe)gemma-4-E2B-itNemotron-H-47B-Reasoning-128K - 65,5 tok/s Generation, 123 tok/s Prefill, TTFT 123.965 ms (4 Laufe)Nemotron-H-47B-Reason...Qwen3.8-Flash-Next - 63,2 tok/s Generation, 803 tok/s Prefill, TTFT 20.996 ms (3 Laufe)Qwen3.8-Flash-Nextgpt-oss-120b - 16,3 tok/s Generation, 63 tok/s Prefill, TTFT 134.604 ms (7 Laufe)gpt-oss-120bLing-3.0-flash - 14,9 tok/s Generation, 109 tok/s Prefill, TTFT 109.414 ms (3 Laufe)Ling-3.0-flashQwen3.5-122B-A10B - 11,8 tok/s Generation, 69 tok/s Prefill, TTFT 149.884 ms (4 Laufe)Qwen3.5-122B-A10BGLM-4.5-Air - 9,1 tok/s Generation, 54 tok/s Prefill, TTFT 153.903 ms (5 Laufe)GLM-4.5-AirNemotron-3-Nano-4B - 8,0 tok/s Generation, 63 tok/s Prefill, TTFT 139.289 ms (3 Laufe)Nemotron-3-Nano-4BNemotron-3-Super-120B-A12B - 6,1 tok/s Generation, 67 tok/s Prefill, TTFT 166.452 ms (3 Laufe)Nemotron-3-Super-120B...Nemotron-Cascade-2-30B-A3B - 5,9 tok/s Generation, 72 tok/s Prefill, TTFT 130.288 ms (3 Laufe)Nemotron-Cascade-2-30...command-a-reasoning-08-2025 - 5,1 tok/s Generation, 80 tok/s Prefill, TTFT 175.223 ms (3 Laufe)command-a-reasoning-0...MiniMax-M2.5 - 4,0 tok/s Generation, 47 tok/s Prefill, TTFT 174.251 ms (4 Laufe)MiniMax-M2.5MiniMax-M2.7 - 2,6 tok/s Generation, 24 tok/s Prefill, TTFT 193.311 ms (3 Laufe)MiniMax-M2.7Mistral-Medium-3.5-128B - 2,5 tok/s Generation, 101 tok/s Prefill, TTFT 126.241 ms (3 Laufe)Mistral-Medium-3.5-12...Qwen2.5-72B-Instruct - 2,3 tok/s Generation, 81 tok/s Prefill, TTFT 569 ms (2 Laufe)Qwen2.5-72B-InstructDevstral-2-123B-Instruct-2512 - 2,1 tok/s Generation, 113 tok/s Prefill, TTFT 118.087 ms (3 Laufe)Devstral-2-123B-Instr...DeepSeek-V4-Flash-284B-A13B - 1,2 tok/s Generation, 14 tok/s Prefill, TTFT 148.315 ms (1 Lauf)DeepSeek-V4-Flash-284...
Llama-3.2-1B-Instruct 609,5 tok/sQwen3-0.6B 480,5 tok/sQwen3-1.7B 437,4 tok/sLlama-3.2-3B-Instruct 354,2 tok/sQwen2.5-3B-Instruct 333,2 tok/sgemma-2-2b-it 323,8 tok/sQwen3-4B 294,3 tok/sPhi-3.5-mini-instruct 272,9 tok/sMeta-Llama-3.1-8B-Instruct 266,7 tok/sQwen2.5-Coder-7B-Instruct 256,7 tok/sQwen3-8B 252,8 tok/sgpt-oss-20b 247,3 tok/sNemotron-3-Nano-30B-A3B 244,9 tok/sQwen3-Coder-30B-A3B-Instruct 234,1 tok/sQwen3-30B-A3B 227,0 tok/sQwen3-30B-A3B-Thinking-2507 223,3 tok/sQwen3-VL-30B-A3B-Instruct 221,6 tok/sgemma-3n-E4B-it 220,8 tok/sQwen3-30B-A3B-Instruct-2507 218,5 tok/sQwen3-Omni-30B-A3B-Thinking 218,1 tok/sLaguna-XS-2.1 212,4 tok/sNorth-Mini-Code-1.0 208,8 tok/sOrnith-1.0-9B 207,5 tok/sMinistral-3-14B-Reasoning-2512 204,9 tok/sQwen3-Coder-Next 197,7 tok/sQwen3-14B 186,9 tok/sGemma-4-26B-A4B-it 185,7 tok/sQwen3.5-35B-A3B 184,4 tok/sQwen3.6-35B-A3B 181,7 tok/sgemma-4-12B-it 179,4 tok/sQwen-AgentWorld-35B-A3B 177,0 tok/sgemma-2-9b-it 171,6 tok/sMistral-Small-3.1-24B-Instruct-2503 170,1 tok/sMagistral-Small-2509 170,0 tok/sDevstral-Small-2-24B-Instruct-2512 162,7 tok/sDevstral-Small-2507 161,8 tok/sQwen2.5-7B-Instruct 160,3 tok/sCodestral-22B-v0.1 154,1 tok/sMistral-Small-24B-Instruct-2501 153,1 tok/sOpenReasoning-Nemotron-32B 124,6 tok/sSeed-OSS-36B-Instruct 117,5 tok/sQwen3-32B 117,2 tok/sQwen2.5-Coder-32B-Instruct 113,9 tok/sgemma-2-27b-it 113,0 tok/sLlama-3.3-Nemotron-Super-49B-v1.5 108,3 tok/sgemma-4-31B-it 108,0 tok/sQwen3.6-27B 95,6 tok/sNemotron-3-Nano-Omni-30B-A3B-Reasoning 76,7 tok/sgemma-4-E2B-it 68,3 tok/sNemotron-H-47B-Reasoning-128K 65,5 tok/sQwen3.8-Flash-Next 63,2 tok/sgpt-oss-120b 16,3 tok/sLing-3.0-flash 14,9 tok/sQwen3.5-122B-A10B 11,8 tok/sGLM-4.5-Air 9,1 tok/sNemotron-3-Nano-4B 8,0 tok/sNemotron-3-Super-120B-A12B 6,1 tok/sNemotron-Cascade-2-30B-A3B 5,9 tok/scommand-a-reasoning-08-2025 5,1 tok/sMiniMax-M2.5 4,0 tok/sMiniMax-M2.7 2,6 tok/sMistral-Medium-3.5-128B 2,5 tok/sQwen2.5-72B-Instruct 2,3 tok/sDevstral-2-123B-Instruct-2512 2,1 tok/sDeepSeek-V4-Flash-284B-A13B 1,2 tok/s

Prozessoren auf diesem Board

CPUIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHzIntel · 214 Läufe609,5 tok/s CPUIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHzIntel · 38 Läufe14,5 tok/s

Grafikkarten auf diesem Board

GPU2x AMD Radeon RX 7900 XTXAMD · 172 Läufe609,5 tok/s GPU2x NVIDIA GeForce RTX 2060NVIDIA · 38 Läufe259,9 tok/s GPUNVIDIA Tesla V100 PCIe 32GBNVIDIA · 4 Läufe63,2 tok/s

Getestete Modelle

MLlama-3.2-1B-Instruct1BMeta · 3 Läufe MQwen3-0.6B0.6BQwen (Alibaba) · 3 Läufe MQwen3-1.7B1.7BQwen (Alibaba) · 3 Läufe MLlama-3.2-3B-Instruct3BMeta · 9 Läufe MQwen2.5-3B-Instruct3BQwen (Alibaba) · 9 Läufe Mgemma-2-2b-it2BGoogle · 3 Läufe MQwen3-4B4BQwen (Alibaba) · 3 Läufe MPhi-3.5-mini-instruct3.8Bmicrosoft · 3 Läufe MMeta-Llama-3.1-8B-Instruct8BMeta · 7 Läufe MQwen2.5-Coder-7B-InstructQwen (Alibaba) · 3 Läufe MQwen3-8B8.2BQwen (Alibaba) · 3 Läufe Mgpt-oss-20b20BOpenAI · 6 Läufe MNemotron-3-Nano-30B-A3B30BNVIDIA · 9 Läufe MQwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) · 6 Läufe MQwen3-30B-A3B30BQwen (Alibaba) · 3 Läufe MQwen3-30B-A3B-Thinking-250730BQwen (Alibaba) · 6 Läufe MQwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) · 3 Läufe Mgemma-3n-E4B-it8BGoogle · 3 Läufe MQwen3-30B-A3B-Instruct-250730BQwen (Alibaba) · 6 Läufe MQwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) · 3 Läufe MLaguna-XS-2.1Poolside · 3 Läufe MNorth-Mini-Code-1.0Cohere · 6 Läufe MOrnith-1.0-9B9BDeepReinforce · 3 Läufe MMinistral-3-14B-Reasoning-251214BMistral AI · 3 Läufe MQwen3-Coder-NextQwen (Alibaba) · 3 Läufe MQwen3-14B14BQwen (Alibaba) · 3 Läufe MGemma-4-26B-A4B-it26BGoogle · 3 Läufe MQwen3.5-35B-A3B35BQwen (Alibaba) · 3 Läufe MQwen3.6-35B-A3B35BQwen (Alibaba) · 7 Läufe Mgemma-4-12B-it12BGoogle · 3 Läufe MQwen-AgentWorld-35B-A3B35BQwen (Alibaba) · 3 Läufe Mgemma-2-9b-it9BGoogle · 3 Läufe MMistral-Small-3.1-24B-Instruct-250324BMistral AI · 3 Läufe MMagistral-Small-250924BMistral AI · 3 Läufe MDevstral-Small-2-24B-Instruct-251224BMistral AI · 3 Läufe MDevstral-Small-250724BMistral AI · 3 Läufe MQwen2.5-7B-Instruct7BQwen (Alibaba) · 3 Läufe MCodestral-22B-v0.122BMistral AI · 3 Läufe MMistral-Small-24B-Instruct-2501Mistral AI · 3 Läufe MOpenReasoning-Nemotron-32B32BNVIDIA · 6 Läufe MSeed-OSS-36B-Instruct36BByteDance Seed · 6 Läufe MQwen3-32B32BQwen (Alibaba) · 3 Läufe MQwen2.5-Coder-32B-Instruct32BQwen (Alibaba) · 5 Läufe Mgemma-2-27b-it27BGoogle · 3 Läufe MLlama-3.3-Nemotron-Super-49B-v1.549BNVIDIA · 4 Läufe Mgemma-4-31B-it31BGoogle · 3 Läufe MQwen3.6-27B27BQwen (Alibaba) · 3 Läufe MNemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA · 1 Läufe Mgemma-4-E2B-it5BGoogle · 6 Läufe MNemotron-H-47B-Reasoning-128K47BNVIDIA · 4 Läufe MQwen3.8-Flash-Next180BQwen (Alibaba) · 3 Läufe Mgpt-oss-120b120BOpenAI · 7 Läufe MLing-3.0-flash127.5BinclusionAI · 3 Läufe MQwen3.5-122B-A10B122BQwen (Alibaba) · 4 Läufe MGLM-4.5-Air106BZ.ai (Zhipu) · 5 Läufe MNemotron-3-Nano-4B4BNVIDIA · 3 Läufe MNemotron-3-Super-120B-A12B120BNVIDIA · 3 Läufe MNemotron-Cascade-2-30B-A3B30BNVIDIA · 3 Läufe Mcommand-a-reasoning-08-2025111BCohere · 3 Läufe MMiniMax-M2.5230BMiniMax · 4 Läufe MMiniMax-M2.7230BMiniMax · 3 Läufe MMistral-Medium-3.5-128B128BMistral AI · 3 Läufe MQwen2.5-72B-Instruct72BQwen (Alibaba) · 2 Läufe MDevstral-2-123B-Instruct-2512123BMistral AI · 3 Läufe MDeepSeek-V4-Flash-284B-A13B284BDeepSeek · 1 Läufe

Genutzte Betriebssysteme

🖥Ubuntu 24.04.3 LTS (Kernel 7.0.0-28-generic)
Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf Dell Inc. PowerEdge R820.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
609,48 tok/s TG
Prefill 31.648 · TTFT 962 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
2Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
480,52 tok/s TG
Prefill 22.887 · TTFT 1.208 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
3Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
437,40 tok/s TG
Prefill 16.731 · TTFT 1.636 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
4Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
376,49 tok/s TG
Prefill 22.247 · TTFT 615 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
5Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
354,21 tok/s TG
Prefill 17.373 · TTFT 1.825 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
6Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
333,18 tok/s TG
Prefill 17.060 · TTFT 1.879 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
7gemma-2-2b-it2BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
323,81 tok/s TG
Prefill 6.071 · TTFT 3.506 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
8Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
294,28 tok/s TG
Prefill 9.688 · TTFT 2.856 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
9Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
281,62 tok/s TG
Prefill 14.942 · TTFT 839 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
10Phi-3.5-mini-instruct3.8Bmicrosoft PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
272,93 tok/s TG
Prefill 691 · TTFT 38.379 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
11Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
268,79 tok/s TG
Prefill 12.537 · TTFT 993 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
12Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
266,70 tok/s TG
Prefill 10.161 · TTFT 3.360 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
13Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
259,86 tok/s TG
Prefill 9.253 · TTFT 3.361 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
14Qwen2.5-Coder-7B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
256,72 tok/s TG
Prefill 10.123 · TTFT 3.280 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
15Qwen3-8B8.2BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
252,78 tok/s TG
Prefill 6.452 · TTFT 4.269 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
16gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,27 tok/s TG
Prefill 5.437 · TTFT 3.732 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
17Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
244,91 tok/s TG
Prefill 3.719 · TTFT 6.905 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
18Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
234,08 tok/s TG
Prefill 7.116 · TTFT 4.629 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
19Qwen3-30B-A3B30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,96 tok/s TG
Prefill 5.032 · TTFT 5.593 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
20Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,59 tok/s TG
Prefill 9.526 · TTFT 3.488 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
21Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
225,82 tok/s TG
Prefill 9.739 · TTFT 3.277 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
22Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
223,26 tok/s TG
Prefill 5.840 · TTFT 4.476 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
23Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
221,62 tok/s TG
Prefill 6.455 · TTFT 4.958 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
24gemma-3n-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
220,77 tok/s TG
Prefill 3.758 · TTFT 6.047 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
25Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
218,45 tok/s TG
Prefill 4.085 · TTFT 7.280 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
26Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
218,13 tok/s TG
Prefill 4.747 · TTFT 5.848 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
27Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
215,97 tok/s TG
Prefill 9.775 · TTFT 3.283 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
28gemma-2-2b-it2BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
212,46 tok/s TG
Prefill 5.449 · TTFT 1.783 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
29Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
212,42 tok/s TG
Prefill 4.204 · TTFT 7.880 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
30North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
208,75 tok/s TG
Prefill 3.396 · TTFT 6.675 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
31Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
207,49 tok/s TG
Prefill 4.026 · TTFT 5.675 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
32Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
207,49 tok/s TG
Prefill 12.047 · TTFT 1.151 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
33Llama-3.2-1B-Instruct1BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
207,12 tok/s TG
Prefill 7.688 · TTFT 400 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
34Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
204,85 tok/s TG
Prefill 5.517 · TTFT 5.147 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
35Qwen3-Coder-NextQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
197,72 tok/s TG
Prefill 3.028 · TTFT 9.922 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
36Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
196,57 tok/s TG
Prefill 12.975 · TTFT 1.133 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
37gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
192,70 tok/s TG
Prefill 4.519 · TTFT 2.188 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
38Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,50 tok/s TG
Prefill 6.698 · TTFT 2.090 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
39Qwen3-14B14BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
186,94 tok/s TG
Prefill 4.086 · TTFT 6.892 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
40Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
185,72 tok/s TG
Prefill 2.040 · TTFT 10.071 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
41Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
185,17 tok/s TG
Prefill 2.486 · TTFT 4.503 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
42Qwen3-4B4BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,99 tok/s TG
Prefill 7.151 · TTFT 1.754 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
43Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
184,38 tok/s TG
Prefill 3.855 · TTFT 5.993 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
44Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
181,73 tok/s TG
Prefill 3.947 · TTFT 5.816 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
45gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
179,37 tok/s TG
Prefill 755 · TTFT 26.574 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
46Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
177,00 tok/s TG
Prefill 3.900 · TTFT 5.890 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
47Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
173,08 tok/s TG
Prefill 7.158 · TTFT 2.024 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
48Phi-3.5-mini-instruct3.8Bmicrosoft PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
172,34 tok/s TG
Prefill 5.226 · TTFT 11.908 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
49gemma-2-9b-it9BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
171,56 tok/s TG
Prefill 378 · TTFT 49.531 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
50Mistral-Small-3.1-24B-Instruct-250324BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
170,07 tok/s TG
Prefill 4.885 · TTFT 6.913 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
51Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
170,04 tok/s TG
Prefill 3.644 · TTFT 7.723 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
52Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,96 tok/s TG
Prefill 3.010 · TTFT 18.082 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
53Qwen2.5-3B-Instruct3BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
168,19 tok/s TG
Prefill 7.879 · TTFT 1.850 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
54Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
162,67 tok/s TG
Prefill 4.605 · TTFT 6.779 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
55Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
161,82 tok/s TG
Prefill 5.708 · TTFT 7.791 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
56Qwen2.5-7B-Instruct7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
160,26 tok/s TG
Prefill 4.979 · TTFT 6.510 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
57Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,98 tok/s TG
Prefill 4.810 · TTFT 2.927 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
58Llama-3.2-3B-Instruct3BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
158,90 tok/s TG
Prefill 7.616 · TTFT 1.908 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ8_0Details →
59Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
157,44 tok/s TG
Prefill 5.388 · TTFT 2.798 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
60Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
154,06 tok/s TG
Prefill 4.443 · TTFT 9.034 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
61Mistral-Small-24B-Instruct-2501Mistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
153,12 tok/s TG
Prefill 4.348 · TTFT 7.017 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
62Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
152,06 tok/s TG
Prefill 7.328 · TTFT 1.967 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
63Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
151,93 tok/s TG
Prefill 3.571 · TTFT 4.182 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
64Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
151,56 tok/s TG
Prefill 5.059 · TTFT 2.775 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
65Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
150,92 tok/s TG
Prefill 4.439 · TTFT 3.079 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
66Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
150,76 tok/s TG
Prefill 3.259 · TTFT 3.120 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
67Qwen2.5-Coder-7B-InstructQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
148,60 tok/s TG
Prefill 7.309 · TTFT 1.923 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
68Qwen3-8B8.2BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
145,20 tok/s TG
Prefill 4.884 · TTFT 2.555 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
69Qwen3-0.6B0.6BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,39 tok/s TG
Prefill 7.110 · TTFT 411 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
70Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
136,39 tok/s TG
Prefill 3.136 · TTFT 3.281 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
71Qwen3-1.7B1.7BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
136,10 tok/s TG
Prefill 6.107 · TTFT 471 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
72Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
134,94 tok/s TG
Prefill 4.042 · TTFT 3.043 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
73Qwen3-30B-A3B30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
132,32 tok/s TG
Prefill 3.572 · TTFT 3.501 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
74North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,13 tok/s TG
Prefill 2.805 · TTFT 3.716 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
75Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
126,81 tok/s TG
Prefill 3.529 · TTFT 3.536 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
76Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
126,19 tok/s TG
Prefill 4.087 · TTFT 4.824 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
77OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
124,63 tok/s TG
Prefill 2.910 · TTFT 13.342 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
78Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
124,06 tok/s TG
Prefill 1.850 · TTFT 5.352 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
79Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
122,88 tok/s TG
Prefill 2.387 · TTFT 7.059 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMvLLMgodclawAWQDetails →
80Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
117,49 tok/s TG
Prefill 3.235 · TTFT 3.141 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf Dell Inc. PowerEdge R820.

Im Leaderboard →
Noch keine Harnessbenchmarks auf diesem Mainboard.

← Alle Hardware