Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Contributed byMario AlkaQwen (Alibaba)

Qwen2.5-32B-Instruct-AWQ

Harness benchmark · measured on 04.04.2026 11:15

Benchmark-IDrun-20260722-161610-de118a
Tool Usage V 1.0Dense32BRuntime: openclaw_cli
ℹ
For context: Diese Plattform nutzt Unified Memory – die "VRAM" ist gemeinsamer System-RAM (APU/Superchip); das Modell teilt sich den Speicher mit dem System.
Points235,00von 1.760,00
Points rate13,35%
Tasks passed15von 15
Total duration1.783,00s
Ranking in the field
48of 51 systems

Harness benchmark · Primary metric: Score rate (%)

This run is better than 6 % of all comparable systems.
Score rate 13 %
-79 % vs Ø 63,1
Tasks passed 15
-81 % vs Ø 77,1
Total duration 1.783,0 s
+10 % vs Ø 1.623,8
Distribution in the field10 – 100 %
Ø 63 Median Dieser Lauf

Wie schlägt sich dieser Benchmark mit anderen Modellen?

Kolibri-1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20261008-165122-c5dea7
100 %
Qwen3.6-35B-A3B-AWQNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260929-153935-691df9
100 %
Jev-1.13.0Cloud/API: TypeSafe AI (Hardware unbekannt) · run-20260929-091917-060aae
100 %
Qwen3.6-35B-A3B-AWQNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260929-091748-cbe456
100 %
Qwen3.8-27B-Uncensored2× 2x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260929-091747-e13da0
100 %
Open-Jev-27B-v1.1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260929-091747-5d8477
100 %
Kolibri-1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20261008-125923-3f1672
99 %
Qwen3.6-35B-A3B-AWQNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260929-112249-dba0f2
97 %
Kolibri-1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20261008-125923-43651d
93 %
Kolibri-1NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20261008-125923-5b5304
91 %
Gemma-4-26B-A4B-itNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260722-161611-05d866
91 %
Devstral-Small-2-24B-Instruct-2512AMD Radeon 8060S Graphics · run-20260722-161611-5f2f86
87 %
Gemma-4-26B-A4B-itAMD Radeon 8060S Graphics · run-20260722-161611-12a767
82 %
MiniMax-M2.53× 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition · run-20260722-161611-f6cfe1
81 %
Qwen2.5-32B-Instruct-AWQ this runAMD Radeon 8060S Graphics · run-20260722-161610-de118a
13 %

Aufgaben (15)

TaskStatusPointsDuration
Antwortzeit Testpassed5 / 5053,00 s
JSON Direkt Ausgabepassed7 / 7060,00 s
Kurzinhalt Benchmarkpassed6 / 6056,00 s
Textdatei anlegenpassed10 / 100119,00 s
JSON Datei erzeugenpassed12 / 12099,00 s
JSON Datei lesen und Feld ausgebenpassed12 / 120148,00 s
Komplexeres JSON erzeugenpassed14 / 140196,00 s
JSON auswerten Summepassed15 / 15072,00 s
Python Code erzeugenpassed13 / 130120,00 s
Python Code ausfuehrenpassed24 / 15056,00 s
PHP Datei erzeugenpassed13 / 130123,00 s
PHP Datei ausfuehrenpassed65 / 15038,00 s
Markdown Inhalt generierenpassed11 / 110316,00 s
Dateiinhalt pruefenpassed10 / 10051,00 s
Mehrstufige Verarbeitungpassed18 / 180276,00 s

Configuration

benchmark-konfiguration — run-20260722-161610-de118a
# LLM-Benchmark Konfiguration # Modell : Qwen2.5-32B-Instruct-AWQ # Run-ID : run-20260722-161610-de118a # GPU : AMD Radeon 8060S Graphics # CPU : AMD RYZEN AI MAX+ 395 w/ Radeon 8060S # RAM : 31 GB bench@llm-benchmark:~$ cat benchmark.conf execution_type local
execution_typelocal

All benchmarks of this model To leaderboard

Anzeige
Model comparison

Qwen2.5-32B-Instruct-AWQ on various hardware

All published performance runs of this model – each bubble a variant: position = prefill (X) × generation (Y), bubble size = number of runs. Closer to the top right = faster. ★ Marked gold = this benchmark.

GPUby graphics card

6544913271640,001.8623.7245.587Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 510,3 tok/s Generation, 4.510 tok/s Prefill, TTFT 5.988 ms (6 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 473,9 tok/s Generation, 4.532 tok/s Prefill, TTFT 9.919 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 412,6 tok/s Generation, 4.568 tok/s Prefill, TTFT 11.783 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX A6000 - 362,6 tok/s Generation, 4.063 tok/s Prefill, TTFT 4.052 ms (9 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 3090 Ti - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)NVIDIA GeForce RTX 30...AMD Radeon RX 7900 XTX - 179,0 tok/s Generation, 2.823 tok/s Prefill, TTFT 5.787 ms (3 Laufe)AMD Radeon RX 7900 XTXAMD Radeon AI PRO R9700 - 116,3 tok/s Generation, 430 tok/s Prefill, TTFT 108.658 ms (13 Laufe)AMD Radeon AI PRO R97...AMD Radeon PRO W7900 Dual Slot - 89,6 tok/s Generation, 1.013 tok/s Prefill, TTFT 13.903 ms (3 Laufe)AMD Radeon PRO W7900 ...AMD Radeon PRO W7800 48GB - 69,9 tok/s Generation, 1.211 tok/s Prefill, TTFT 13.698 ms (6 Laufe)AMD Radeon PRO W7800 ...NVIDIA GeForce RTX 5070 Ti - 45,0 tok/s Generation, 619 tok/s Prefill, TTFT 95.102 ms (3 Laufe)NVIDIA GeForce RTX 50...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 510,3 tok/sNVIDIA GeForce RTX 5090 473,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 412,6 tok/sNVIDIA RTX A6000 362,6 tok/sNVIDIA GeForce RTX 3090 Ti 223,8 tok/sAMD Radeon RX 7900 XTX 179,0 tok/sAMD Radeon AI PRO R9700 116,3 tok/sAMD Radeon PRO W7900 Dual Slot 89,6 tok/sAMD Radeon PRO W7800 48GB 69,9 tok/sNVIDIA GeForce RTX 5070 Ti 45,0 tok/s

CPUby processor

6464843231610,01001.8943.6885.482Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 510,3 tok/s Generation, 4.510 tok/s Prefill, TTFT 5.988 ms (6 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 7 5800X3D 8-Core Processor - 473,9 tok/s Generation, 4.532 tok/s Prefill, TTFT 9.919 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 412,6 tok/s Generation, 4.568 tok/s Prefill, TTFT 11.783 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 362,6 tok/s Generation, 1.991 tok/s Prefill, TTFT 74.758 ms (19 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen Threadripper PRO 3955WX 16-Cores - 179,0 tok/s Generation, 2.823 tok/s Prefill, TTFT 5.787 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 3 3100 4-Core Processor - 116,3 tok/s Generation, 1.438 tok/s Prefill, TTFT 9.543 ms (3 Laufe)AMD Ryzen 3 3100 4-Co...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 89,6 tok/s Generation, 1.013 tok/s Prefill, TTFT 34.100 ms (12 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen 9 9950X 16-Core Processor 510,3 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 473,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 412,6 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 362,6 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 223,8 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 179,0 tok/sAMD Ryzen 3 3100 4-Core Processor 116,3 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 89,6 tok/s

MBby mainboard

6404803201600,05352.1483.7605.372Prefill (tok/s)Generation (tok/s)ASUSTeK COMPUTER INC. ProArt X870E-CREATOR WIFI - 510,3 tok/s Generation, 4.510 tok/s Prefill, TTFT 5.988 ms (6 Laufe)ASUSTeK COMPUTER INC....ASUSTeK COMPUTER INC. ROG STRIX B550-A GAMING - 473,9 tok/s Generation, 4.532 tok/s Prefill, TTFT 9.919 ms (3 Laufe)ASUSTeK COMPUTER INC....ASUSTeK COMPUTER INC. Pro WS WRX90E-SAGE SE - 412,6 tok/s Generation, 2.820 tok/s Prefill, TTFT 54.516 ms (28 Laufe)ASUSTeK COMPUTER INC....Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series) - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)Meigao Innovation Tec...ASUSTeK COMPUTER INC. Pro WS WRX80E-SAGE SE WIFI - 179,0 tok/s Generation, 1.375 tok/s Prefill, TTFT 28.437 ms (15 Laufe)ASUSTeK COMPUTER INC....ASUSTeK COMPUTER INC. ROG STRIX X570-F GAMING - 116,3 tok/s Generation, 1.438 tok/s Prefill, TTFT 9.543 ms (3 Laufe)ASUSTeK COMPUTER INC....
ASUSTeK COMPUTER INC. ProArt X870E-CREATOR WIFI 510,3 tok/sASUSTeK COMPUTER INC. ROG STRIX B550-A GAMING 473,9 tok/sASUSTeK COMPUTER INC. Pro WS WRX90E-SAGE SE 412,6 tok/sMeigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series) 223,8 tok/sASUSTeK COMPUTER INC. Pro WS WRX80E-SAGE SE WIFI 179,0 tok/sASUSTeK COMPUTER INC. ROG STRIX X570-F GAMING 116,3 tok/s

ENGby engine

5695304924544161.9402.4492.9573.466Prefill (tok/s)Generation (tok/s)vLLM - 510,3 tok/s Generation, 3.126 tok/s Prefill, TTFT 6.869 ms (21 Laufe)vLLMllama.cpp - 474,0 tok/s Generation, 2.280 tok/s Prefill, TTFT 50.612 ms (40 Laufe)llama.cpp
vLLM 510,3 tok/sllama.cpp 474,0 tok/s

DRVby driver

5615365104854592.4172.5202.6232.725Prefill (tok/s)Generation (tok/s)unbekannt - 510,3 tok/s Generation, 2.571 tok/s Prefill, TTFT 35.553 ms (61 Laufe)unbekannt
unbekannt 510,3 tok/s
Contributed by

Mario Alka Administrator

@marioalka

Ich bin Unternehmer, Softwareentwickler und KI-Enthusiast. Seit vielen Jahren entwickle ich Unternehmenssoftware und beschäftige mich inzwischen fast täglich mit lokalen LLMs, KI-Agenten und leistungsfähiger KI-Hardware.

Mit LLM-Benchmark.de möchte ich eine Plattform schaffen, auf der Modelle, GPUs und Agenten objektiv und reproduzierbar miteinander verglichen werden.