Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Contributed byMario AlkaQwen (Alibaba)

Qwen2.5-32B-Instruct-AWQ

Harness benchmark · measured on 06.04.2026 15:08

Benchmark-IDrun-20260722-161610-75ccf8
Tool Usage Standard 1.0Dense32BRuntime: openclaw_cli
ℹ
For context: Diese Plattform nutzt Unified Memory – die "VRAM" ist gemeinsamer System-RAM (APU/Superchip); das Modell teilt sich den Speicher mit dem System.
Points298,00von 2.980,00
Points rate10,00%
Tasks passed16von 16
Total duration4.687,00s
Ranking in the field
This GPUAll GPUs
28of 30 systems

Harness benchmark · Primary metric: Score rate (%)

This run is better than 0 % of all comparable systems.
Score rate 10 %
-82 % vs Ø 54,4
Tasks passed 16
-14 % vs Ø 18,6
Total duration 4.687,0 s
+96 % vs Ø 2.395,9
Distribution in the field10 – 91 %
Ø 54 Median Dieser Lauf

Wie schlägt sich dieser Benchmark mit anderen Modellen?

Hardware

GPU: AMD Radeon 8060S Graphics
CPU: AMD RYZEN AI MAX+ 395 w/ Radeon 8060S
RAM: 123 GB
Mainboard: Meigao Innovation Technology (Shen Zhen) Co., Ltd SHWSA (MS-S1 MAX)

Setup

Runtime: openclaw_cli
Quantization: -
Model: Qwen2.5-32B-Instruct-AWQ

Aufgaben (16)

TaskStatusPointsDuration
Antwortzeit Testpassed5 / 5046,00 s
Format Testpassed8 / 8069,00 s
Dateisystem Setuppassed12 / 120205,00 s
Daten Generierungpassed15 / 150311,00 s
Parsing + Transformationpassed20 / 200294,00 s
Fehlerbehandlung JSONpassed15 / 150158,00 s
Python Tool Usagepassed22 / 220184,00 s
PHP Tool Usagepassed22 / 220248,00 s
Export + Reimportpassed24 / 240575,00 s
Archivierungpassed18 / 180183,00 s
Hash Berechnungpassed20 / 200474,00 s
Textsuchepassed18 / 180304,00 s
Idempotenz Testpassed22 / 220305,00 s
Rechte Problempassed22 / 220603,00 s
Final JSONpassed25 / 250620,00 s
Finale Ausgabepassed30 / 300108,00 s

All benchmarks of this model To leaderboard

Anzeige
Model comparison

Qwen2.5-32B-Instruct-AWQ on various hardware

All published performance runs of this model – each bubble a variant: position = prefill (X) × generation (Y), bubble size = number of runs. Closer to the top right = faster. ★ Marked gold = this benchmark.

GPUby graphics card

6594943291650,001.8803.7615.641Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 510,3 tok/s Generation, 4.510 tok/s Prefill, TTFT 5.988 ms (6 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 473,9 tok/s Generation, 4.532 tok/s Prefill, TTFT 9.919 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 412,6 tok/s Generation, 4.568 tok/s Prefill, TTFT 11.783 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX A6000 - 362,6 tok/s Generation, 4.063 tok/s Prefill, TTFT 4.052 ms (9 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 3090 Ti - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)NVIDIA GeForce RTX 30...AMD Radeon PRO W7900 Dual Slot - 89,6 tok/s Generation, 1.013 tok/s Prefill, TTFT 13.903 ms (3 Laufe)AMD Radeon PRO W7900 ...AMD Radeon PRO W7800 48GB - 69,9 tok/s Generation, 1.608 tok/s Prefill, TTFT 9.864 ms (3 Laufe)AMD Radeon PRO W7800 ...NVIDIA GeForce RTX 5070 Ti - 45,0 tok/s Generation, 619 tok/s Prefill, TTFT 95.102 ms (3 Laufe)NVIDIA GeForce RTX 50...AMD Radeon AI PRO R9700 - 22,3 tok/s Generation, 127 tok/s Prefill, TTFT 138.392 ms (10 Laufe)AMD Radeon AI PRO R97...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 510,3 tok/sNVIDIA GeForce RTX 5090 473,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 412,6 tok/sNVIDIA RTX A6000 362,6 tok/sNVIDIA GeForce RTX 3090 Ti 223,8 tok/sAMD Radeon PRO W7900 Dual Slot 89,6 tok/sAMD Radeon PRO W7800 48GB 69,9 tok/sNVIDIA GeForce RTX 5070 Ti 45,0 tok/sAMD Radeon AI PRO R9700 22,3 tok/s

CPUby processor

6464843231610,01781.9423.7065.470Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 510,3 tok/s Generation, 4.510 tok/s Prefill, TTFT 5.988 ms (6 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 7 5800X3D 8-Core Processor - 473,9 tok/s Generation, 4.532 tok/s Prefill, TTFT 9.919 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 412,6 tok/s Generation, 4.568 tok/s Prefill, TTFT 11.783 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 362,6 tok/s Generation, 1.991 tok/s Prefill, TTFT 74.758 ms (19 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 89,6 tok/s Generation, 1.080 tok/s Prefill, TTFT 39.623 ms (9 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen 9 9950X 16-Core Processor 510,3 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 473,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 412,6 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 362,6 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 223,8 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 89,6 tok/s

MBby mainboard

6464843231610,01861.9333.6795.426Prefill (tok/s)Generation (tok/s)ASUSTeK COMPUTER INC. ProArt X870E-CREATOR WIFI - 510,3 tok/s Generation, 4.510 tok/s Prefill, TTFT 5.988 ms (6 Laufe)ASUSTeK COMPUTER INC....ASUSTeK COMPUTER INC. ROG STRIX B550-A GAMING - 473,9 tok/s Generation, 4.532 tok/s Prefill, TTFT 9.919 ms (3 Laufe)ASUSTeK COMPUTER INC....ASUSTeK COMPUTER INC. Pro WS WRX90E-SAGE SE - 412,6 tok/s Generation, 2.820 tok/s Prefill, TTFT 54.516 ms (28 Laufe)ASUSTeK COMPUTER INC....Meigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series) - 223,8 tok/s Generation, 2.049 tok/s Prefill, TTFT 20.233 ms (6 Laufe)Meigao Innovation Tec...ASUSTeK COMPUTER INC. Pro WS WRX80E-SAGE SE WIFI - 89,6 tok/s Generation, 1.080 tok/s Prefill, TTFT 39.623 ms (9 Laufe)ASUSTeK COMPUTER INC....
ASUSTeK COMPUTER INC. ProArt X870E-CREATOR WIFI 510,3 tok/sASUSTeK COMPUTER INC. ROG STRIX B550-A GAMING 473,9 tok/sASUSTeK COMPUTER INC. Pro WS WRX90E-SAGE SE 412,6 tok/sMeigao Innovation Technology (Shen Zhen) Co., Ltd DRFXL (MotherBoard Series) 223,8 tok/sASUSTeK COMPUTER INC. Pro WS WRX80E-SAGE SE WIFI 89,6 tok/s

ENGby engine

5695304924544161.8952.6313.3674.103Prefill (tok/s)Generation (tok/s)vLLM - 510,3 tok/s Generation, 3.650 tok/s Prefill, TTFT 4.952 ms (15 Laufe)vLLMllama.cpp - 474,0 tok/s Generation, 2.348 tok/s Prefill, TTFT 53.942 ms (37 Laufe)llama.cpp
vLLM 510,3 tok/sllama.cpp 474,0 tok/s

DRVby driver

5615365104854592.5602.6692.7782.887Prefill (tok/s)Generation (tok/s)unbekannt - 510,3 tok/s Generation, 2.723 tok/s Prefill, TTFT 39.810 ms (52 Laufe)unbekannt
unbekannt 510,3 tok/s
Contributed by

Mario Alka Administrator

@marioalka

Ich bin Unternehmer, Softwareentwickler und KI-Enthusiast. Seit vielen Jahren entwickle ich Unternehmenssoftware und beschäftige mich inzwischen fast täglich mit lokalen LLMs, KI-Agenten und leistungsfähiger KI-Hardware.

Mit LLM-Benchmark.de möchte ich eine Plattform schaffen, auf der Modelle, GPUs und Agenten objektiv und reproduzierbar miteinander verglichen werden.