Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
NVIDIA

OpenReasoning-Nemotron-32B32B

Benchmarkprofil und veröffentlichte Ergebnisse.

Dense32B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation481,0 tok/s
Min 0,1Ø 429,9Max 2.491,2
Ueber dem Durchschnitt · 218 Systeme im Feld
Prefill4.935 tok/s
Min 7Ø 4.548Max 37.116
Ueber dem Durchschnitt · 218 Systeme im Feld
Time to First Token971 ms
Min 119Ø 65.147Max 328.995
Ueber dem Durchschnitt · 218 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

6254693131560,001.8603.7215.581Prefill (tok/s)Generation (tok/s)NVIDIA GeForce RTX 5090 - 481,0 tok/s Generation, 3.983 tok/s Prefill, TTFT 10.140 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 480,0 tok/s Generation, 4.502 tok/s Prefill, TTFT 9.693 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 411,7 tok/s Generation, 4.317 tok/s Prefill, TTFT 11.939 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 3090 Ti - 236,8 tok/s Generation, 2.036 tok/s Prefill, TTFT 20.847 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA RTX A6000 - 144,0 tok/s Generation, 1.970 tok/s Prefill, TTFT 10.842 ms (15 Laufe)NVIDIA RTX A6000NVIDIA GeForce RTX 5070 Ti - 49,9 tok/s Generation, 621 tok/s Prefill, TTFT 94.653 ms (3 Laufe)NVIDIA GeForce RTX 50...AMD Radeon AI PRO R9700 - 23,3 tok/s Generation, 214 tok/s Prefill, TTFT 162.122 ms (7 Laufe)AMD Radeon AI PRO R97...AMD Radeon 8060S Graphics - 16,5 tok/s Generation, 691 tok/s Prefill, TTFT 41.832 ms (1 Lauf)AMD Radeon 8060S Grap...NVIDIA GeForce RTX 2060 - 1,1 tok/s Generation, 8 tok/s Prefill, TTFT 266.668 ms (1 Lauf)NVIDIA GeForce RTX 20...
NVIDIA GeForce RTX 5090 481,0 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 480,0 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 411,7 tok/sNVIDIA GeForce RTX 3090 Ti 236,8 tok/sNVIDIA RTX A6000 144,0 tok/sNVIDIA GeForce RTX 5070 Ti 49,9 tok/sAMD Radeon AI PRO R9700 23,3 tok/sAMD Radeon 8060S Graphics 16,5 tok/sNVIDIA GeForce RTX 2060 1,1 tok/s

CPUnach Prozessor

6254693131560,001.8603.7215.581Prefill (tok/s)Generation (tok/s)AMD Ryzen 7 5800X3D 8-Core Processor - 481,0 tok/s Generation, 3.983 tok/s Prefill, TTFT 10.140 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 9950X 16-Core Processor - 480,0 tok/s Generation, 4.502 tok/s Prefill, TTFT 9.693 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 411,7 tok/s Generation, 4.317 tok/s Prefill, TTFT 11.939 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 236,8 tok/s Generation, 2.036 tok/s Prefill, TTFT 20.847 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 144,0 tok/s Generation, 1.411 tok/s Prefill, TTFT 58.977 ms (22 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 49,9 tok/s Generation, 621 tok/s Prefill, TTFT 94.653 ms (3 Laufe)AMD Ryzen Threadrippe...AMD RYZEN AI MAX+ 395 w/ Radeon 8060S - 16,5 tok/s Generation, 691 tok/s Prefill, TTFT 41.832 ms (1 Lauf)AMD RYZEN AI MAX+ 395...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 1,1 tok/s Generation, 8 tok/s Prefill, TTFT 266.668 ms (1 Lauf)Intel(R) Xeon(R) CPU ...
AMD Ryzen 7 5800X3D 8-Core Processor 481,0 tok/sAMD Ryzen 9 9950X 16-Core Processor 480,0 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 411,7 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 236,8 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 144,0 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 49,9 tok/sAMD RYZEN AI MAX+ 395 w/ Radeon 8060S 16,5 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 1,1 tok/s

ENGnach Engine

5295054814574332.1732.2652.3582.450Prefill (tok/s)Generation (tok/s)llama.cpp - 481,0 tok/s Generation, 2.312 tok/s Prefill, TTFT 47.098 ms (45 Laufe)llama.cpp
llama.cpp 481,0 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
481,00 tok/s TG
Prefill 4.476 · TTFT 22.733 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
2OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
480,01 tok/s TG
Prefill 5.022 · TTFT 21.777 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
3OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
411,74 tok/s TG
Prefill 6.821 · TTFT 24.282 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
391,83 tok/s TG
Prefill 5.175 · TTFT 25.101 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
342,61 tok/s TG
Prefill 3.592 · TTFT 31.111 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
255,53 tok/s TG
Prefill 5.057 · TTFT 6.588 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
7OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
254,28 tok/s TG
Prefill 4.935 · TTFT 6.717 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
8OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,79 tok/s TG
Prefill 2.409 · TTFT 46.406 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
9OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
219,61 tok/s TG
Prefill 6.206 · TTFT 7.079 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
217,53 tok/s TG
Prefill 5.226 · TTFT 7.446 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
182,02 tok/s TG
Prefill 3.427 · TTFT 9.736 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
143,98 tok/s TG
Prefill 2.767 · TTFT 24.248 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
13OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
140,00 tok/s TG
Prefill 2.638 · TTFT 27.354 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
14OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
138,38 tok/s TG
Prefill 2.698 · TTFT 27.790 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
15OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
137,80 tok/s TG
Prefill 3.136 · TTFT 23.970 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
16OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
127,74 tok/s TG
Prefill 2.245 · TTFT 14.449 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
17OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
115,88 tok/s TG
Prefill 1.609 · TTFT 16.977 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
18OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
77,33 tok/s TG
Prefill 2.366 · TTFT 6.171 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
19OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
77,23 tok/s TG
Prefill 1.954 · TTFT 6.520 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
20OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
69,23 tok/s TG
Prefill 2.540 · TTFT 971 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
21OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
68,35 tok/s TG
Prefill 3.427 · TTFT 714 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
22OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
65,74 tok/s TG
Prefill 1.560 · TTFT 8.148 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
23OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,59 tok/s TG
Prefill 2.641 · TTFT 930 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
24OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
64,56 tok/s TG
Prefill 3.452 · TTFT 709 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
25OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
57,37 tok/s TG
Prefill 2.309 · TTFT 1.056 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
26OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
56,97 tok/s TG
Prefill 2.087 · TTFT 6.098 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
27OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
49,93 tok/s TG
Prefill 707 · TTFT 215.096 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
28OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
45,16 tok/s TG
Prefill 2.426 · TTFT 5.640 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
29OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
40,24 tok/s TG
Prefill 1.453 · TTFT 1.685 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
30OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
31,27 tok/s TG
Prefill 1.242 · TTFT 1.972 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
31OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
31,24 tok/s TG
Prefill 1.232 · TTFT 1.990 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
32OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
27,10 tok/s TG
Prefill 1.215 · TTFT 2.015 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_M
33OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
25,80 tok/s TG
Prefill 706 · TTFT 63.420 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
34OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,25 tok/s TG
Prefill 1.196 · TTFT 2.115 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
35OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,26 tok/s TG
Prefill 1.308 · TTFT 1.876 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
36OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
19,26 tok/s TG
Prefill 1.316 · TTFT 1.864 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0
37OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
16,53 tok/s TG
Prefill 691 · TTFT 41.832 ms
10×AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMllama.cppgodclawQ4_K_M
38OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,56 tok/s TG
Prefill 50 · TTFT 190.018 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
39OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,48 tok/s TG
Prefill 51 · TTFT 187.949 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
40OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,22 tok/s TG
Prefill 50 · TTFT 189.758 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
41OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,13 tok/s TG
Prefill 51 · TTFT 187.699 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
42OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,08 tok/s TG
Prefill 50 · TTFT 189.477 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
43OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
10,99 tok/s TG
Prefill 51 · TTFT 187.842 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
44OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,46 tok/s TG
Prefill 449 · TTFT 5.444 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
45OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,10 tok/s TG
Prefill 8 · TTFT 266.668 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.