Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
NVIDIA

Nemotron-Cascade-2-30B-A3B30B

Benchmark profile and published results.

MoE30B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA RTX PRO 6000 Blackwell Workstation EditionAll GPUs
Generation1.768,1 tok/s
Min 0,0Ø 248,3Max 2.491,2
Ueber dem Durchschnitt · 3969 Systeme im Feld
Prefill21.449 tok/s
Min 4Ø 4.741Max 55.260
Ueber dem Durchschnitt · 3969 Systeme im Feld
Time to First Token224 ms
Min 20Ø 33.962Max 535.235
Ueber dem Durchschnitt · 3967 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

2.2971.7231.1495740,003.3696.73910.108Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 1.768,1 tok/s Generation, 6.820 tok/s Prefill, TTFT 3.302 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 1.719,2 tok/s Generation, 6.140 tok/s Prefill, TTFT 3.569 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.655,2 tok/s Generation, 8.162 tok/s Prefill, TTFT 3.403 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 3090 Ti - 897,5 tok/s Generation, 3.962 tok/s Prefill, TTFT 6.439 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA RTX A6000 - 723,7 tok/s Generation, 7.683 tok/s Prefill, TTFT 3.412 ms (24 Laufe)NVIDIA RTX A6000AMD Radeon 8060S Graphics - 326,9 tok/s Generation, 499 tok/s Prefill, TTFT 56.616 ms (4 Laufe)AMD Radeon 8060S Grap...NVIDIA GeForce RTX 5070 Ti - 262,4 tok/s Generation, 1.327 tok/s Prefill, TTFT 13.826 ms (9 Laufe)NVIDIA GeForce RTX 50...NVIDIA GB10 - 148,8 tok/s Generation, 2.840 tok/s Prefill, TTFT 3.808 ms (6 Laufe)NVIDIA GB10AMD Radeon AI PRO R9700 - 122,1 tok/s Generation, 515 tok/s Prefill, TTFT 64.887 ms (10 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 2060 - 5,9 tok/s Generation, 72 tok/s Prefill, TTFT 130.288 ms (3 Laufe)NVIDIA GeForce RTX 20...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.768,1 tok/sNVIDIA GeForce RTX 5090 1.719,2 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.655,2 tok/sNVIDIA GeForce RTX 3090 Ti 897,5 tok/sNVIDIA RTX A6000 723,7 tok/sAMD Radeon 8060S Graphics 326,9 tok/sNVIDIA GeForce RTX 5070 Ti 262,4 tok/sNVIDIA GB10 148,8 tok/sAMD Radeon AI PRO R9700 122,1 tok/sNVIDIA GeForce RTX 2060 5,9 tok/s

CPUby processor

2.2971.7231.1495740,003.3696.73910.108Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 1.768,1 tok/s Generation, 6.820 tok/s Prefill, TTFT 3.302 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 7 5800X3D 8-Core Processor - 1.719,2 tok/s Generation, 6.140 tok/s Prefill, TTFT 3.569 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 1.655,2 tok/s Generation, 8.162 tok/s Prefill, TTFT 3.403 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 897,5 tok/s Generation, 3.962 tok/s Prefill, TTFT 6.439 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 723,7 tok/s Generation, 5.574 tok/s Prefill, TTFT 21.493 ms (34 Laufe)AMD Ryzen Threadrippe...AMD RYZEN AI MAX+ 395 w/ Radeon 8060S - 326,9 tok/s Generation, 499 tok/s Prefill, TTFT 56.616 ms (4 Laufe)AMD RYZEN AI MAX+ 395...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 262,4 tok/s Generation, 720 tok/s Prefill, TTFT 26.930 ms (3 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 7945HX with Radeon Graphics - 219,6 tok/s Generation, 1.631 tok/s Prefill, TTFT 7.274 ms (6 Laufe)AMD Ryzen 9 7945HX wi...NVIDIA Grace - 148,8 tok/s Generation, 2.840 tok/s Prefill, TTFT 3.808 ms (6 Laufe)NVIDIA GraceIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 5,9 tok/s Generation, 72 tok/s Prefill, TTFT 130.288 ms (3 Laufe)Intel(R) Xeon(R) CPU ...
AMD Ryzen 9 9950X 16-Core Processor 1.768,1 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 1.719,2 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 1.655,2 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 897,5 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 723,7 tok/sAMD RYZEN AI MAX+ 395 w/ Radeon 8060S 326,9 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 262,4 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 219,6 tok/sNVIDIA Grace 148,8 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 5,9 tok/s

ENGby engine

2.1801.6801.1806801802.4965.2828.06910.856Prefill (tok/s)Generation (tok/s)llama.cpp - 1.768,1 tok/s Generation, 4.014 tok/s Prefill, TTFT 20.759 ms (65 Laufe)llama.cppvLLM - 592,4 tok/s Generation, 9.337 tok/s Prefill, TTFT 24.063 ms (9 Laufe)vLLM
llama.cpp 1.768,1 tok/svLLM 592,4 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.768,14 tok/s TG
Prefill 8.360 · TTFT 6.952 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
2Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.719,17 tok/s TG
Prefill 8.044 · TTFT 7.376 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
3Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.655,21 tok/s TG
Prefill 10.591 · TTFT 7.004 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
4Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.650,72 tok/s TG
Prefill 11.398 · TTFT 6.887 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
5Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.542,64 tok/s TG
Prefill 7.398 · TTFT 8.118 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
6Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.007,26 tok/s TG
Prefill 7.851 · TTFT 2.444 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
7Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
986,08 tok/s TG
Prefill 6.401 · TTFT 2.783 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
8Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
928,51 tok/s TG
Prefill 10.134 · TTFT 2.295 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
9Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
926,98 tok/s TG
Prefill 9.358 · TTFT 2.375 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
10Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
899,18 tok/s TG
Prefill 6.644 · TTFT 2.846 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
11Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
897,47 tok/s TG
Prefill 4.560 · TTFT 13.829 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
12Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
723,68 tok/s TG
Prefill 7.027 · TTFT 14.700 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
13Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
723,16 tok/s TG
Prefill 7.058 · TTFT 14.771 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
14Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
592,35 tok/s TG
Prefill 20.010 · TTFT 1.519 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
15Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
548,84 tok/s TG
Prefill 4.012 · TTFT 4.835 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
16Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
436,89 tok/s TG
Prefill 6.484 · TTFT 4.583 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
17Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
435,36 tok/s TG
Prefill 6.438 · TTFT 4.605 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
18Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
415,29 tok/s TG
Prefill 14.768 · TTFT 886 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
19Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
393,14 tok/s TG
Prefill 6.810 · TTFT 9.694 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
20Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
391,02 tok/s TG
Prefill 6.784 · TTFT 9.603 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
21Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
365,67 tok/s TG
Prefill 21.449 · TTFT 1.461 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
22Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
359,03 tok/s TG
Prefill 3.976 · TTFT 549 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_MDetails →
23Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
356,78 tok/s TG
Prefill 4.249 · TTFT 510 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_MDetails →
24Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
330,17 tok/s TG
Prefill 5.181 · TTFT 419 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
25Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
329,90 tok/s TG
Prefill 6.288 · TTFT 345 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
26Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
327,65 tok/s TG
Prefill 6.467 · TTFT 336 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_MDetails →
27Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
326,85 tok/s TG
Prefill 125 · TTFT 210.255 ms
5×AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMvLLMgodclawBF16Details →
28Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
262,44 tok/s TG
Prefill 822 · TTFT 55.319 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
29Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
256,29 tok/s TG
Prefill 15.783 · TTFT 824 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
30Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
250,32 tok/s TG
Prefill 5.865 · TTFT 3.782 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
31Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
221,80 tok/s TG
Prefill 3.314 · TTFT 655 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_MDetails →
32Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
219,79 tok/s TG
Prefill 4.791 · TTFT 2.262 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
33Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
219,59 tok/s TG
Prefill 2.273 · TTFT 11.329 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
34Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
217,05 tok/s TG
Prefill 6.295 · TTFT 1.732 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
35Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,78 tok/s TG
Prefill 6.257 · TTFT 1.743 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
36Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
200,64 tok/s TG
Prefill 5.982 · TTFT 3.713 ms
10×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
37Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
190,25 tok/s TG
Prefill 1.859 · TTFT 13.867 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
38Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
180,59 tok/s TG
Prefill 5.816 · TTFT 394 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliAWQDetails →
39Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
176,37 tok/s TG
Prefill 4.856 · TTFT 2.232 ms
5×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
40Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
171,10 tok/s TG
Prefill 4.389 · TTFT 495 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
41Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
170,84 tok/s TG
Prefill 4.390 · TTFT 495 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
42Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
162,55 tok/s TG
Prefill 715 · TTFT 21.986 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
43Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
157,50 tok/s TG
Prefill 1.715 · TTFT 6.606 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
44Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
157,01 tok/s TG
Prefill 4.273 · TTFT 508 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
45Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
156,26 tok/s TG
Prefill 1.343 · TTFT 8.459 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
46Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
148,79 tok/s TG
Prefill 3.362 · TTFT 6.588 ms
10×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
47Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
145,40 tok/s TG
Prefill 4.443 · TTFT 489 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
48Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
145,15 tok/s TG
Prefill 4.443 · TTFT 489 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ8_0Details →
49Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
138,75 tok/s TG
Prefill 1.439 · TTFT 1.508 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
50Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
131,82 tok/s TG
Prefill 4.293 · TTFT 505 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cliQ8_0Details →
51Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
123,54 tok/s TG
Prefill 2.897 · TTFT 3.743 ms
5×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
52Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,13 tok/s TG
Prefill 269 · TTFT 141.200 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
53Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
122,08 tok/s TG
Prefill 272 · TTFT 140.873 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
54Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
121,28 tok/s TG
Prefill 271 · TTFT 141.620 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
55Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
120,01 tok/s TG
Prefill 1.155 · TTFT 1.875 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen 9 7945HX with Radeon Graphics · 61 GB RAMllama.cppgodclawIQ4_XSDetails →
56Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
118,36 tok/s TG
Prefill 5.676 · TTFT 402 ms
1×NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMopenclaw_cliFP8Details →
57Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,87 tok/s TG
Prefill 3.141 · TTFT 690 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
58Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
101,36 tok/s TG
Prefill 3.237 · TTFT 6.850 ms
10×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ8_0Details →
59Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
94,63 tok/s TG
Prefill 1.463 · TTFT 15.382 ms
10×AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMllama.cppgodclawQ4_K_MDetails →
60Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
84,61 tok/s TG
Prefill 2.849 · TTFT 3.806 ms
5×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ8_0Details →
61Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
76,95 tok/s TG
Prefill 2.356 · TTFT 929 ms
1×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ4_K_MDetails →
62Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
76,18 tok/s TG
Prefill 221 · TTFT 62.327 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
63Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
75,16 tok/s TG
Prefill 220 · TTFT 62.756 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
64Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
74,62 tok/s TG
Prefill 219 · TTFT 62.998 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
65Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
68,96 tok/s TG
Prefill 623 · TTFT 3.485 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_MDetails →
66Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,04 tok/s TG
Prefill 2.341 · TTFT 935 ms
1×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMllama.cppopenclaw_cliQ8_0Details →
67Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,17 tok/s TG
Prefill 179 · TTFT 12.138 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
68Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,81 tok/s TG
Prefill 179 · TTFT 12.150 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
69Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
31,70 tok/s TG
Prefill 179 · TTFT 12.121 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_MDetails →
70Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkPerformancetest Small 1.0
27,50 tok/s TG
Prefill 299 · TTFT 224 ms
1×AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMvLLMgodclawBF16Details →
71Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkPerformancetest Small 1.0
27,50 tok/s TG
Prefill 109 · TTFT 604 ms
1×AMD Radeon 8060S GraphicsAMD RYZEN AI MAX+ 395 w/ Radeon 8060S · 31 GB RAMvLLMgodclawBF16Details →
72Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,86 tok/s TG
Prefill 61 · TTFT 35.481 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
73Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
5,33 tok/s TG
Prefill 74 · TTFT 150.609 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
74Nemotron-Cascade-2-30B-A3B30BNVIDIA Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
0,27 tok/s TG
Prefill 82 · TTFT 204.776 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_MDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.