NVIDIA
Llama-3.3-Nemotron-Super-49B-v1.549B
Benchmarkprofil und veröffentlichte Ergebnisse.
Dense49B
Einordnung im Feld
Bestwerte im Vergleich
Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.
Generation364,1 tok/s
Min 0,0Ø 248,3Max 2.491,2
Ueber dem Durchschnitt · 3969 Systeme im Feld
Prefill5.040 tok/s
Min 4Ø 4.741Max 55.260
Ueber dem Durchschnitt · 3969 Systeme im Feld
Time to First Token1.025 ms
Min 20Ø 33.962Max 535.235
Ueber dem Durchschnitt · 3967 Systeme im Feld
Performanceprofil
Durchsatz nach Hardware & Engine
Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.
GPUnach Grafikkarte
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 364,1 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 303,0 tok/sNVIDIA RTX A6000 197,3 tok/sAMD Radeon PRO W7900 Dual Slot 71,0 tok/sNVIDIA GeForce RTX 5070 Ti 25,2 tok/sNVIDIA GeForce RTX 5090 20,2 tok/sNVIDIA GeForce RTX 3090 Ti 19,6 tok/sAMD Radeon AI PRO R9700 11,6 tok/s
CPUnach Prozessor
AMD Ryzen 9 9950X 16-Core Processor 364,1 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 303,0 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 197,3 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 71,0 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 20,2 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 19,6 tok/s
Durchsatz & Latenz
Performancebenchmark
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 364,07 tok/s TG Prefill 2.683 · TTFT 30.535 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 302,99 tok/s TG Prefill 2.480 · TTFT 36.311 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 291,20 tok/s TG Prefill 2.971 · TTFT 34.561 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 4 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 249,27 tok/s TG Prefill 1.839 · TTFT 45.580 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 5 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 197,25 tok/s TG Prefill 5.040 · TTFT 7.497 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 6 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 190,16 tok/s TG Prefill 2.465 · TTFT 9.980 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 7 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 183,48 tok/s TG Prefill 4.576 · TTFT 8.283 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 8 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 159,68 tok/s TG Prefill 2.983 · TTFT 10.578 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 9 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 158,21 tok/s TG Prefill 2.237 · TTFT 11.826 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 10 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 154,03 tok/s TG Prefill 1.071 · TTFT 74.122 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 11 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 153,61 tok/s TG Prefill 1.063 · TTFT 74.931 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 12 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 122,58 tok/s TG Prefill 1.677 · TTFT 15.124 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 13 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 111,56 tok/s TG Prefill 3.912 · TTFT 4.256 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 14 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 106,74 tok/s TG Prefill 3.548 · TTFT 4.684 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 15 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,80 tok/s TG Prefill 936 · TTFT 25.459 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 16 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 79,37 tok/s TG Prefill 1.020 · TTFT 24.303 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 17 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 71,02 tok/s TG Prefill 597 · TTFT 43.608 ms | 10× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 18 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 47,77 tok/s TG Prefill 2.291 · TTFT 1.070 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 19 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 44,78 tok/s TG Prefill 2.079 · TTFT 1.179 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 20 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 39,31 tok/s TG Prefill 1.618 · TTFT 1.513 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 21 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 38,26 tok/s TG Prefill 2.396 · TTFT 1.025 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 22 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 34,68 tok/s TG Prefill 490 · TTFT 25.082 ms | 5× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 23 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,25 tok/s TG Prefill 1.890 · TTFT 1.299 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 24 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,18 tok/s TG Prefill 261 · TTFT 255.650 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 25 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 24,54 tok/s TG Prefill 1.688 · TTFT 1.452 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawFP8 | Details → | |
| 26 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,84 tok/s TG Prefill 838 · TTFT 2.930 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 27 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 21,83 tok/s TG Prefill 830 · TTFT 2.957 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 28 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 20,18 tok/s TG Prefill 359 · TTFT 278.984 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliQ4_K_M | Details → | |
| 29 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,60 tok/s TG Prefill 427 · TTFT 182.825 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 30 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,19 tok/s TG Prefill 463 · TTFT 5.292 ms | 1× | AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 31 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 18,48 tok/s TG Prefill 410 · TTFT 83.981 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 32 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 14,12 tok/s TG Prefill 239 · TTFT 121.204 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 33 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,93 tok/s TG Prefill 341 · TTFT 124.817 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliQ4_K_M | Details → | |
| 34 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,62 tok/s TG Prefill 22 · TTFT 391.135 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 35 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,44 tok/s TG Prefill 22 · TTFT 390.695 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 36 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,43 tok/s TG Prefill 22 · TTFT 391.026 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 37 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,39 tok/s TG Prefill 22 · TTFT 390.917 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 38 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,18 tok/s TG Prefill 22 · TTFT 390.807 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 39 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,12 tok/s TG Prefill 22 · TTFT 390.191 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 40 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,61 tok/s TG Prefill 384 · TTFT 6.371 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketQ4_K_M | Details → | |
| 41 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,41 tok/s TG Prefill 229 · TTFT 10.683 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 42 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,05 tok/s TG Prefill 25 · TTFT 98.876 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 43 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,04 tok/s TG Prefill 25 · TTFT 98.887 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 44 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 3,04 tok/s TG Prefill 25 · TTFT 98.873 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 45 | Llama-3.3-Nemotron-Super-49B-v1.549BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 2,48 tok/s TG Prefill 301 · TTFT 8.129 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliQ4_K_M | Details → |
Agent- & Chat-Bewertung
Harnessbenchmark
Noch keine Harnessbenchmarks fuer dieses Modell.