Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
OpenAI

gpt-oss-120b120B

Benchmarkprofil und veröffentlichte Ergebnisse.

MoE120B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation1.335,9 tok/s
Min 0,0Ø 518,2Max 2.414,4
Ueber dem Durchschnitt · 244 Systeme im Feld
Prefill6.805 tok/s
Min 7Ø 6.972Max 39.029
Unter dem Durchschnitt · 244 Systeme im Feld
Time to First Token568 ms
Min 114Ø 27.182Max 354.674
Ueber dem Durchschnitt · 244 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

1.7361.3028684340,002.6035.2067.808Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 1.335,9 tok/s Generation, 5.805 tok/s Prefill, TTFT 4.872 ms (5 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.229,7 tok/s Generation, 6.303 tok/s Prefill, TTFT 4.302 ms (12 Laufe)NVIDIA RTX PRO 6000 B...AMD Radeon PRO W7900 Dual Slot - 216,2 tok/s Generation, 1.083 tok/s Prefill, TTFT 9.148 ms (3 Laufe)AMD Radeon PRO W7900 ...AMD Radeon AI PRO R9700 - 107,0 tok/s Generation, 1.057 tok/s Prefill, TTFT 67.151 ms (13 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 3090 Ti - 85,3 tok/s Generation, 238 tok/s Prefill, TTFT 79.784 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA GeForce RTX 5070 Ti - 60,1 tok/s Generation, 195 tok/s Prefill, TTFT 69.936 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 5090 - 42,3 tok/s Generation, 239 tok/s Prefill, TTFT 76.971 ms (5 Laufe)NVIDIA GeForce RTX 50...Intel Arc Pro B70 - 32,4 tok/s Generation, 47 tok/s Prefill, TTFT 184.310 ms (3 Laufe)Intel Arc Pro B70NVIDIA GeForce RTX 2060 - 5,3 tok/s Generation, 42 tok/s Prefill, TTFT 165.568 ms (3 Laufe)NVIDIA GeForce RTX 20...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.335,9 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.229,7 tok/sAMD Radeon PRO W7900 Dual Slot 216,2 tok/sAMD Radeon AI PRO R9700 107,0 tok/sNVIDIA GeForce RTX 3090 Ti 85,3 tok/sNVIDIA GeForce RTX 5070 Ti 60,1 tok/sNVIDIA GeForce RTX 5090 42,3 tok/sIntel Arc Pro B70 32,4 tok/sNVIDIA GeForce RTX 2060 5,3 tok/s

CPUnach Prozessor

1.7361.3028684340,002.6035.2067.808Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 1.335,9 tok/s Generation, 5.805 tok/s Prefill, TTFT 4.872 ms (5 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 1.229,7 tok/s Generation, 6.303 tok/s Prefill, TTFT 4.302 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 216,2 tok/s Generation, 639 tok/s Prefill, TTFT 39.542 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 107,0 tok/s Generation, 1.057 tok/s Prefill, TTFT 67.151 ms (13 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 85,3 tok/s Generation, 238 tok/s Prefill, TTFT 79.784 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 7 5800X3D 8-Core Processor - 42,3 tok/s Generation, 239 tok/s Prefill, TTFT 76.971 ms (5 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 7945HX with Radeon Graphics - 32,4 tok/s Generation, 47 tok/s Prefill, TTFT 184.310 ms (3 Laufe)AMD Ryzen 9 7945HX wi...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 5,3 tok/s Generation, 42 tok/s Prefill, TTFT 165.568 ms (3 Laufe)Intel(R) Xeon(R) CPU ...
AMD Ryzen 9 9950X 16-Core Processor 1.335,9 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 1.229,7 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 216,2 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 107,0 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 85,3 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 42,3 tok/sAMD Ryzen 9 7945HX with Radeon Graphics 32,4 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 5,3 tok/s

ENGnach Engine

1.7321.2998664330,01.2352.0082.7813.554Prefill (tok/s)Generation (tok/s)llama.cpp - 1.335,9 tok/s Generation, 2.514 tok/s Prefill, TTFT 62.788 ms (45 Laufe)llama.cppunbekannt - 99,8 tok/s Generation, 3.110 tok/s Prefill, TTFT 789 ms (2 Laufe)unbekanntvLLM - 21,5 tok/s Generation, 1.679 tok/s Prefill, TTFT 10.998 ms (3 Laufe)vLLM
llama.cpp 1.335,9 tok/sunbekannt 99,8 tok/svLLM 21,5 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.335,85 tok/s TG
Prefill 6.805 · TTFT 8.787 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
2gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.274,68 tok/s TG
Prefill 6.447 · TTFT 8.887 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
3gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.229,72 tok/s TG
Prefill 9.543 · TTFT 8.771 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.220,77 tok/s TG
Prefill 7.425 · TTFT 9.155 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.214,90 tok/s TG
Prefill 7.954 · TTFT 9.043 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.122,29 tok/s TG
Prefill 5.433 · TTFT 10.439 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
7gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
774,35 tok/s TG
Prefill 5.796 · TTFT 3.127 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
8gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
765,17 tok/s TG
Prefill 6.482 · TTFT 2.990 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
9gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
706,49 tok/s TG
Prefill 8.061 · TTFT 2.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
706,35 tok/s TG
Prefill 8.636 · TTFT 2.783 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
704,20 tok/s TG
Prefill 6.832 · TTFT 3.038 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
684,36 tok/s TG
Prefill 4.762 · TTFT 3.642 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
13gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
281,92 tok/s TG
Prefill 3.493 · TTFT 568 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
14gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
251,59 tok/s TG
Prefill 5.195 · TTFT 382 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
15gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,58 tok/s TG
Prefill 4.273 · TTFT 463 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
16gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
250,33 tok/s TG
Prefill 3.723 · TTFT 540 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
247,47 tok/s TG
Prefill 3.802 · TTFT 520 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
18gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
216,16 tok/s TG
Prefill 1.128 · TTFT 8.806 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
19gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
209,75 tok/s TG
Prefill 1.247 · TTFT 16.274 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
20gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,02 tok/s TG
Prefill 173 · TTFT 186.661 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
21gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,85 tok/s TG
Prefill 172 · TTFT 186.714 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
22gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
105,39 tok/s TG
Prefill 170 · TTFT 189.655 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
23gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
101,58 tok/s TG
Prefill 874 · TTFT 2.364 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
24gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,77 tok/s TG
Prefill 1.920 · TTFT 1.022 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
25gpt-oss-120b120BOpenAI Performancebenchmark
99,77 tok/s TG
Prefill 1.920 · TTFT 1.022 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_M
26gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
85,33 tok/s TG
Prefill 270 · TTFT 166.013 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
27gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
63,33 tok/s TG
Prefill 138 · TTFT 85.637 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
28gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
62,02 tok/s TG
Prefill 136 · TTFT 86.915 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
29gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
61,91 tok/s TG
Prefill 137 · TTFT 86.144 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
30gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
60,05 tok/s TG
Prefill 224 · TTFT 126.906 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
31gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
53,10 tok/s TG
Prefill 190 · TTFT 71.280 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
32gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
51,30 tok/s TG
Prefill 232 · TTFT 64.035 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
33gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
42,26 tok/s TG
Prefill 170 · TTFT 234.298 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
34gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,41 tok/s TG
Prefill 50 · TTFT 226.449 ms
5×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
35gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
30,26 tok/s TG
Prefill 149 · TTFT 103.687 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
36gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
26,57 tok/s TG
Prefill 50 · TTFT 276.964 ms
10×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
37gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,08 tok/s TG
Prefill 124 · TTFT 15.977 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
38gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,82 tok/s TG
Prefill 123 · TTFT 16.131 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
39gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
23,79 tok/s TG
Prefill 124 · TTFT 15.976 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
40gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,48 tok/s TG
Prefill 4.300 · TTFT 556 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclaw4-Bit
41gpt-oss-120b120BOpenAI Performancebenchmark
21,48 tok/s TG
Prefill 4.300 · TTFT 556 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclaw
42gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
21,12 tok/s TG
Prefill 213 · TTFT 9.303 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
43gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,92 tok/s TG
Prefill 170 · TTFT 11.622 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
44gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
13,32 tok/s TG
Prefill 405 · TTFT 26.375 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cli
45gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,82 tok/s TG
Prefill 40 · TTFT 49.516 ms
1×Intel Arc Pro B70AMD Ryzen 9 7945HX with Radeon Graphics · 29 GB RAMllama.cppopenclaw_cliQ4_K_M
46gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,57 tok/s TG
Prefill 137 · TTFT 14.433 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
47gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,46 tok/s TG
Prefill 333 · TTFT 6.064 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cli
48gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,29 tok/s TG
Prefill 56 · TTFT 189.966 ms
5×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
49gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,46 tok/s TG
Prefill 50 · TTFT 39.304 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
50gpt-oss-120b120BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,05 tok/s TG
Prefill 20 · TTFT 267.436 ms
10×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.