Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DeepReinforce

Ornith-1.0-35B35B

Benchmark profile and published results.

Dense35B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation1.799,4 tok/s
Min 9,4Ø 555,4Max 2.143,6
Ueber dem Durchschnitt · 512 Systeme im Feld
Prefill9.192 tok/s
Min 28Ø 6.219Max 21.843
Ueber dem Durchschnitt · 512 Systeme im Feld
Time to First Token385 ms
Min 59Ø 9.221Max 168.314
Ueber dem Durchschnitt · 512 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

2.2971.7231.1485740,002.6645.3297.993Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 1.799,4 tok/s Generation, 6.587 tok/s Prefill, TTFT 3.899 ms (9 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 1.607,5 tok/s Generation, 6.349 tok/s Prefill, TTFT 3.508 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 1.556,7 tok/s Generation, 5.085 tok/s Prefill, TTFT 3.918 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 920,2 tok/s Generation, 3.340 tok/s Prefill, TTFT 6.459 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA GeForce RTX 5070 Ti - 309,0 tok/s Generation, 972 tok/s Prefill, TTFT 20.166 ms (3 Laufe)NVIDIA GeForce RTX 50...AMD Radeon AI PRO R9700 - 216,9 tok/s Generation, 1.446 tok/s Prefill, TTFT 42.722 ms (15 Laufe)AMD Radeon AI PRO R97...AMD Radeon PRO W7900 Dual Slot - 211,5 tok/s Generation, 2.131 tok/s Prefill, TTFT 4.814 ms (3 Laufe)AMD Radeon PRO W7900 ...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 1.799,4 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 1.607,5 tok/sNVIDIA GeForce RTX 5090 1.556,7 tok/sNVIDIA GeForce RTX 3090 Ti 920,2 tok/sNVIDIA GeForce RTX 5070 Ti 309,0 tok/sAMD Radeon AI PRO R9700 216,9 tok/sAMD Radeon PRO W7900 Dual Slot 211,5 tok/s

CPUby processor

2.2961.7221.1485740,01252.7195.3137.907Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 9965WX 24-Cores - 1.799,4 tok/s Generation, 6.587 tok/s Prefill, TTFT 3.899 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 9950X 16-Core Processor - 1.607,5 tok/s Generation, 6.349 tok/s Prefill, TTFT 3.508 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 7 5800X3D 8-Core Processor - 1.556,7 tok/s Generation, 5.085 tok/s Prefill, TTFT 3.918 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 8945HX with Radeon Graphics - 920,2 tok/s Generation, 3.340 tok/s Prefill, TTFT 6.459 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 309,0 tok/s Generation, 1.551 tok/s Prefill, TTFT 12.490 ms (6 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 216,9 tok/s Generation, 1.446 tok/s Prefill, TTFT 42.722 ms (15 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 9965WX 24-Cores 1.799,4 tok/sAMD Ryzen 9 9950X 16-Core Processor 1.607,5 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 1.556,7 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 920,2 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 309,0 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 216,9 tok/s

ENGby engine

1.9791.8891.7991.7091.6193.2443.3823.5203.658Prefill (tok/s)Generation (tok/s)llama.cpp - 1.799,4 tok/s Generation, 3.451 tok/s Prefill, TTFT 20.321 ms (39 Laufe)llama.cpp
llama.cpp 1.799,4 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.799,41 tok/s TG
Prefill 9.192 · TTFT 8.876 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
2Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.607,48 tok/s TG
Prefill 7.448 · TTFT 7.492 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
3Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.556,71 tok/s TG
Prefill 6.275 · TTFT 8.228 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
4Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.447,27 tok/s TG
Prefill 8.138 · TTFT 7.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1.400,99 tok/s TG
Prefill 6.038 · TTFT 8.703 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
920,16 tok/s TG
Prefill 3.818 · TTFT 13.771 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
7Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
882,70 tok/s TG
Prefill 6.523 · TTFT 2.651 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
8Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
867,90 tok/s TG
Prefill 5.424 · TTFT 2.985 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
9Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
794,89 tok/s TG
Prefill 5.470 · TTFT 3.060 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
780,58 tok/s TG
Prefill 7.221 · TTFT 2.850 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
762,69 tok/s TG
Prefill 8.704 · TTFT 2.484 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
517,07 tok/s TG
Prefill 3.355 · TTFT 4.929 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
13Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
309,02 tok/s TG
Prefill 1.120 · TTFT 42.243 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
14Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
295,61 tok/s TG
Prefill 3.556 · TTFT 542 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
15Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
292,74 tok/s TG
Prefill 5.076 · TTFT 381 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
16Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
266,28 tok/s TG
Prefill 4.441 · TTFT 434 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
264,61 tok/s TG
Prefill 5.077 · TTFT 385 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
18Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
240,47 tok/s TG
Prefill 5.000 · TTFT 386 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
19Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
216,85 tok/s TG
Prefill 3.842 · TTFT 5.955 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
20Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,46 tok/s TG
Prefill 2.663 · TTFT 8.403 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
21Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
210,36 tok/s TG
Prefill 3.683 · TTFT 5.472 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
22Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,38 tok/s TG
Prefill 940 · TTFT 16.001 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
23Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
184,15 tok/s TG
Prefill 2.849 · TTFT 676 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
24Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
181,28 tok/s TG
Prefill 3.620 · TTFT 2.799 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
25Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
179,04 tok/s TG
Prefill 2.033 · TTFT 4.903 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
26Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
173,97 tok/s TG
Prefill 3.522 · TTFT 2.513 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
27Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
104,78 tok/s TG
Prefill 284 · TTFT 139.519 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
28Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,53 tok/s TG
Prefill 283 · TTFT 140.845 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
29Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,11 tok/s TG
Prefill 282 · TTFT 141.242 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
30Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
91,41 tok/s TG
Prefill 1.698 · TTFT 1.137 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
31Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,58 tok/s TG
Prefill 2.449 · TTFT 787 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
32Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
70,57 tok/s TG
Prefill 2.415 · TTFT 713 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
33Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
69,03 tok/s TG
Prefill 856 · TTFT 2.253 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
34Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,81 tok/s TG
Prefill 239 · TTFT 56.818 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
35Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,49 tok/s TG
Prefill 238 · TTFT 57.323 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
36Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
62,07 tok/s TG
Prefill 238 · TTFT 57.464 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
37Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,33 tok/s TG
Prefill 200 · TTFT 9.642 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
38Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
25,10 tok/s TG
Prefill 193 · TTFT 10.006 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
39Ornith-1.0-35B35BDeepReinforce Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,98 tok/s TG
Prefill 199 · TTFT 9.735 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.