Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Poolside

Laguna-M.1

Benchmarkprofil und veröffentlichte Ergebnisse.

Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation337,6 tok/s
Min 0,0Ø 248,3Max 2.491,2
Ueber dem Durchschnitt · 3969 Systeme im Feld
Prefill2.260 tok/s
Min 4Ø 4.741Max 55.260
Unter dem Durchschnitt · 3969 Systeme im Feld
Time to First Token1.681 ms
Min 20Ø 33.962Max 535.235
Ueber dem Durchschnitt · 3967 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

4383292191100,008121.6252.437Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 337,6 tok/s Generation, 1.966 tok/s Prefill, TTFT 19.640 ms (13 Laufe)NVIDIA RTX PRO 6000 B...AMD Radeon AI PRO R9700 - 8,2 tok/s Generation, 31 tok/s Prefill, TTFT 222.479 ms (9 Laufe)AMD Radeon AI PRO R97...NVIDIA GeForce RTX 5070 Ti - 7,0 tok/s Generation, 60 tok/s Prefill, TTFT 116.585 ms (12 Laufe)NVIDIA GeForce RTX 50...NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 5,8 tok/s Generation, 49 tok/s Prefill, TTFT 158.145 ms (5 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA GeForce RTX 5090 - 4,2 tok/s Generation, 37 tok/s Prefill, TTFT 169.257 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 3090 Ti - 3,1 tok/s Generation, 6 tok/s Prefill, TTFT 392.752 ms (35 Laufe)NVIDIA GeForce RTX 30...
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 337,6 tok/sAMD Radeon AI PRO R9700 8,2 tok/sNVIDIA GeForce RTX 5070 Ti 7,0 tok/sNVIDIA RTX PRO 6000 Blackwell Workstation Edition 5,8 tok/sNVIDIA GeForce RTX 5090 4,2 tok/sNVIDIA GeForce RTX 3090 Ti 3,1 tok/s

CPUnach Prozessor

4383292191100,008121.6252.437Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 9965WX 24-Cores - 337,6 tok/s Generation, 1.966 tok/s Prefill, TTFT 19.640 ms (13 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 8,2 tok/s Generation, 31 tok/s Prefill, TTFT 222.479 ms (9 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 7,0 tok/s Generation, 60 tok/s Prefill, TTFT 116.585 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 9950X 16-Core Processor - 5,8 tok/s Generation, 49 tok/s Prefill, TTFT 158.145 ms (5 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen 7 5800X3D 8-Core Processor - 4,2 tok/s Generation, 37 tok/s Prefill, TTFT 169.257 ms (3 Laufe)AMD Ryzen 7 5800X3D 8...AMD Ryzen 9 8945HX with Radeon Graphics - 3,1 tok/s Generation, 6 tok/s Prefill, TTFT 392.752 ms (35 Laufe)AMD Ryzen 9 8945HX wi...
AMD Ryzen Threadripper PRO 9965WX 24-Cores 337,6 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 8,2 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 7,0 tok/sAMD Ryzen 9 9950X 16-Core Processor 5,8 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 4,2 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 3,1 tok/s

ENGnach Engine

371354338321304331345359373Prefill (tok/s)Generation (tok/s)llama.cpp - 337,6 tok/s Generation, 352 tok/s Prefill, TTFT 242.876 ms (77 Laufe)llama.cpp
llama.cpp 337,6 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
337,60 tok/s TG
Prefill 2.103 · TTFT 37.017 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
2Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,72 tok/s TG
Prefill 2.246 · TTFT 36.915 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
3Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,41 tok/s TG
Prefill 2.100 · TTFT 37.421 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
334,40 tok/s TG
Prefill 2.260 · TTFT 36.888 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
321,42 tok/s TG
Prefill 2.147 · TTFT 37.376 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,66 tok/s TG
Prefill 2.017 · TTFT 12.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
7Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,49 tok/s TG
Prefill 2.071 · TTFT 12.702 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
8Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
187,27 tok/s TG
Prefill 2.011 · TTFT 12.859 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
9Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
186,37 tok/s TG
Prefill 1.992 · TTFT 12.967 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
183,76 tok/s TG
Prefill 1.927 · TTFT 13.105 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,93 tok/s TG
Prefill 1.616 · TTFT 1.681 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
12Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,48 tok/s TG
Prefill 1.516 · TTFT 1.792 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
13Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
67,38 tok/s TG
Prefill 1.555 · TTFT 1.746 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
14Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,16 tok/s TG
Prefill 31 · TTFT 286.772 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
15Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,98 tok/s TG
Prefill 31 · TTFT 288.357 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
16Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,93 tok/s TG
Prefill 31 · TTFT 288.198 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
17Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,05 tok/s TG
Prefill 31 · TTFT 286.662 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
18Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,00 tok/s TG
Prefill 59 · TTFT 151.350 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
19Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,93 tok/s TG
Prefill 59 · TTFT 150.457 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
20Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,90 tok/s TG
Prefill 31 · TTFT 291.485 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
21Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,87 tok/s TG
Prefill 31 · TTFT 286.032 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
22Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,50 tok/s TG
Prefill 57 · TTFT 152.613 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
23Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,28 tok/s TG
Prefill 53 · TTFT 164.092 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
24Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,98 tok/s TG
Prefill 61 · TTFT 44.934 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
25Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,93 tok/s TG
Prefill 58 · TTFT 151.267 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
26Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,86 tok/s TG
Prefill 66 · TTFT 40.934 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
27Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,84 tok/s TG
Prefill 66 · TTFT 41.139 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
28Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,80 tok/s TG
Prefill 59 · TTFT 150.829 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
29Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,80 tok/s TG
Prefill 65 · TTFT 41.504 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
30Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,77 tok/s TG
Prefill 48 · TTFT 182.972 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
31Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,09 tok/s TG
Prefill 30 · TTFT 89.440 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
32Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,06 tok/s TG
Prefill 29 · TTFT 94.249 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
33Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
5,03 tok/s TG
Prefill 30 · TTFT 91.117 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
34Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,97 tok/s TG
Prefill 45 · TTFT 191.746 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
35Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,81 tok/s TG
Prefill 55 · TTFT 158.303 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
36Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,80 tok/s TG
Prefill 49 · TTFT 183.700 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
37Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,20 tok/s TG
Prefill 50 · TTFT 181.487 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
38Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,20 tok/s TG
Prefill 57 · TTFT 151.603 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
39Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,17 tok/s TG
Prefill 41 · TTFT 216.967 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
40Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,03 tok/s TG
Prefill 42 · TTFT 216.252 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
41Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,08 tok/s TG
Prefill 8 · TTFT 281.078 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
42Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,01 tok/s TG
Prefill 5 · TTFT 397.363 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
43Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,98 tok/s TG
Prefill 5 · TTFT 410.515 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
44Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,98 tok/s TG
Prefill 5 · TTFT 408.262 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
45Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,98 tok/s TG
Prefill 5 · TTFT 416.638 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
46Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,97 tok/s TG
Prefill 5 · TTFT 395.460 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
47Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,96 tok/s TG
Prefill 5 · TTFT 418.804 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
48Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,95 tok/s TG
Prefill 5 · TTFT 428.772 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
49Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,92 tok/s TG
Prefill 5 · TTFT 406.612 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
50Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,91 tok/s TG
Prefill 5 · TTFT 408.023 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
51Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,91 tok/s TG
Prefill 5 · TTFT 413.865 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
52Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,90 tok/s TG
Prefill 5 · TTFT 429.316 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
53Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,90 tok/s TG
Prefill 5 · TTFT 409.419 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
54Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,89 tok/s TG
Prefill 6 · TTFT 385.101 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
55Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,88 tok/s TG
Prefill 5 · TTFT 401.414 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
56Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,88 tok/s TG
Prefill 5 · TTFT 405.191 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
57Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,86 tok/s TG
Prefill 5 · TTFT 399.841 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
58Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,85 tok/s TG
Prefill 5 · TTFT 407.941 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
59Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,84 tok/s TG
Prefill 5 · TTFT 423.222 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
60Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,84 tok/s TG
Prefill 5 · TTFT 401.206 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
61Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,83 tok/s TG
Prefill 5 · TTFT 410.851 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
62Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,81 tok/s TG
Prefill 5 · TTFT 459.880 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
63Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,81 tok/s TG
Prefill 5 · TTFT 410.587 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
64Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,80 tok/s TG
Prefill 5 · TTFT 407.953 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
65Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,79 tok/s TG
Prefill 5 · TTFT 414.339 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
66Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,76 tok/s TG
Prefill 5 · TTFT 397.216 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
67Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,71 tok/s TG
Prefill 5 · TTFT 392.723 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
68Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,68 tok/s TG
Prefill 5 · TTFT 412.837 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
69Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,65 tok/s TG
Prefill 5 · TTFT 428.043 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
70Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,63 tok/s TG
Prefill 53 · TTFT 50.822 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
71Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,06 tok/s TG
Prefill 8 · TTFT 255.194 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
72Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,92 tok/s TG
Prefill 8 · TTFT 253.028 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
73Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,76 tok/s TG
Prefill 8 · TTFT 264.875 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
74Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,57 tok/s TG
Prefill 5 · TTFT 411.512 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppcodex_cliQ4_K_M
75Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,52 tok/s TG
Prefill 5 · TTFT 387.271 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
76Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,51 tok/s TG
Prefill 5 · TTFT 391.984 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
77Laguna-M.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
0,30 tok/s TG
Prefill 29 · TTFT 74.552 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.