Poolside
Laguna-S-2.1117.6B
Benchmarkprofil und veröffentlichte Ergebnisse.
MoE117.6B
Einordnung im Feld
Bestwerte im Vergleich
Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.
Generation835,1 tok/s
Min 0,0Ø 245,9Max 2.491,2
Ueber dem Durchschnitt · 4828 Systeme im Feld
Prefill16.357 tok/s
Min 4Ø 4.871Max 112.346
Ueber dem Durchschnitt · 4812 Systeme im Feld
Time to First Token305 ms
Min 20Ø 32.261Max 535.235
Ueber dem Durchschnitt · 4825 Systeme im Feld
Performanceprofil
Durchsatz nach Hardware & Engine
Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.
GPUnach Grafikkarte
CPUnach Prozessor
AMD Ryzen 9 9950X 16-Core Processor 835,1 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 779,8 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 356,4 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 42,3 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 31,6 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 13,3 tok/s
Durchsatz & Latenz
Performancebenchmark
| # | Modell / Hersteller | Messwerte | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 835,13 tok/s TG Prefill 3.499 · TTFT 16.577 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 2 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 797,14 tok/s TG Prefill 3.616 · TTFT 16.087 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 3 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 791,09 tok/s TG Prefill 3.559 · TTFT 16.497 ms | 10× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 4 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 779,78 tok/s TG Prefill 3.841 · TTFT 16.300 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 5 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 776,08 tok/s TG Prefill 4.515 · TTFT 15.579 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 6 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 662,97 tok/s TG Prefill 2.731 · TTFT 19.776 ms | 10× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 7 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 470,52 tok/s TG Prefill 3.067 · TTFT 6.420 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 8 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 465,82 tok/s TG Prefill 3.019 · TTFT 6.496 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 9 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 461,99 tok/s TG Prefill 3.219 · TTFT 6.266 ms | 5× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 10 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 434,78 tok/s TG Prefill 3.944 · TTFT 5.525 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 11 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 415,35 tok/s TG Prefill 3.365 · TTFT 5.876 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 12 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 408,67 tok/s TG Prefill 2.354 · TTFT 8.049 ms | 5× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 13 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 356,42 tok/s TG Prefill 16.357 · TTFT 2.480 ms | 10× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 14 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 344,15 tok/s TG Prefill 15.326 · TTFT 2.709 ms | 10× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 15 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 250,44 tok/s TG Prefill 13.079 · TTFT 1.402 ms | 5× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 16 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 234,43 tok/s TG Prefill 11.921 · TTFT 1.518 ms | 5× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 17 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 146,11 tok/s TG Prefill 2.580 · TTFT 1.064 ms | 1× | NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 18 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,75 tok/s TG Prefill 3.130 · TTFT 877 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 19 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 135,51 tok/s TG Prefill 2.905 · TTFT 945 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 20 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 131,71 tok/s TG Prefill 2.197 · TTFT 1.250 ms | 1× | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 21 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 109,52 tok/s TG Prefill 5.943 · TTFT 462 ms | 1× | 2x NVIDIA RTX A6000 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 22 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 100,14 tok/s TG Prefill 4.429 · TTFT 645 ms | 1× | 2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 23 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 70,51 tok/s TG Prefill 5.970 · TTFT 7.475 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 24 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,33 tok/s TG Prefill 153 · TTFT 257.193 ms | 10× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 25 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 42,20 tok/s TG Prefill 4.890 · TTFT 4.010 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 26 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,70 tok/s TG Prefill 134 · TTFT 130.995 ms | 5× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 27 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,47 tok/s TG Prefill 97 · TTFT 309.056 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 28 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 32,27 tok/s TG Prefill 100 · TTFT 306.428 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 29 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,55 tok/s TG Prefill 174 · TTFT 246.888 ms | 10× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_M | Details → | |
| 30 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 31,51 tok/s TG Prefill 98 · TTFT 302.732 ms | 10× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 31 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,83 tok/s TG Prefill 87 · TTFT 185.676 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 32 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 29,65 tok/s TG Prefill 86 · TTFT 187.895 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 33 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 28,64 tok/s TG Prefill 89 · TTFT 183.222 ms | 5× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 34 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 25,54 tok/s TG Prefill 157 · TTFT 125.314 ms | 5× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_M | Details → | |
| 35 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,37 tok/s TG Prefill 8.629 · TTFT 305 ms | 1× | 3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclawINT4 | Details → | |
| 36 | Laguna-S-2.1117.6BPoolside Performancebenchmark | 13,37 tok/s TG Prefill 8.629 · TTFT 305 ms | 1× | 3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | godclawINT4 | Details → | |
| 37 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 13,32 tok/s TG Prefill 98 · TTFT 206.915 ms | 5× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_M | Details → | |
| 38 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 12,62 tok/s TG Prefill 130 · TTFT 21.118 ms | 1× | NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 39 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,64 tok/s TG Prefill 76 · TTFT 36.235 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 40 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,60 tok/s TG Prefill 76 · TTFT 36.406 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 41 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,44 tok/s TG Prefill 76 · TTFT 36.141 ms | 1× | 3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | llama.cppgodclawUD-Q4_K_M | Details → | |
| 42 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,87 tok/s TG Prefill 88 · TTFT 196.186 ms | 10× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_M | Details → | |
| 43 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 9,06 tok/s TG Prefill 156 · TTFT 17.644 ms | 1× | NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAM | llama.cppwebsocketUD-Q4_K_M | Details → | |
| 44 | Laguna-S-2.1117.6BPoolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation) | 4,80 tok/s TG Prefill 100 · TTFT 27.502 ms | 1× | NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAM | llama.cppcodex_cliUD-Q4_K_M | Details → |
Agent- & Chat-Bewertung
Harnessbenchmark
Noch keine Harnessbenchmarks fuer dieses Modell.