Poolside

Laguna-XS-2.1-INT433.4B

Name: Laguna-XS-2.1-INT4
Author: Poolside

Benchmark profile and published results.

MoE33.4B

Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation26,9 tok/s

Min 0,0Ø 77,4Max 667,0

Unter dem Durchschnitt · 978 Systeme im Feld

Prefill3.698 tok/s

Min 4Ø 2.302Max 35.719

Ueber dem Durchschnitt · 978 Systeme im Feld

Time to First Token748 ms

Min 31Ø 57.832Max 535.235

Ueber dem Durchschnitt · 976 Systeme im Feld

Performance profile

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

AMD Radeon AI PRO R9700 26,9 tok/s

AMD Ryzen Threadripper PRO 7955WX 16-Cores 26,9 tok/s

vLLM 26,9 tok/sunbekannt 26,9 tok/s

Throughput & latency

Metric:

	#	Model / Maker	Metrics	Parallel	GPU / CPU / RAM	Runtime
	1	Laguna-XS-2.1-INT433.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	26,88 tok/s TG Prefill 3.698 · TTFT 748 ms	1×	3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM	vLLMgodclawINT4	Details →
	2	Laguna-XS-2.1-INT433.4BPoolside Performance benchmark	26,88 tok/s TG Prefill 3.698 · TTFT 748 ms	1×	3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM	godclawINT4	Details →

Agent & chat rating

Noch keine Harnessbenchmarks fuer dieses Modell.