Poolside

Laguna-XS-2.1-INT433.4B

Name: Laguna-XS-2.1-INT4
Author: Poolside

Benchmark profile and published results.

MoE33.4B

Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation26,9 tok/s

Min 0,0Ø 245,9Max 2.491,2

Unter dem Durchschnitt · 4828 Systeme im Feld

Prefill3.698 tok/s

Min 4Ø 4.871Max 112.346

Unter dem Durchschnitt · 4812 Systeme im Feld

Time to First Token748 ms

Min 20Ø 32.261Max 535.235

Ueber dem Durchschnitt · 4825 Systeme im Feld

Performance profile

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

AMD Radeon AI PRO R9700 26,9 tok/s

AMD Ryzen Threadripper PRO 7955WX 16-Cores 26,9 tok/s

vLLM 26,9 tok/sunbekannt 26,9 tok/s

Throughput & latency

Metric:

	#	Model / Maker	Metrics	Parallel	GPU / CPU / RAM	Runtime
	1	Laguna-XS-2.1-INT433.4BPoolside Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	26,88 tok/s TG Prefill 3.698 · TTFT 748 ms	1×	3x AMD Radeon AI PRO R9700 iAMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM	vLLMgodclawINT4	Details →
	2	Laguna-XS-2.1-INT433.4BPoolside Performance benchmark	26,88 tok/s TG Prefill 3.698 · TTFT 748 ms	1×	3x AMD Radeon AI PRO R9700 i32x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM	godclawINT4	Details →

Agent & chat rating

Noch keine Harnessbenchmarks fuer dieses Modell.