Qwen (Alibaba)

Qwen2.5-0.5B-Instruct

Name: Qwen2.5-0.5B-Instruct
Author: Qwen (Alibaba)

Benchmark profile and published results.

Dense

Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation19,6 tok/s

Min 0,0Ø 7,3Max 70,9

Ueber dem Durchschnitt · 78 Systeme im Feld

Prefill171 tok/s

Min 4Ø 70Max 273

Ueber dem Durchschnitt · 78 Systeme im Feld

Time to First Token29.146 ms

Min 569Ø 162.646Max 506.953

Ueber dem Durchschnitt · 78 Systeme im Feld

Performance profile

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

CPU-only 19,6 tok/s

4 x Cortex-A78C + 4 x Cortex-A55 19,6 tok/s

llama.cpp 19,6 tok/s

Throughput & latency

Metric:

#	Model / Maker	Metrics	Parallel	GPU / CPU / RAM	Runtime
1	Qwen2.5-0.5B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	19,64 tok/s TG Prefill 135 · TTFT 103.828 ms	5×	Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM	llama.cppopenclaw_cliQ4_K_M	Details →
2	Qwen2.5-0.5B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	19,33 tok/s TG Prefill 171 · TTFT 178.576 ms	10×	Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM	llama.cppopenclaw_cliQ4_K_M	Details →
3	Qwen2.5-0.5B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)	11,74 tok/s TG Prefill 85 · TTFT 29.146 ms	1×	Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM	llama.cppopenclaw_cliQ4_K_M	Details →

Agent & chat rating

Noch keine Harnessbenchmarks fuer dieses Modell.