Qwen (Alibaba)
Qwen2.5-0.5B-Instruct
Benchmark profile and published results.
Dense
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation19,6 tok/s
Min 0,0Ø 235,6Max 2.491,2
Unter dem Durchschnitt · 4705 Systeme im Feld
Prefill171 tok/s
Min 4Ø 4.785Max 112.346
Unter dem Durchschnitt · 4696 Systeme im Feld
Time to First Token29.146 ms
Min 20Ø 32.984Max 535.235
Ueber dem Durchschnitt · 4703 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen2.5-0.5B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,64 tok/s TG Prefill 135 · TTFT 103.828 ms | 5× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 2 | Qwen2.5-0.5B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 19,33 tok/s TG Prefill 171 · TTFT 178.576 ms | 10× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → | |
| 3 | Qwen2.5-0.5B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 11,74 tok/s TG Prefill 85 · TTFT 29.146 ms | 1× | Keine GPU (CPU-only) i4 x Cortex-A78C + 4 x Cortex-A55 · 15 GB RAM | llama.cppopenclaw_cliQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.