Qwen (Alibaba)
Qwen2.5-Coder-7B-Instruct
Benchmark profile and published results.
Dense
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation256,7 tok/s
Min 0,0Ø 235,6Max 2.491,2
Ueber dem Durchschnitt · 4705 Systeme im Feld
Prefill10.123 tok/s
Min 4Ø 4.785Max 112.346
Ueber dem Durchschnitt · 4696 Systeme im Feld
Time to First Token762 ms
Min 20Ø 32.984Max 535.235
Ueber dem Durchschnitt · 4703 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen2.5-Coder-7B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 256,72 tok/s TG Prefill 10.123 · TTFT 3.280 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Qwen2.5-Coder-7B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 148,60 tok/s TG Prefill 7.309 · TTFT 1.923 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Qwen2.5-Coder-7B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,06 tok/s TG Prefill 3.402 · TTFT 762 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.