Qwen (Alibaba)
Qwen2.5-Coder-7B-Instruct
Benchmark profile and published results.
Dense
Position in the field
Best values compared
Best metrics of this model against the minimum, average and maximum of all published systems.
Generation256,7 tok/s
Min 0,1Ø 159,1Max 717,6
Ueber dem Durchschnitt · 361 Systeme im Feld
Prefill10.123 tok/s
Min 39Ø 5.819Max 52.503
Ueber dem Durchschnitt · 361 Systeme im Feld
Time to First Token762 ms
Min 156Ø 18.353Max 354.928
Ueber dem Durchschnitt · 361 Systeme im Feld
Performance profile
Throughput by hardware & engine
Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.
Throughput & latency
Performance benchmark
| # | Model / Maker | Metrics | Parallel | GPU / CPU / RAM | Runtime | ||
|---|---|---|---|---|---|---|---|
| 1 | Qwen2.5-Coder-7B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 256,72 tok/s TG Prefill 10.123 · TTFT 3.280 ms | 10× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 2 | Qwen2.5-Coder-7B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 148,60 tok/s TG Prefill 7.309 · TTFT 1.923 ms | 5× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → | |
| 3 | Qwen2.5-Coder-7B-InstructQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) | 81,06 tok/s TG Prefill 3.402 · TTFT 762 ms | 1× | 2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAM | llama.cppgodclawQ4_K_M | Details → |
Agent & chat rating
Harness benchmark
Noch keine Harnessbenchmarks fuer dieses Modell.