Created bymario-alka.dePowered bynoob2claw.detricoma.de
Qwen (Alibaba)

Qwen3-14B14B

Benchmark profile and published results.

Dense14B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation280,8 tok/s
Min 0,1Ø 159,1Max 717,6
Ueber dem Durchschnitt · 361 Systeme im Feld
Prefill8.760 tok/s
Min 39Ø 5.819Max 52.503
Ueber dem Durchschnitt · 361 Systeme im Feld
Time to First Token748 ms
Min 156Ø 18.353Max 354.928
Ueber dem Durchschnitt · 361 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

36327218190,70,001.7093.4185.127Prefill (tok/s)Generation (tok/s)AMD Radeon RX 7900 XTX - 280,8 tok/s Generation, 4.162 tok/s Prefill, TTFT 3.605 ms (9 Laufe)AMD Radeon RX 7900 XTXCPU-only - 15,5 tok/s Generation, 423 tok/s Prefill, TTFT 6.536 ms (2 Laufe)CPU-onlyAMD Oberon (PlayStation 5) - 10,6 tok/s Generation, 185 tok/s Prefill, TTFT 13.217 ms (1 Lauf)AMD Oberon (PlayStati...
AMD Radeon RX 7900 XTX 280,8 tok/sCPU-only 15,5 tok/sAMD Oberon (PlayStation 5) 10,6 tok/s

CPUby processor

36327218190,70,001.9413.8825.823Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 3955WX 16-Cores - 280,8 tok/s Generation, 4.723 tok/s Prefill, TTFT 3.358 ms (6 Laufe)AMD Ryzen Threadrippe...Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz - 186,9 tok/s Generation, 3.038 tok/s Prefill, TTFT 4.101 ms (3 Laufe)Intel(R) Xeon(R) CPU ...Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) - 15,5 tok/s Generation, 525 tok/s Prefill, TTFT 4.974 ms (1 Lauf)Apple M6 (unified CPU...Apple M6 (unified CPU/GPU SoC) - 14,0 tok/s Generation, 321 tok/s Prefill, TTFT 8.097 ms (1 Lauf)Apple M6 (unified CPU...AMD Zen2 8-Core (PlayStation 5) - 10,6 tok/s Generation, 185 tok/s Prefill, TTFT 13.217 ms (1 Lauf)AMD Zen2 8-Core (Play...
AMD Ryzen Threadripper PRO 3955WX 16-Cores 280,8 tok/sIntel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz 186,9 tok/sApple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) 15,5 tok/sApple M6 (unified CPU/GPU SoC) 14,0 tok/sAMD Zen2 8-Core (PlayStation 5) 10,6 tok/s

ENGby engine

36227218190,60,002.6155.2297.844Prefill (tok/s)Generation (tok/s)vLLM - 280,8 tok/s Generation, 6.373 tok/s Prefill, TTFT 2.764 ms (3 Laufe)vLLMllama.cpp - 189,6 tok/s Generation, 2.646 tok/s Prefill, TTFT 5.339 ms (7 Laufe)llama.cpplmstudio-mlx - 15,5 tok/s Generation, 525 tok/s Prefill, TTFT 4.974 ms (1 Lauf)lmstudio-mlxOllama - 14,0 tok/s Generation, 321 tok/s Prefill, TTFT 8.097 ms (1 Lauf)Ollama
vLLM 280,8 tok/sllama.cpp 189,6 tok/slmstudio-mlx 15,5 tok/sOllama 14,0 tok/s
Throughput & latency

Performance benchmark

Metric:
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
280,80 tok/s TG
Prefill 8.760 · TTFT 5.247 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
2Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
198,18 tok/s TG
Prefill 7.101 · TTFT 2.296 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
3Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
189,57 tok/s TG
Prefill 4.215 · TTFT 6.476 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
4Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
186,94 tok/s TG
Prefill 4.086 · TTFT 6.892 ms
10×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
5Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
113,91 tok/s TG
Prefill 2.991 · TTFT 4.155 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
6Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,74 tok/s TG
Prefill 2.967 · TTFT 4.204 ms
5×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
7Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
49,73 tok/s TG
Prefill 2.063 · TTFT 1.206 ms
1×2x AMD Radeon RX 7900 XTX i4x Intel(R) Xeon(R) CPU E5-4657L v2 @ 2.40GHz · 504 GB RAMllama.cppgodclawQ4_K_M
8Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
47,29 tok/s TG
Prefill 2.015 · TTFT 1.225 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMllama.cppgodclawQ4_K_M
9Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,22 tok/s TG
Prefill 3.257 · TTFT 748 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 63 GB RAMvLLMgodclaw
10Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,53 tok/s TG
Prefill 525 · TTFT 4.974 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC, ARM64, AdvSIMD) · 24 GB RAMlmstudio-mlxlmstudioMLX 4bit
11Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,03 tok/s TG
Prefill 321 · TTFT 8.097 ms
1×Keine GPU (CPU-only)Apple M6 (unified CPU/GPU SoC) · 24 GB RAMOllamaopenclaw_cliQ4_K_M
12Qwen3-14B14BQwen (Alibaba) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
10,58 tok/s TG
Prefill 185 · TTFT 13.217 ms
1×AMD Oberon (PlayStation 5)AMD Zen2 8-Core (PlayStation 5) · 16 GB RAMllama.cppgodclawQ4_K_M
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.