vL
Modellserver / Inferenz-Engine
vLLM
Alle Performance-Benchmarks, die mit diesem Modellserver gemessen wurden – Durchsatz, Prefill und Latenz.
Beste Generation
69,2 tok/s
Qwen3-VL-30B-A3B-Instruct
∅ Generation
31,7 tok/s
Schnitt aus 54 Läufen
Bester Prefill
9.072 tok/s
Prompt-Verarbeitung
Bester TTFT
91 ms
Time to First Token
Top-Modelle auf vLLM
Bester Generierungs-Durchsatz je Modell (tok/s).
Auf welcher Hardware laeuft vLLM am schnellsten?
Bester Durchsatz je Grafikkarte mit diesem Modellserver.
Performanceprofil
Durchsatz mit vLLM
Jede Blase steht für eine CPU, GPU bzw. ein Modell – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.
CPUnach Prozessor
AMD Ryzen Threadripper PRO 7955WX 16-Cores 69,2 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 62,7 tok/sNVIDIA Grace 34,4 tok/sAMD Ryzen 9 9950X 16-Core Processor 28,8 tok/s
GPUnach Grafikkarte
AMD Radeon AI PRO R9700 69,2 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 62,7 tok/sNVIDIA GB10 34,4 tok/s
MODnach Modell
Qwen3-VL-30B-A3B-Instruct 69,2 tok/sMiniMax-M2.5 62,7 tok/sQwen3.5-35B-A3B 59,4 tok/sQwen3.6-35B-A3B 56,0 tok/sgpt-oss-20b 52,7 tok/sQwen3-30B-A3B-Thinking-2507 49,3 tok/sQwen3-Coder-30B-A3B-Instruct 48,0 tok/sQwen3-30B-A3B-Instruct-2507 45,4 tok/sQwen3-Omni-30B-A3B-Thinking 34,8 tok/sMiniMax-M2.7-AWQ-4bit 34,4 tok/sQwen3.6-27B 28,8 tok/sLaguna-XS-2.1-INT4 26,9 tok/sgemma-4-31b-it-int8 24,4 tok/sQwen3-Coder-Next 22,7 tok/sgpt-oss-120b 21,5 tok/sMistral-Small-3.1-24B-Instruct-2503 15,0 tok/sLaguna-S-2.1-INT4 13,4 tok/sQwen2.5-Coder-32B-Instruct 9,9 tok/sGLM-4.5-Air 9,1 tok/s
Alle Messungen
← Alle Engines61 Benchmark-Läufe
Jeder veroeffentlichte Lauf mit vLLM.
| # | Modell / Hersteller | Typ | Messwerte | GPU / CPU / RAM | Runtime | Datum | ||
|---|---|---|---|---|---|---|---|---|
| 1 | MiniMax-M2.5MiniMaxTool Usage Standard 1.0 | Harnessbenchmark | 81,4 % 2.427/2.980 Pkt · 16/16 Aufg. | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw BF16 | 13.07.2026 | Details → | |
| 2 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 69,19 tok/s Prefill 7.289 · TTFT 412 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 3 | MiniMax-M2.5MiniMaxTool Usage Standard 1.0 | Harnessbenchmark | 68,2 % 2.033/2.980 Pkt · 16/16 Aufg. | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw BF16 | 13.07.2026 | Details → | |
| 4 | MiniMax-M2.5MiniMaxPerformancetest Small 1.0 | Performancebenchmark | 62,70 tok/s Prefill 368 · TTFT 144 ms | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw BF16 | 20.07.2026 | Details → | |
| 5 | MiniMax-M2.7-AWQ-4bitMiniMaxTool-Parcours Dossier 40 V1.0 | Harnessbenchmark | 61,1 % 3.641/5.960 Pkt · 40/40 Aufg. | NVIDIA GB10NVIDIA Grace · 120 GB RAM | vLLMgodclaw AWQ | 19.07.2026 | Details → | |
| 6 | MiniMax-M2.5MiniMaxTool-Parcours Dossier 40 V1.0 | Harnessbenchmark | 60,8 % 3.622/5.960 Pkt · 34/40 Aufg. | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw BF16 | 19.07.2026 | Details → | |
| 7 | Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 59,41 tok/s Prefill 3.761 · TTFT 569 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 8 | MiniMax-M2.5MiniMaxTool Usage Standard 1.0 | Harnessbenchmark | 57,5 % 1.714/2.980 Pkt · 16/16 Aufg. | 3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition34x AMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAM | vLLMgodclaw BF16 | 15.07.2026 | Details → | |
| 9 | Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 55,99 tok/s Prefill 3.520 · TTFT 622 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 10 | gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 52,72 tok/s Prefill 4.993 · TTFT 874 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | 22.07.2026 | Details → | |
| 11 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 49,30 tok/s Prefill 320 · TTFT 6.725 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 12 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 48,40 tok/s Prefill 3.509 · TTFT 649 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 13 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 47,99 tok/s Prefill 867 · TTFT 2.482 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 14 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 47,65 tok/s Prefill 5.913 · TTFT 437 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 15 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 46,52 tok/s Prefill 4.080 · TTFT 752 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 16 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 46,18 tok/s Prefill 5.211 · TTFT 480 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 17 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 45,43 tok/s Prefill 861 · TTFT 2.500 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 18 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 44,17 tok/s Prefill 4.851 · TTFT 489 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 19 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 43,75 tok/s Prefill 913 · TTFT 2.357 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 20 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 42,04 tok/s Prefill 3.904 · TTFT 581 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 21 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 41,95 tok/s Prefill 8.044 · TTFT 378 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 22 | Qwen3-30B-A3B-Thinking-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 41,21 tok/s Prefill 5.446 · TTFT 460 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 23 | Qwen3.6-27BQwen (Alibaba)Tool Usage Standard 1.0 | Harnessbenchmark | 40,9 % 1.220/2.980 Pkt · 16/16 Aufg. | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition32x AMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | 15.07.2026 | Details → | |
| 24 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 40,50 tok/s Prefill 5.664 · TTFT 755 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 25 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 39,74 tok/s Prefill 3.947 · TTFT 575 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 26 | Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 39,70 tok/s Prefill 4.998 · TTFT 387 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 27 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 39,27 tok/s Prefill 5.443 · TTFT 774 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 28 | Qwen3-Coder-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 38,34 tok/s Prefill 8.377 · TTFT 387 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 29 | Qwen3.6-27BQwen (Alibaba)Tool-Parcours Dossier 40 V1.0 | Harnessbenchmark | 38,0 % 2.267/5.960 Pkt · 38/40 Aufg. | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition32x AMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | 19.07.2026 | Details → | |
| 30 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 36,87 tok/s Prefill 7.939 · TTFT 473 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 31 | gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 35,66 tok/s Prefill 6.540 · TTFT 375 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | 22.07.2026 | Details → | |
| 32 | Qwen3-Omni-30B-A3B-ThinkingQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 34,82 tok/s Prefill 5.528 · TTFT 767 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 33 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 34,80 tok/s Prefill 4.274 · TTFT 570 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 34 | MiniMax-M2.7-AWQ-4bitMiniMaxPerformancetest Small 1.0 | Performancebenchmark | 34,37 tok/s Prefill 503 · TTFT 105 ms | NVIDIA GB10NVIDIA Grace · 120 GB RAM | vLLMgodclaw AWQ | 20.07.2026 | Details → | |
| 35 | Qwen3-VL-30B-A3B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 34,36 tok/s Prefill 7.861 · TTFT 473 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 36 | Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 34,21 tok/s Prefill 5.971 · TTFT 356 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 37 | Qwen3.6-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 33,19 tok/s Prefill 2.767 · TTFT 1.132 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 38 | Qwen3-30B-A3B-Instruct-2507Qwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 32,76 tok/s Prefill 4.322 · TTFT 563 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 39 | Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 30,28 tok/s Prefill 1.804 · TTFT 1.281 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 40 | Qwen3.5-35B-A3BQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 29,06 tok/s Prefill 4.992 · TTFT 415 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 41 | Qwen3.6-27BQwen (Alibaba)Timebench 2 - Token-Generation / Output-Durchsatz | Performancebenchmark | 28,80 tok/s Prefill 599 · TTFT 122 ms | NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition32x AMD Ryzen 9 9950X 16-Core Processor · 92 GB RAM | vLLMgodclaw | 20.07.2026 | Details → | |
| 42 | gpt-oss-20bOpenAITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 28,70 tok/s Prefill 3.379 · TTFT 986 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | 22.07.2026 | Details → | |
| 43 | Laguna-XS-2.1-INT4PoolsideTimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 26,88 tok/s Prefill 3.698 · TTFT 748 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT4 | 22.07.2026 | Details → | |
| 44 | gemma-4-31b-it-int8GooglePerformancetest Small 1.0 | Performancebenchmark | 24,36 tok/s Prefill 309 · TTFT 91 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT8 | 20.07.2026 | Details → | |
| 45 | Qwen3-Coder-NextQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 22,73 tok/s Prefill 2.230 · TTFT 1.115 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 46 | Qwen3-Coder-NextQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 22,53 tok/s Prefill 2.237 · TTFT 1.117 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 47 | gpt-oss-120bOpenAITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 21,48 tok/s Prefill 4.300 · TTFT 556 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw | 22.07.2026 | Details → | |
| 48 | Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 15,00 tok/s Prefill 9.072 · TTFT 245 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT4 | 22.07.2026 | Details → | |
| 49 | Laguna-S-2.1-INT4PoolsideTimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 13,37 tok/s Prefill 8.629 · TTFT 305 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT4 | 22.07.2026 | Details → | |
| 50 | gemma-4-31b-it-int8GooglePerformancetest Small 1.0 | Performancebenchmark | 12,45 tok/s Prefill 208 · TTFT 135 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT8 | 20.07.2026 | Details → | |
| 51 | gemma-4-31b-it-int8GoogleTimebench 2 - Token-Generation / Output-Durchsatz | Performancebenchmark | 11,19 tok/s Prefill 162 · TTFT 716 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT8 | 20.07.2026 | Details → | |
| 52 | gemma-4-31b-it-int8GooglePerformancetest Small 1.0 | Performancebenchmark | 10,54 tok/s Prefill 199 · TTFT 141 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT8 | 20.07.2026 | Details → | |
| 53 | Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 9,86 tok/s Prefill 8.244 · TTFT 264 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 54 | Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 9,84 tok/s Prefill 7.325 · TTFT 311 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 55 | GLM-4.5-AirZ.ai (Zhipu)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 9,08 tok/s Prefill 5.237 · TTFT 407 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 22.07.2026 | Details → | |
| 56 | Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 6,98 tok/s Prefill 4.076 · TTFT 559 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT4 | 22.07.2026 | Details → | |
| 57 | Mistral-Small-3.1-24B-Instruct-2503Mistral AITimebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 6,13 tok/s Prefill 2.944 · TTFT 763 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw INT4 | 22.07.2026 | Details → | |
| 58 | Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 5,57 tok/s Prefill 4.108 · TTFT 529 ms | AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 59 | Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 5,54 tok/s Prefill 5.413 · TTFT 420 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 60 | Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 5,30 tok/s Prefill 3.582 · TTFT 607 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → | |
| 61 | Qwen2.5-Coder-32B-InstructQwen (Alibaba)Timebench 3 - Kombi (Prefill + Generation) | Performancebenchmark | 5,24 tok/s Prefill 3.234 · TTFT 701 ms | 3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAM | vLLMgodclaw AWQ | 21.07.2026 | Details → |