Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
🧠
Prozessor

AMD Ryzen 9 8945HX with Radeon Graphics

AMD
222Benchmarks
49Modelle
222Performance
0Harness
15 WIdle-Leistung
75 WMax-Leistung
Beste Generation
1.492,8 tok/s
gemma-4-E2B-it
∅ Generation
259,3 tok/s
Schnitt aus 222 Läufen
Bester Prefill
17.357 tok/s
Prompt-Verarbeitung
Bester TTFT
20 ms
Time to First Token
Beste Harness-Quote
%
noch kein Harness
🏆
gemma-4-E2B-it läuft am schnellsten auf dieser CPU · 1.492,8 tok/s
Bester Prefill: 17.357 tok/s · 49 Modelle getestet

Top-Modelle

Bester gemessener Durchsatz je Modell auf AMD Ryzen 9 8945HX with Radeon Graphics – umschaltbar nach Generation, Prefill oder Kombiwert.

gemma-4-E2B-it5B
1.492,8 tok/s
gpt-oss-20b20B
1.113,5 tok/s
Nemotron-3-Nano-4B4B
992,1 tok/s
Laguna-XS-2.1
986,1 tok/s
gemma-4-E4B-it8B
983,7 tok/s
Gemma-4-26B-A4B-it26B
926,2 tok/s
Performanceprofil

Durchsatz auf AMD Ryzen 9 8945HX with Radeon Graphics

Jede Blase steht für ein Modell, eine Engine bzw. eine GPU – Position: Prompt-Verarbeitung (X) × Ausgabe (Y), Blasengröße: Anzahl Messläufe.

MODnach Modell

1.8931.4209474730,004.7139.42714.140Prefill (tok/s)Generation (tok/s)gemma-4-E2B-it - 1.492,8 tok/s Generation, 9.978 tok/s Prefill, TTFT 3.182 ms (3 Laufe)gemma-4-E2B-itgpt-oss-20b - 1.113,5 tok/s Generation, 7.334 tok/s Prefill, TTFT 2.323 ms (13 Laufe)gpt-oss-20bNemotron-3-Nano-4B - 992,1 tok/s Generation, 5.129 tok/s Prefill, TTFT 5.537 ms (3 Laufe)Nemotron-3-Nano-4BLaguna-XS-2.1 - 986,1 tok/s Generation, 4.824 tok/s Prefill, TTFT 8.985 ms (6 Laufe)Laguna-XS-2.1gemma-4-E4B-it - 983,7 tok/s Generation, 6.942 tok/s Prefill, TTFT 7.124 ms (2 Laufe)gemma-4-E4B-itNorth-Mini-Code-1.0 - 939,5 tok/s Generation, 4.419 tok/s Prefill, TTFT 8.644 ms (2 Laufe)North-Mini-Code-1.0Qwen3-30B-A3B-Thinking-2507 - 930,6 tok/s Generation, 8.813 tok/s Prefill, TTFT 8.583 ms (4 Laufe)Qwen3-30B-A3B-Thinkin...Qwen3-Coder-30B-A3B-Instruct - 928,5 tok/s Generation, 11.637 tok/s Prefill, TTFT 5.235 ms (4 Laufe)Qwen3-Coder-30B-A3B-I...Qwen3-Omni-30B-A3B-Thinking - 927,4 tok/s Generation, 4.754 tok/s Prefill, TTFT 9.018 ms (2 Laufe)Qwen3-Omni-30B-A3B-Th...Gemma-4-26B-A4B-it - 926,2 tok/s Generation, 3.653 tok/s Prefill, TTFT 9.438 ms (2 Laufe)Gemma-4-26B-A4B-itOrnith-1.0-35B - 920,2 tok/s Generation, 3.586 tok/s Prefill, TTFT 9.350 ms (2 Laufe)Ornith-1.0-35BQwen3-30B-A3B-Instruct-2507 - 905,1 tok/s Generation, 9.925 tok/s Prefill, TTFT 8.229 ms (4 Laufe)Qwen3-30B-A3B-Instruc...Qwen3-VL-30B-A3B-Instruct - 903,5 tok/s Generation, 6.863 tok/s Prefill, TTFT 8.427 ms (2 Laufe)Qwen3-VL-30B-A3B-Inst...Nemotron-Cascade-2-30B-A3B - 897,5 tok/s Generation, 4.286 tok/s Prefill, TTFT 9.332 ms (2 Laufe)Nemotron-Cascade-2-30...Nemotron-3-Nano-30B-A3B - 897,5 tok/s Generation, 4.180 tok/s Prefill, TTFT 9.374 ms (2 Laufe)Nemotron-3-Nano-30B-A...Nemotron-3-Nano-Omni-30B-A3B-Reasoning - 896,6 tok/s Generation, 4.175 tok/s Prefill, TTFT 9.402 ms (2 Laufe)Nemotron-3-Nano-Omni-...Qwen3.5-35B-A3B - 866,1 tok/s Generation, 3.595 tok/s Prefill, TTFT 9.647 ms (2 Laufe)Qwen3.5-35B-A3BQwen3.6-35B-A3B - 852,0 tok/s Generation, 3.662 tok/s Prefill, TTFT 9.751 ms (2 Laufe)Qwen3.6-35B-A3BQwen-AgentWorld-35B-A3B - 849,2 tok/s Generation, 3.689 tok/s Prefill, TTFT 9.771 ms (2 Laufe)Qwen-AgentWorld-35B-A...Meta-Llama-3.1-8B-Instruct - 837,9 tok/s Generation, 9.262 tok/s Prefill, TTFT 8.362 ms (2 Laufe)Meta-Llama-3.1-8B-Ins...Ornith-1.0-9B - 786,2 tok/s Generation, 4.710 tok/s Prefill, TTFT 9.444 ms (2 Laufe)Ornith-1.0-9Bgemma-4-12B-it - 654,9 tok/s Generation, 2.647 tok/s Prefill, TTFT 12.993 ms (2 Laufe)gemma-4-12B-itMinistral-3-14B-Reasoning-2512 - 543,1 tok/s Generation, 5.778 tok/s Prefill, TTFT 8.178 ms (4 Laufe)Ministral-3-14B-Reaso...Magistral-Small-2509 - 353,8 tok/s Generation, 2.744 tok/s Prefill, TTFT 8.227 ms (3 Laufe)Magistral-Small-2509Devstral-Small-2-24B-Instruct-2512 - 331,6 tok/s Generation, 4.743 tok/s Prefill, TTFT 31.297 ms (1 Lauf)Devstral-Small-2-24B-...Codestral-22B-v0.1 - 325,2 tok/s Generation, 3.507 tok/s Prefill, TTFT 31.980 ms (1 Lauf)Codestral-22B-v0.1Devstral-Small-2507 - 317,4 tok/s Generation, 6.072 tok/s Prefill, TTFT 23.382 ms (1 Lauf)Devstral-Small-2507Qwen3.6-27B - 264,2 tok/s Generation, 1.610 tok/s Prefill, TTFT 42.712 ms (1 Lauf)Qwen3.6-27BOpenReasoning-Nemotron-32B - 236,8 tok/s Generation, 2.409 tok/s Prefill, TTFT 46.406 ms (1 Lauf)OpenReasoning-Nemotro...Qwen2.5-Coder-32B-Instruct - 236,4 tok/s Generation, 2.420 tok/s Prefill, TTFT 46.503 ms (1 Lauf)Qwen2.5-Coder-32B-Ins...
gemma-4-E2B-it 1.492,8 tok/sgpt-oss-20b 1.113,5 tok/sNemotron-3-Nano-4B 992,1 tok/sLaguna-XS-2.1 986,1 tok/sgemma-4-E4B-it 983,7 tok/sNorth-Mini-Code-1.0 939,5 tok/sQwen3-30B-A3B-Thinking-2507 930,6 tok/sQwen3-Coder-30B-A3B-Instruct 928,5 tok/sQwen3-Omni-30B-A3B-Thinking 927,4 tok/sGemma-4-26B-A4B-it 926,2 tok/sOrnith-1.0-35B 920,2 tok/sQwen3-30B-A3B-Instruct-2507 905,1 tok/sQwen3-VL-30B-A3B-Instruct 903,5 tok/sNemotron-Cascade-2-30B-A3B 897,5 tok/sNemotron-3-Nano-30B-A3B 897,5 tok/sNemotron-3-Nano-Omni-30B-A3B-Reasoning 896,6 tok/sQwen3.5-35B-A3B 866,1 tok/sQwen3.6-35B-A3B 852,0 tok/sQwen-AgentWorld-35B-A3B 849,2 tok/sMeta-Llama-3.1-8B-Instruct 837,9 tok/sOrnith-1.0-9B 786,2 tok/sgemma-4-12B-it 654,9 tok/sMinistral-3-14B-Reasoning-2512 543,1 tok/sMagistral-Small-2509 353,8 tok/sDevstral-Small-2-24B-Instruct-2512 331,6 tok/sCodestral-22B-v0.1 325,2 tok/sDevstral-Small-2507 317,4 tok/sQwen3.6-27B 264,2 tok/sOpenReasoning-Nemotron-32B 236,8 tok/sQwen2.5-Coder-32B-Instruct 236,4 tok/s

ENGnach Engine

1.7601.4791.1979166343.5566.3619.16611.971Prefill (tok/s)Generation (tok/s)llama.cpp - 1.492,8 tok/s Generation, 5.128 tok/s Prefill, TTFT 10.557 ms (66 Laufe)llama.cppvLLM - 901,9 tok/s Generation, 10.399 tok/s Prefill, TTFT 4.394 ms (14 Laufe)vLLM
llama.cpp 1.492,8 tok/svLLM 901,9 tok/s

GPUnach Grafikkarte

1.6421.5671.4931.4181.3445.6885.9306.1726.414Prefill (tok/s)Generation (tok/s)NVIDIA GeForce RTX 3090 Ti - 1.492,8 tok/s Generation, 6.051 tok/s Prefill, TTFT 9.479 ms (80 Laufe)NVIDIA GeForce RTX 30...
NVIDIA GeForce RTX 3090 Ti 1.492,8 tok/s
Plattform

Mainboards mit dieser CPU

Auf diesen Boards wurde AMD Ryzen 9 8945HX with Radeon Graphics gemessen – anklicken für Board-Details mit CPUs und Modellen.

Durchsatz & Latenz

Performancebenchmark

80 veroeffentlichte Performance-Läufe auf AMD Ryzen 9 8945HX with Radeon Graphics.

Im Leaderboard →
Messwert:
Größe
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.492,78 tok/s TG
Prefill 11.476 · TTFT 7.075 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
2gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1.113,51 tok/s TG
Prefill 6.554 · TTFT 10.391 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
3Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
992,11 tok/s TG
Prefill 5.920 · TTFT 12.083 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
4Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
986,05 tok/s TG
Prefill 5.179 · TTFT 13.058 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
5gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
983,68 tok/s TG
Prefill 7.362 · TTFT 10.840 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
6Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
981,72 tok/s TG
Prefill 5.166 · TTFT 13.134 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
7Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
979,74 tok/s TG
Prefill 5.175 · TTFT 13.143 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
8North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
939,51 tok/s TG
Prefill 4.611 · TTFT 12.995 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_M
9Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
930,61 tok/s TG
Prefill 5.307 · TTFT 13.161 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
10Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
928,48 tok/s TG
Prefill 7.663 · TTFT 12.219 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
11Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
927,42 tok/s TG
Prefill 5.040 · TTFT 13.415 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
12Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
926,20 tok/s TG
Prefill 3.875 · TTFT 14.083 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XL
13Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
920,16 tok/s TG
Prefill 3.818 · TTFT 13.771 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
14Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
905,10 tok/s TG
Prefill 7.532 · TTFT 12.527 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
15Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
903,53 tok/s TG
Prefill 7.168 · TTFT 12.726 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
16Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
901,86 tok/s TG
Prefill 12.965 · TTFT 12.663 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
17Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
897,47 tok/s TG
Prefill 4.560 · TTFT 13.829 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
18Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
897,46 tok/s TG
Prefill 4.457 · TTFT 13.871 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
19Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
896,55 tok/s TG
Prefill 4.436 · TTFT 13.922 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
20Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
883,71 tok/s TG
Prefill 12.981 · TTFT 12.917 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
21Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
866,12 tok/s TG
Prefill 3.825 · TTFT 14.245 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
22Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
851,97 tok/s TG
Prefill 3.890 · TTFT 14.433 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_M
23Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
849,15 tok/s TG
Prefill 3.913 · TTFT 14.486 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_M
24Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
837,85 tok/s TG
Prefill 9.559 · TTFT 12.952 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
25gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
827,28 tok/s TG
Prefill 9.803 · TTFT 2.242 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
26gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
797,18 tok/s TG
Prefill 11.820 · TTFT 1.789 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
27gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
796,82 tok/s TG
Prefill 11.892 · TTFT 1.781 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
28Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
786,22 tok/s TG
Prefill 4.926 · TTFT 14.292 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
29Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
670,65 tok/s TG
Prefill 17.357 · TTFT 3.808 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
30gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
656,13 tok/s TG
Prefill 5.934 · TTFT 3.387 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
31gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
654,86 tok/s TG
Prefill 2.799 · TTFT 19.412 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XL
32Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
596,31 tok/s TG
Prefill 5.389 · TTFT 4.001 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
33Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
586,52 tok/s TG
Prefill 4.479 · TTFT 4.845 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
34Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
584,39 tok/s TG
Prefill 4.467 · TTFT 4.864 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
35Laguna-XS-2.1Poolside PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
582,20 tok/s TG
Prefill 4.480 · TTFT 4.869 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
36Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
558,18 tok/s TG
Prefill 4.694 · TTFT 4.497 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
37Qwen3-Omni-30B-A3B-Thinking30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
556,41 tok/s TG
Prefill 4.468 · TTFT 4.620 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
38Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
554,75 tok/s TG
Prefill 7.036 · TTFT 3.930 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
39Nemotron-3-Nano-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
550,00 tok/s TG
Prefill 3.904 · TTFT 4.878 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
40Nemotron-Cascade-2-30B-A3B30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
548,84 tok/s TG
Prefill 4.012 · TTFT 4.835 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
41Nemotron-3-Nano-Omni-30B-A3B-Reasoning30BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
547,85 tok/s TG
Prefill 3.914 · TTFT 4.883 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
42Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
543,05 tok/s TG
Prefill 4.878 · TTFT 20.084 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
43North-Mini-Code-1.0Cohere PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,97 tok/s TG
Prefill 4.226 · TTFT 4.294 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_M
44Qwen3-VL-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,88 tok/s TG
Prefill 6.558 · TTFT 4.129 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
45gemma-4-E4B-it8BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,58 tok/s TG
Prefill 6.522 · TTFT 3.407 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
46Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
542,30 tok/s TG
Prefill 6.912 · TTFT 4.026 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
47Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
524,37 tok/s TG
Prefill 7.751 · TTFT 4.130 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
48Gemma-4-26B-A4B-it26BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
522,97 tok/s TG
Prefill 3.432 · TTFT 4.794 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XL
49Ornith-1.0-35B35BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
517,07 tok/s TG
Prefill 3.355 · TTFT 4.929 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
50Qwen3-30B-A3B-Instruct-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
496,79 tok/s TG
Prefill 12.291 · TTFT 3.700 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
51Qwen3-30B-A3B-Thinking-250730BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
487,24 tok/s TG
Prefill 12.271 · TTFT 3.758 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
52gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
483,69 tok/s TG
Prefill 9.270 · TTFT 1.070 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
53gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
479,47 tok/s TG
Prefill 9.242 · TTFT 1.075 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocket
54Qwen3.5-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
479,14 tok/s TG
Prefill 3.365 · TTFT 5.049 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
55Qwen3.6-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
472,34 tok/s TG
Prefill 3.434 · TTFT 5.070 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_M
56Qwen-AgentWorld-35B-A3B35BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
471,29 tok/s TG
Prefill 3.464 · TTFT 5.057 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_M
57gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
470,17 tok/s TG
Prefill 6.563 · TTFT 3.093 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
58gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
468,74 tok/s TG
Prefill 6.617 · TTFT 3.069 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
59gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
463,67 tok/s TG
Prefill 5.822 · TTFT 1.705 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
60Meta-Llama-3.1-8B-Instruct8BMeta PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
456,70 tok/s TG
Prefill 8.966 · TTFT 3.773 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
61Ornith-1.0-9B9BDeepReinforce PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
430,04 tok/s TG
Prefill 4.493 · TTFT 4.596 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
62gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
403,67 tok/s TG
Prefill 5.727 · TTFT 1.727 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
63Qwen3-Coder-30B-A3B-Instruct30BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
399,08 tok/s TG
Prefill 14.492 · TTFT 984 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
64gemma-4-12B-it12BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
355,09 tok/s TG
Prefill 2.494 · TTFT 6.574 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketUD-Q4_K_XL
65Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
353,84 tok/s TG
Prefill 924 · TTFT 13.139 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
66Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
338,30 tok/s TG
Prefill 5.943 · TTFT 2.299 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
67Devstral-Small-2-24B-Instruct-251224BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
331,64 tok/s TG
Prefill 4.743 · TTFT 31.297 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
68Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
330,94 tok/s TG
Prefill 4.379 · TTFT 7.353 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
69Codestral-22B-v0.122BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
325,20 tok/s TG
Prefill 3.507 · TTFT 31.980 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
70Devstral-Small-250724BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
317,44 tok/s TG
Prefill 6.072 · TTFT 23.382 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
71Ministral-3-14B-Reasoning-251214BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
294,82 tok/s TG
Prefill 4.538 · TTFT 6.199 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
72Qwen3.6-27B27BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
264,22 tok/s TG
Prefill 1.610 · TTFT 42.712 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
73gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
246,06 tok/s TG
Prefill 5.285 · TTFT 374 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
74gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
245,58 tok/s TG
Prefill 5.520 · TTFT 359 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
75gpt-oss-20b20BOpenAI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
238,87 tok/s TG
Prefill 5.096 · TTFT 388 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
76Nemotron-3-Nano-4B4BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,91 tok/s TG
Prefill 4.079 · TTFT 528 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
77OpenReasoning-Nemotron-32B32BNVIDIA PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,79 tok/s TG
Prefill 2.409 · TTFT 46.406 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
78Qwen2.5-Coder-32B-Instruct32BQwen (Alibaba) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
236,42 tok/s TG
Prefill 2.420 · TTFT 46.503 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
79gemma-4-E2B-it5BGoogle PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
235,80 tok/s TG
Prefill 8.654 · TTFT 230 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
80Magistral-Small-250924BMistral AI PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
226,20 tok/s TG
Prefill 2.929 · TTFT 4.189 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMvLLMwebsocketAWQ
Agent- & Chat-Bewertung

Harnessbenchmark

0 veroeffentlichte Harness-Läufe auf AMD Ryzen 9 8945HX with Radeon Graphics.

Im Leaderboard →
Noch keine Harnessbenchmarks auf dieser Hardware.

← Alle Hardware

Technische Daten

Technische Daten – AMD Ryzen 9 8945HX with Radeon Graphics

HerstellerAMD
TDP75 W
Beste Generation1.492,8 tok/s
Bester Prefill17.357 tok/s
Modelle49
Messläufe (Performance)222