Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Z.ai (Zhipu)

GLM-4.5-Air106B

Benchmarkprofil und veröffentlichte Ergebnisse.

MoE106B
Einordnung im Feld

Bestwerte im Vergleich

Beste Messwerte dieses Modells gegen Minimum, Durchschnitt und Maximum aller veröffentlichten Systeme.

Generation661,8 tok/s
Min 0,0Ø 518,2Max 2.414,4
Ueber dem Durchschnitt · 244 Systeme im Feld
Prefill3.559 tok/s
Min 7Ø 6.972Max 39.029
Unter dem Durchschnitt · 244 Systeme im Feld
Time to First Token815 ms
Min 114Ø 27.182Max 354.674
Ueber dem Durchschnitt · 244 Systeme im Feld
Performanceprofil

Durchsatz nach Hardware & Engine

Jede Blase steht für eine GPU, CPU bzw. Engine – die Position zeigt Prompt-Verarbeitung (X) und Ausgabe-Geschwindigkeit (Y), die Blasengröße die Anzahl der Messläufe.

GPUnach Grafikkarte

8606454302150,003.2576.5159.772Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 661,8 tok/s Generation, 3.117 tok/s Prefill, TTFT 8.401 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 615,3 tok/s Generation, 3.448 tok/s Prefill, TTFT 9.105 ms (12 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX A6000 - 276,5 tok/s Generation, 7.883 tok/s Prefill, TTFT 1.739 ms (6 Laufe)NVIDIA RTX A6000AMD Radeon AI PRO R9700 - 104,1 tok/s Generation, 1.403 tok/s Prefill, TTFT 67.488 ms (11 Laufe)AMD Radeon AI PRO R97...AMD Radeon PRO W7900 Dual Slot - 99,5 tok/s Generation, 461 tok/s Prefill, TTFT 57.896 ms (9 Laufe)AMD Radeon PRO W7900 ...NVIDIA GeForce RTX 3090 Ti - 20,8 tok/s Generation, 137 tok/s Prefill, TTFT 156.298 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA GeForce RTX 5070 Ti - 9,9 tok/s Generation, 109 tok/s Prefill, TTFT 59.573 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 5090 - 6,2 tok/s Generation, 161 tok/s Prefill, TTFT 57.809 ms (5 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 2060 - 2,1 tok/s Generation, 18 tok/s Prefill, TTFT 117.963 ms (1 Lauf)NVIDIA GeForce RTX 20...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 661,8 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 615,3 tok/sNVIDIA RTX A6000 276,5 tok/sAMD Radeon AI PRO R9700 104,1 tok/sAMD Radeon PRO W7900 Dual Slot 99,5 tok/sNVIDIA GeForce RTX 3090 Ti 20,8 tok/sNVIDIA GeForce RTX 5070 Ti 9,9 tok/sNVIDIA GeForce RTX 5090 6,2 tok/sNVIDIA GeForce RTX 2060 2,1 tok/s

CPUnach Prozessor

8606454302150,001.5243.0484.573Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 661,8 tok/s Generation, 3.117 tok/s Prefill, TTFT 8.401 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 615,3 tok/s Generation, 3.448 tok/s Prefill, TTFT 9.105 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 276,5 tok/s Generation, 3.690 tok/s Prefill, TTFT 44.283 ms (17 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 99,5 tok/s Generation, 373 tok/s Prefill, TTFT 58.315 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 20,8 tok/s Generation, 137 tok/s Prefill, TTFT 156.298 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 7 5800X3D 8-Core Processor - 6,2 tok/s Generation, 161 tok/s Prefill, TTFT 57.809 ms (5 Laufe)AMD Ryzen 7 5800X3D 8...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 2,1 tok/s Generation, 18 tok/s Prefill, TTFT 117.963 ms (1 Lauf)Intel(R) Xeon(R) CPU ...
AMD Ryzen 9 9950X 16-Core Processor 661,8 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 615,3 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 276,5 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 99,5 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 20,8 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 6,2 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 2,1 tok/s

ENGnach Engine

8546404272130,02652.5304.7957.060Prefill (tok/s)Generation (tok/s)llama.cpp - 661,8 tok/s Generation, 1.425 tok/s Prefill, TTFT 57.166 ms (42 Laufe)llama.cppvLLM - 276,5 tok/s Generation, 5.900 tok/s Prefill, TTFT 6.467 ms (9 Laufe)vLLMunbekannt - 32,9 tok/s Generation, 3.110 tok/s Prefill, TTFT 1.893 ms (2 Laufe)unbekannt
llama.cpp 661,8 tok/svLLM 276,5 tok/sunbekannt 32,9 tok/s
Durchsatz & Latenz

Performancebenchmark

Messwert:
#Modell / HerstellerMesswerteParallelGPU / CPU / RAMRuntime
1GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
661,81 tok/s TG
Prefill 3.559 · TTFT 18.166 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
2GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
615,32 tok/s TG
Prefill 5.005 · TTFT 17.982 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
3GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
614,42 tok/s TG
Prefill 4.348 · TTFT 18.337 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
606,09 tok/s TG
Prefill 3.754 · TTFT 19.156 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
530,93 tok/s TG
Prefill 2.357 · TTFT 24.008 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
369,72 tok/s TG
Prefill 3.178 · TTFT 6.224 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
7GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
339,73 tok/s TG
Prefill 4.537 · TTFT 5.634 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
8GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
338,70 tok/s TG
Prefill 4.134 · TTFT 5.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
9GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
327,67 tok/s TG
Prefill 3.524 · TTFT 6.621 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
299,95 tok/s TG
Prefill 2.073 · TTFT 8.616 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
276,46 tok/s TG
Prefill 11.804 · TTFT 2.833 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
12GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
269,51 tok/s TG
Prefill 10.904 · TTFT 3.057 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
13GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
197,32 tok/s TG
Prefill 9.348 · TTFT 1.552 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
14GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
188,12 tok/s TG
Prefill 8.582 · TTFT 1.686 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
15GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 2.615 · TTFT 815 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
16GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
114,95 tok/s TG
Prefill 2.849 · TTFT 762 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
114,93 tok/s TG
Prefill 3.570 · TTFT 601 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
18GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
107,89 tok/s TG
Prefill 2.115 · TTFT 1.012 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
19GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
106,86 tok/s TG
Prefill 3.108 · TTFT 689 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
20GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
104,08 tok/s TG
Prefill 2.674 · TTFT 8.272 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
21GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
99,46 tok/s TG
Prefill 1.300 · TTFT 18.623 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
22GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
90,64 tok/s TG
Prefill 3.471 · TTFT 630 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
23GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
84,40 tok/s TG
Prefill 3.192 · TTFT 679 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
24GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
83,92 tok/s TG
Prefill 1.024 · TTFT 10.752 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
25GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
44,21 tok/s TG
Prefill 939 · TTFT 2.266 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
26GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
32,88 tok/s TG
Prefill 982 · TTFT 3.379 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
27GLM-4.5-Air106BZ.ai (Zhipu) Performancebenchmark
32,88 tok/s TG
Prefill 982 · TTFT 3.379 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_M
28GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
29,69 tok/s TG
Prefill 223 · TTFT 109.515 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
29GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
24,65 tok/s TG
Prefill 160 · TTFT 68.270 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
30GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
20,78 tok/s TG
Prefill 144 · TTFT 302.096 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
31GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
17,03 tok/s TG
Prefill 104 · TTFT 105.008 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
32GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
15,67 tok/s TG
Prefill 157 · TTFT 13.591 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
33GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
14,86 tok/s TG
Prefill 133 · TTFT 150.792 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
34GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
12,20 tok/s TG
Prefill 55 · TTFT 200.979 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
35GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
11,22 tok/s TG
Prefill 103 · TTFT 20.742 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
36GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,87 tok/s TG
Prefill 112 · TTFT 19.038 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
37GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,08 tok/s TG
Prefill 5.237 · TTFT 407 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
38GLM-4.5-Air106BZ.ai (Zhipu) Performancebenchmark
9,08 tok/s TG
Prefill 5.237 · TTFT 407 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawAWQ
39GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
9,03 tok/s TG
Prefill 138 · TTFT 172.301 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
40GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,50 tok/s TG
Prefill 56 · TTFT 199.090 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
41GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,44 tok/s TG
Prefill 51 · TTFT 41.695 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
42GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,44 tok/s TG
Prefill 51 · TTFT 42.235 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
43GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,40 tok/s TG
Prefill 51 · TTFT 41.828 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
44GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
8,27 tok/s TG
Prefill 55 · TTFT 200.698 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
45GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
7,11 tok/s TG
Prefill 133 · TTFT 16.005 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
46GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
6,20 tok/s TG
Prefill 382 · TTFT 35.625 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cliAWQ
47GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
4,34 tok/s TG
Prefill 107 · TTFT 80.161 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
48GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,51 tok/s TG
Prefill 83 · TTFT 25.669 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
49GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
3,34 tok/s TG
Prefill 182 · TTFT 11.740 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cliAWQ
50GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,60 tok/s TG
Prefill 108 · TTFT 79.520 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
51GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
2,13 tok/s TG
Prefill 18 · TTFT 117.963 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
52GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,53 tok/s TG
Prefill 78 · TTFT 109.360 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
53GLM-4.5-Air106BZ.ai (Zhipu) PerformancebenchmarkTimebench 3 - Kombi (Prefill + Generation)
1,19 tok/s TG
Prefill 80 · TTFT 106.653 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
Agent- & Chat-Bewertung

Harnessbenchmark

Noch keine Harnessbenchmarks fuer dieses Modell.