Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
Z.ai (Zhipu)

GLM-4.5-Air106B

Benchmark profile and published results.

MoE106B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

Generation661,8 tok/s
Min 0,0Ø 518,2Max 2.414,4
Ueber dem Durchschnitt · 244 Systeme im Feld
Prefill3.559 tok/s
Min 7Ø 6.972Max 39.029
Unter dem Durchschnitt · 244 Systeme im Feld
Time to First Token815 ms
Min 114Ø 27.182Max 354.674
Ueber dem Durchschnitt · 244 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

8606454302150,003.2576.5159.772Prefill (tok/s)Generation (tok/s)NVIDIA RTX PRO 6000 Blackwell Workstation Edition - 661,8 tok/s Generation, 3.117 tok/s Prefill, TTFT 8.401 ms (3 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition - 615,3 tok/s Generation, 3.448 tok/s Prefill, TTFT 9.105 ms (12 Laufe)NVIDIA RTX PRO 6000 B...NVIDIA RTX A6000 - 276,5 tok/s Generation, 7.883 tok/s Prefill, TTFT 1.739 ms (6 Laufe)NVIDIA RTX A6000AMD Radeon AI PRO R9700 - 104,1 tok/s Generation, 1.403 tok/s Prefill, TTFT 67.488 ms (11 Laufe)AMD Radeon AI PRO R97...AMD Radeon PRO W7900 Dual Slot - 99,5 tok/s Generation, 461 tok/s Prefill, TTFT 57.896 ms (9 Laufe)AMD Radeon PRO W7900 ...NVIDIA GeForce RTX 3090 Ti - 20,8 tok/s Generation, 137 tok/s Prefill, TTFT 156.298 ms (3 Laufe)NVIDIA GeForce RTX 30...NVIDIA GeForce RTX 5070 Ti - 9,9 tok/s Generation, 109 tok/s Prefill, TTFT 59.573 ms (3 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 5090 - 6,2 tok/s Generation, 161 tok/s Prefill, TTFT 57.809 ms (5 Laufe)NVIDIA GeForce RTX 50...NVIDIA GeForce RTX 2060 - 2,1 tok/s Generation, 18 tok/s Prefill, TTFT 117.963 ms (1 Lauf)NVIDIA GeForce RTX 20...
NVIDIA RTX PRO 6000 Blackwell Workstation Edition 661,8 tok/sNVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition 615,3 tok/sNVIDIA RTX A6000 276,5 tok/sAMD Radeon AI PRO R9700 104,1 tok/sAMD Radeon PRO W7900 Dual Slot 99,5 tok/sNVIDIA GeForce RTX 3090 Ti 20,8 tok/sNVIDIA GeForce RTX 5070 Ti 9,9 tok/sNVIDIA GeForce RTX 5090 6,2 tok/sNVIDIA GeForce RTX 2060 2,1 tok/s

CPUby processor

8606454302150,001.5243.0484.573Prefill (tok/s)Generation (tok/s)AMD Ryzen 9 9950X 16-Core Processor - 661,8 tok/s Generation, 3.117 tok/s Prefill, TTFT 8.401 ms (3 Laufe)AMD Ryzen 9 9950X 16-...AMD Ryzen Threadripper PRO 9965WX 24-Cores - 615,3 tok/s Generation, 3.448 tok/s Prefill, TTFT 9.105 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 7955WX 16-Cores - 276,5 tok/s Generation, 3.690 tok/s Prefill, TTFT 44.283 ms (17 Laufe)AMD Ryzen Threadrippe...AMD Ryzen Threadripper PRO 5975WX 32-Cores - 99,5 tok/s Generation, 373 tok/s Prefill, TTFT 58.315 ms (12 Laufe)AMD Ryzen Threadrippe...AMD Ryzen 9 8945HX with Radeon Graphics - 20,8 tok/s Generation, 137 tok/s Prefill, TTFT 156.298 ms (3 Laufe)AMD Ryzen 9 8945HX wi...AMD Ryzen 7 5800X3D 8-Core Processor - 6,2 tok/s Generation, 161 tok/s Prefill, TTFT 57.809 ms (5 Laufe)AMD Ryzen 7 5800X3D 8...Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz - 2,1 tok/s Generation, 18 tok/s Prefill, TTFT 117.963 ms (1 Lauf)Intel(R) Xeon(R) CPU ...
AMD Ryzen 9 9950X 16-Core Processor 661,8 tok/sAMD Ryzen Threadripper PRO 9965WX 24-Cores 615,3 tok/sAMD Ryzen Threadripper PRO 7955WX 16-Cores 276,5 tok/sAMD Ryzen Threadripper PRO 5975WX 32-Cores 99,5 tok/sAMD Ryzen 9 8945HX with Radeon Graphics 20,8 tok/sAMD Ryzen 7 5800X3D 8-Core Processor 6,2 tok/sIntel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz 2,1 tok/s

ENGby engine

8546404272130,02652.5304.7957.060Prefill (tok/s)Generation (tok/s)llama.cpp - 661,8 tok/s Generation, 1.425 tok/s Prefill, TTFT 57.166 ms (42 Laufe)llama.cppvLLM - 276,5 tok/s Generation, 5.900 tok/s Prefill, TTFT 6.467 ms (9 Laufe)vLLMunbekannt - 32,9 tok/s Generation, 3.110 tok/s Prefill, TTFT 1.893 ms (2 Laufe)unbekannt
llama.cpp 661,8 tok/svLLM 276,5 tok/sunbekannt 32,9 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
661,81 tok/s TG
Prefill 3.559 · TTFT 18.166 ms
10×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
2GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
615,32 tok/s TG
Prefill 5.005 · TTFT 17.982 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
3GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
614,42 tok/s TG
Prefill 4.348 · TTFT 18.337 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
4GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
606,09 tok/s TG
Prefill 3.754 · TTFT 19.156 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
5GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
530,93 tok/s TG
Prefill 2.357 · TTFT 24.008 ms
10×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
6GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
369,72 tok/s TG
Prefill 3.178 · TTFT 6.224 ms
5×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
7GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
339,73 tok/s TG
Prefill 4.537 · TTFT 5.634 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
8GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
338,70 tok/s TG
Prefill 4.134 · TTFT 5.849 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
9GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
327,67 tok/s TG
Prefill 3.524 · TTFT 6.621 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
10GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
299,95 tok/s TG
Prefill 2.073 · TTFT 8.616 ms
5×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
11GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
276,46 tok/s TG
Prefill 11.804 · TTFT 2.833 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
12GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
269,51 tok/s TG
Prefill 10.904 · TTFT 3.057 ms
10×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
13GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
197,32 tok/s TG
Prefill 9.348 · TTFT 1.552 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
14GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
188,12 tok/s TG
Prefill 8.582 · TTFT 1.686 ms
5×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
15GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
125,21 tok/s TG
Prefill 2.615 · TTFT 815 ms
1×NVIDIA RTX PRO 6000 Blackwell Workstation EditionAMD Ryzen 9 9950X 16-Core Processor · 92 GB RAMllama.cppgodclawQ4_K_M
16GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
114,95 tok/s TG
Prefill 2.849 · TTFT 762 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
17GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
114,93 tok/s TG
Prefill 3.570 · TTFT 601 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
18GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
107,89 tok/s TG
Prefill 2.115 · TTFT 1.012 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
19GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
106,86 tok/s TG
Prefill 3.108 · TTFT 689 ms
1×3x NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation EditionAMD Ryzen Threadripper PRO 9965WX 24-Cores · 125 GB RAMllama.cppgodclawQ4_K_M
20GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
104,08 tok/s TG
Prefill 2.674 · TTFT 8.272 ms
10×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
21GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
99,46 tok/s TG
Prefill 1.300 · TTFT 18.623 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
22GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
90,64 tok/s TG
Prefill 3.471 · TTFT 630 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
23GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
84,40 tok/s TG
Prefill 3.192 · TTFT 679 ms
1×2x NVIDIA RTX A6000AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
24GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
83,92 tok/s TG
Prefill 1.024 · TTFT 10.752 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
25GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
44,21 tok/s TG
Prefill 939 · TTFT 2.266 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
26GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
32,88 tok/s TG
Prefill 982 · TTFT 3.379 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
27GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmark
32,88 tok/s TG
Prefill 982 · TTFT 3.379 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawQ4_K_M
28GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
29,69 tok/s TG
Prefill 223 · TTFT 109.515 ms
10×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
29GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
24,65 tok/s TG
Prefill 160 · TTFT 68.270 ms
5×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
30GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
20,78 tok/s TG
Prefill 144 · TTFT 302.096 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
31GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
17,03 tok/s TG
Prefill 104 · TTFT 105.008 ms
5×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
32GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
15,67 tok/s TG
Prefill 157 · TTFT 13.591 ms
1×AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
33GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
14,86 tok/s TG
Prefill 133 · TTFT 150.792 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
34GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
12,20 tok/s TG
Prefill 55 · TTFT 200.979 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
35GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
11,22 tok/s TG
Prefill 103 · TTFT 20.742 ms
1×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
36GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,87 tok/s TG
Prefill 112 · TTFT 19.038 ms
1×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
37GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,08 tok/s TG
Prefill 5.237 · TTFT 407 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawAWQ
38GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmark
9,08 tok/s TG
Prefill 5.237 · TTFT 407 ms
1×3x AMD Radeon AI PRO R970032x AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMgodclawAWQ
39GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
9,03 tok/s TG
Prefill 138 · TTFT 172.301 ms
10×2x AMD Radeon PRO W7900 Dual SlotAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ8_0
40GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,50 tok/s TG
Prefill 56 · TTFT 199.090 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
41GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,44 tok/s TG
Prefill 51 · TTFT 41.695 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
42GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,44 tok/s TG
Prefill 51 · TTFT 42.235 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
43GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,40 tok/s TG
Prefill 51 · TTFT 41.828 ms
1×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
44GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
8,27 tok/s TG
Prefill 55 · TTFT 200.698 ms
5×3x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppgodclawQ4_K_M
45GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
7,11 tok/s TG
Prefill 133 · TTFT 16.005 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 9 8945HX with Radeon Graphics · 92 GB RAMllama.cppwebsocketQ4_K_M
46GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
6,20 tok/s TG
Prefill 382 · TTFT 35.625 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cliAWQ
47GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
4,34 tok/s TG
Prefill 107 · TTFT 80.161 ms
5×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
48GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,51 tok/s TG
Prefill 83 · TTFT 25.669 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
49GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
3,34 tok/s TG
Prefill 182 · TTFT 11.740 ms
1×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMvLLMcodex_cliAWQ
50GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,60 tok/s TG
Prefill 108 · TTFT 79.520 ms
10×NVIDIA GeForce RTX 5070 TiAMD Ryzen Threadripper PRO 5975WX 32-Cores · 247 GB RAMllama.cppgodclawQ4_K_M
51GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
2,13 tok/s TG
Prefill 18 · TTFT 117.963 ms
1×2x NVIDIA GeForce RTX 20604x Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz · 504 GB RAMllama.cppgodclawQ4_K_M
52GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,53 tok/s TG
Prefill 78 · TTFT 109.360 ms
5×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
53GLM-4.5-Air106BZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
1,19 tok/s TG
Prefill 80 · TTFT 106.653 ms
10×NVIDIA GeForce RTX 5090AMD Ryzen 7 5800X3D 8-Core Processor · 126 GB RAMllama.cppcodex_cliQ4_K_M
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.