Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Z.ai (Zhipu)

glm-4.7-flash

Benchmark profile and published results.

Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

NVIDIA GeForce RTX 3090 TiAll GPUs
Generation349,3 tok/s
Min 0,0Ø 235,6Max 2.491,2
Ueber dem Durchschnitt · 4705 Systeme im Feld
Prefill14.193 tok/s
Min 4Ø 4.785Max 112.346
Ueber dem Durchschnitt · 4696 Systeme im Feld
Time to First Token346 ms
Min 20Ø 32.984Max 535.235
Ueber dem Durchschnitt · 4703 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

4443332221110,02.5004.7607.0199.279Prefill (tok/s)Generation (tok/s)NVIDIA GeForce RTX 3090 Ti - 349,3 tok/s Generation, 8.028 tok/s Prefill, TTFT 1.698 ms (6 Laufe)NVIDIA GeForce RTX 30...AMD Radeon RX 7900 XTX - 151,7 tok/s Generation, 3.752 tok/s Prefill, TTFT 3.439 ms (3 Laufe)AMD Radeon RX 7900 XTXNVIDIA GB10 - 48,9 tok/s Generation, 4.055 tok/s Prefill, TTFT 536 ms (1 Lauf)NVIDIA GB10
NVIDIA GeForce RTX 3090 Ti 349,3 tok/sAMD Radeon RX 7900 XTX 151,7 tok/sNVIDIA GB10 48,9 tok/s

CPUby processor

4443332221110,02.5004.7607.0199.279Prefill (tok/s)Generation (tok/s)AMD Ryzen 5 5600X 6-Core Processor - 349,3 tok/s Generation, 8.028 tok/s Prefill, TTFT 1.698 ms (6 Laufe)AMD Ryzen 5 5600X 6-C...AMD Ryzen Threadripper PRO 3955WX 16-Cores - 151,7 tok/s Generation, 3.752 tok/s Prefill, TTFT 3.439 ms (3 Laufe)AMD Ryzen Threadrippe...NVIDIA Grace - 48,9 tok/s Generation, 4.055 tok/s Prefill, TTFT 536 ms (1 Lauf)NVIDIA Grace
AMD Ryzen 5 5600X 6-Core Processor 349,3 tok/sAMD Ryzen Threadripper PRO 3955WX 16-Cores 151,7 tok/sNVIDIA Grace 48,9 tok/s

ENGby engine

42433725016477,32.3394.9307.52110.113Prefill (tok/s)Generation (tok/s)unbekannt - 349,3 tok/s Generation, 5.807 tok/s Prefill, TTFT 2.234 ms (3 Laufe)unbekanntvLLM - 211,5 tok/s Generation, 8.700 tok/s Prefill, TTFT 1.006 ms (4 Laufe)vLLMllama.cpp - 151,7 tok/s Generation, 3.752 tok/s Prefill, TTFT 3.439 ms (3 Laufe)llama.cpp
unbekannt 349,3 tok/svLLM 211,5 tok/sllama.cpp 151,7 tok/s
Throughput & latency

Performance benchmark

Metric:
GPUs
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
349,28 tok/s TG
Prefill 7.891 · TTFT 3.899 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliAWQDetails →
2glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
233,82 tok/s TG
Prefill 6.284 · TTFT 2.148 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliAWQDetails →
3glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
211,45 tok/s TG
Prefill 14.193 · TTFT 1.973 ms
10×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQDetails →
4glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
151,70 tok/s TG
Prefill 5.294 · TTFT 5.865 ms
10×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawQ4_K_MDetails →
5glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
144,63 tok/s TG
Prefill 3.247 · TTFT 656 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMopenclaw_cliAWQDetails →
6glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
103,06 tok/s TG
Prefill 4.019 · TTFT 3.355 ms
5×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawQ4_K_MDetails →
7glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
102,50 tok/s TG
Prefill 10.352 · TTFT 1.169 ms
5×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQDetails →
8glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
48,92 tok/s TG
Prefill 4.055 · TTFT 536 ms
1×NVIDIA GB10 (DGX Spark)NVIDIA Grace · 120 GB RAMvLLMgodclawAWQDetails →
9glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
43,51 tok/s TG
Prefill 1.942 · TTFT 1.097 ms
1×2x AMD Radeon RX 7900 XTXAMD Ryzen Threadripper PRO 3955WX 16-Cores · 189 GB RAMllama.cppgodclawQ4_K_MDetails →
10glm-4.7-flashZ.ai (Zhipu) Performance benchmarkTimebench 3 - Kombi (Prefill + Generation)
21,28 tok/s TG
Prefill 6.200 · TTFT 346 ms
1×NVIDIA GeForce RTX 3090 TiAMD Ryzen 5 5600X 6-Core Processor · 30 GB RAMvLLMopenclaw_cliAWQDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.