Created bymario-alka.dePowered bygodcore.denoob2claw.detricoma.de
DEEN
Sign in Sign up
Beta
Meta

Muse-Glimmer-30B30B

Multimodales 30B-Modell (dense, alle Parameter aktiv) von Meta mit dediziertem Perception-Encoder (~1,8B) fuer Bildverarbeitung, destilliert aus Muse Spark, ausgelegt auf agentische Aufgaben auf lokaler Hardware.

Dense Causal Transformer + Perception Encoder (multimodal, 131k Kontext)30B
Position in the field

Best values compared

Best metrics of this model against the minimum, average and maximum of all published systems.

AMD Radeon AI PRO R9700All GPUs
Generation199,1 tok/s
Min 0,0Ø 253,2Max 2.491,2
Unter dem Durchschnitt · 2823 Systeme im Feld
Prefill3.112 tok/s
Min 4Ø 3.470Max 39.029
Unter dem Durchschnitt · 2823 Systeme im Feld
Time to First Token337 ms
Min 20Ø 45.698Max 535.235
Ueber dem Durchschnitt · 2821 Systeme im Feld
Performance profile

Throughput by hardware & engine

Each bubble is a GPU, CPU or engine – position shows prompt processing (X) and output speed (Y), bubble size the number of runs.

GPUby graphics card

2192091991891792.0232.1092.1952.281Prefill (tok/s)Generation (tok/s)AMD Radeon AI PRO R9700 - 199,1 tok/s Generation, 2.152 tok/s Prefill, TTFT 2.455 ms (9 Laufe)AMD Radeon AI PRO R97...
AMD Radeon AI PRO R9700 199,1 tok/s

CPUby processor

2192091991891792.0232.1092.1952.281Prefill (tok/s)Generation (tok/s)AMD Ryzen Threadripper PRO 7955WX 16-Cores - 199,1 tok/s Generation, 2.152 tok/s Prefill, TTFT 2.455 ms (9 Laufe)AMD Ryzen Threadrippe...
AMD Ryzen Threadripper PRO 7955WX 16-Cores 199,1 tok/s

ENGby engine

24419013783,930,61.8602.0332.2072.381Prefill (tok/s)Generation (tok/s)llama.cpp - 199,1 tok/s Generation, 2.214 tok/s Prefill, TTFT 1.090 ms (6 Laufe)llama.cppvLLM - 75,3 tok/s Generation, 2.026 tok/s Prefill, TTFT 5.184 ms (3 Laufe)vLLM
llama.cpp 199,1 tok/svLLM 75,3 tok/s
Throughput & latency

Performance benchmark

Metric:
#Model / MakerMetricsParallelGPU / CPU / RAMRuntime
1Muse-Glimmer-30B30BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
199,09 tok/s TG
Prefill 2.520 · TTFT 2.032 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmDetails →
2Muse-Glimmer-30B30BQ8_0Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
159,55 tok/s TG
Prefill 3.112 · TTFT 1.645 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmDetails →
3Muse-Glimmer-30B30BQ8_0Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
84,05 tok/s TG
Prefill 2.716 · TTFT 943 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmDetails →
4Muse-Glimmer-30B30BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
82,79 tok/s TG
Prefill 2.200 · TTFT 1.164 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmDetails →
5Muse-Glimmer-30B30BBF16Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
75,28 tok/s TG
Prefill 2.774 · TTFT 8.886 ms
10×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawDetails →
6Muse-Glimmer-30B30BBF16Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
41,70 tok/s TG
Prefill 2.092 · TTFT 5.044 ms
5×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawDetails →
7Muse-Glimmer-30B30BQ4_K_MMeta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
28,00 tok/s TG
Prefill 1.219 · TTFT 420 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmDetails →
8Muse-Glimmer-30B30BQ8_0Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
17,92 tok/s TG
Prefill 1.520 · TTFT 337 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMllama.cppopenclaw_cli batched-bench ROCmDetails →
9Muse-Glimmer-30B30BBF16Meta Performance benchmarkTimebench 3 - Kombi (Prefill + Generation) i
8,16 tok/s TG
Prefill 1.213 · TTFT 1.622 ms
1×4x AMD Radeon AI PRO R9700AMD Ryzen Threadripper PRO 7955WX 16-Cores · 184 GB RAMvLLMgodclawDetails →
Agent & chat rating

Harness benchmark

Noch keine Harnessbenchmarks fuer dieses Modell.