Muse Glimmer 30B - pruned GGUF

Muse Glimmer 30B - pruned

Pruned GGUF build of meta-models/Muse-Glimmer-30B, published by bluevoid-pl.

• Base model: meta-models/Muse-Glimmer-30B
• Size: 27B params
• Architecture: muse-glimmer
• License: Apache 2.0
• HF: bluevoid-pl/Muse-Glimmer-30B-pruned-GGUF

Czym is

Muse Glimmer is a 30B causal language model built for autonomous agentic tasks on consumer hardware. It combines multi-step reasoning, reliable tool use, multimodal input (text + images) and failure recovery into a single model that runs locally without cloud infrastructure.

Pruning

This GGUF is pruned:

• Only latin characters are kept, so emojis and non-latin scripts are physically removed (model still thinks it can output them).
• Pruning reduces model size by ~25%, so it fits on limited VRAM.
• No guarantee of any kind that this GGUF works at all. It might break or die for no reason.

Running

Requires llama.cpp newer than b10430; older versions fail to load. Support in llama.cpp and ollama is partial - prefer the web interface over the CLI. On first start llama.cpp may hang for ~5min and warn special_eot_id is not in special_eog_ids - that warning is expected.

ollama run hf.co/bluevoid-pl/Muse-Glimmer-30B-pruned-GGUF:Q4_K_M

Quantizations