Meta Muse Glimmer

Muse Glimmer 30B is a multimodal dense causal language model designed for autonomous agentic tasks, combining multi-step reasoning, reliable tool use, failure recovery, and visual understanding. It has 30B parameters, including a dedicated 1.8B-parameter perception encoder, with a 52-layer language model using a 6,656 hidden size and 32 attention heads. The language model uses a repeating 3:1 local-to-global attention pattern with a 2,048-token sliding window and GQA with 32 query and 2 KV heads. It supports text and image inputs with a 131K+ context window and is optimized for local deployment and long-horizon agent workflows.