InternLM Atria Dawn

Atria Dawn Preview is an agentic model built on the 744B-parameter GLM-5.2 foundation. It uses a 78-layer sparse Mixture-of-Experts architecture with 256 routed experts and 8 activated per token, combining DeepSeek Sparse Attention (DSA) with dense and sparse MLP layers. The model supports a 1M-token context window and 64 attention heads, with 64 key-value heads and one next-token prediction layer. It targets scientific automation, software creation, research, document generation, cybersecurity, and long-horizon tasks requiring iterative tool use and execution.