Params: 501B
Beam 1.0 501B A23B is a sparse Mixture-of-Experts text model designed for token-efficient reasoning, software engineering, agentic tool use, and long-horizon task completion. It carries 501B total parameters with 23B active, built on a 52-layer architecture with 5,120 hidden size, 48 attention heads, and 8 KV heads. Gated grouped-query attention pairs 43 sliding-window layers with 9 full attention layers, and the 49 MoE layers route each token to 8 of 256 experts. Supporting a 1M-token context, it is refined through reinforcement learning across coding, agentic, and STEM environments.
Text GenerationInstruction Following+7