Z.ai GLM 5.1

GLM 5.1 is a large-scale Mixture-of-Experts (MoE) language model and a successor to GLM 5 with improved capabilities and performance, designed for long-context reasoning, coding, and agentic workflows. The model has 744B total parameters with 40B activated, using a 78-layer transformer with 6,144 hidden size and 64 attention heads. It routes tokens across 256 experts with top-8 selection for efficient sparse computation. The model supports up to ~202K context length with RoPE scaling and uses FP8 (e4m3) quantization to reduce memory and improve throughput while maintaining strong multi-step reasoning performance.