InclusionAI Ling 3.1

Ling 3.1 Flash 1019 is a post-trained update of Ling 3.1 Flash, a hybrid-linear Mixture-of-Experts model for real-world agents, scientific reasoning, and coding. The model carries 560B total parameters and 25B active in a 72-layer stack with 4,096 hidden size, 64 attention heads, and 64 KV heads. Its 63 Kimi Delta Attention layers are interleaved with 9 gated MLA layers, and the sparse blocks select 8 of 512 routed experts alongside a shared expert. It supports a 1M-token context and includes a Multi-Token Prediction layer for agentic workloads.

Ling 3.1 Flash is a native hybrid reasoning Mixture-of-Experts model designed for general-purpose agents, office productivity, and software engineering. Building on Ling 3.0 Flash, it scales to 560B total parameters with 25B active, using a 72-layer architecture with 4,096 hidden size, 64 attention heads, and 64 KV heads. Kimi Delta Attention and gated MLA layers alternate in a 7:1 ratio, while MoE layers route each token to 8 of 512 experts plus a shared expert. Supporting a 1M-token context, it adds a Multi-Token Prediction layer for speculative decoding.