Nex AGI
Nex N2.5 Pro is a multimodal agentic model designed for long-horizon tasks, computer use, web browsing, scientific research, knowledge work, and visually grounded workflows. The 397B model uses a 60-layer architecture with 4,096 hidden size, 32 attention heads, and 2 KV heads, combining linear attention with full attention every fourth layer. The architecture employs 512 routed experts, 10 activated per token, and a shared expert, with 1,024-dimensional MoE layers and SiLU activation. Supporting a native 262,144-token context, it incorporates a 27-layer vision encoder for image and video understanding.
Nex AGI
Nex N2.5 Mini is a multimodal agentic model designed for long-horizon tasks involving computer use, web browsing, and visually grounded interaction. The 30B model uses a 40-layer sparse Mixture-of-Experts architecture with 256 experts and 8 activated per token, combining linear attention with full attention every fourth layer. It has a 2,048-dimensional hidden size, 16 attention heads, and 2 key-value heads, with one additional next-token prediction layer. Its vision encoder supports image and video inputs, while the model provides a 262K-token context window for extended research, knowledge work, and productivity tasks.