Params: 119B
Mistral Small 4 119B 2603 is a hybrid multimodal Mixture-of-Experts model that unifies instruction-following, reasoning, and coding capabilities into a single system. It contains 119B parameters with ~6.5B active per token, using 128 experts with 4 selected per token across a 36-layer architecture with 4,096 hidden size and 32 attention heads. Supporting up to a 256K context window, it enables dynamic reasoning modes, vision understanding, and strong agentic tool calling with structured outputs, making it well-suited for high-throughput, real-world AI systems.
Text GenerationInstruction Following+8