Thinking Machines Inkling

Inkling is a native multimodal Mixture-of-Experts model designed for reasoning, coding, conversational AI, retrieval-augmented generation, and agentic workflows across text, image, audio, and video. It features 975B total parameters with 41B activated, using a 66-layer architecture with 6,144 hidden size and 64 attention heads. The model activates 6 experts per token across 256 routed experts alongside 2 shared experts, combining hybrid local and global attention with Multi-Token Prediction for efficient inference. Supporting up to a 1M token context window, it is optimized for large-scale multimodal understanding and long-context applications.

Inkling Small is a multimodal Mixture-of-Experts model with 276B total parameters and 12B active parameters, designed for conversational, coding, retrieval, and agentic applications. It features a 42-layer decoder-only architecture with 32 attention heads, 256 routed experts activating 6 per token, and 2 shared experts. Supporting text, image, and audio inputs, it uses hybrid local and global attention with a 1M-token context window and a 512-token sliding window, while supporting BF16 and NVFP4 numerics.