Ornith 1.0 397B is a 397B parameter sparse Mixture-of-Experts model designed for high-performance agentic coding and software-engineering workflows. Built on Qwen3.5, it uses a 60-layer hybrid architecture combining linear and full attention, with a 4,096 hidden size, 32 attention heads, 2 KV heads, and 512 experts activating 10 per token. Approximately 17B parameters are active per token, with a 262K-token context window and multimodal support. Its self-improving RL framework jointly optimizes solution rollouts and scaffolds, enabling stronger search trajectories and higher-quality coding solutions.
Model specifications and capabilities are published by the model author and reproduced here from HF Model Card (ornith-ai/Ornith-1.0-397B). Released under MIT. Further reading: Blog
Choose your hardware and inference engine to get deployment commands and performance benchmarks tailored to your infrastructure
1,440 GB
Enter your email to get access to this content
Benchmarks measured by Vultr on B200 · vLLM. Throughput and latency vary with concurrency, input length and engine configuration, so treat these as a comparison baseline, not a service guarantee.