Model Type
Vision-Language Model
Released
October 15, 2026
Parameters
600B
Model ID
stepfun-ai/Step-5-Preview
Capabilities
Step 5 Preview
Step 5 Preview is a multimodal sparse Mixture-of-Experts model built for agentic software engineering, long-horizon tool use, and finance-focused knowledge work. The model carries 600B total parameters and 27B active per token across 92 layers, with a 4,096 hidden size, 64 attention heads, and 4 KV heads. Sliding-window and full-attention layers alternate in a 3:1 pattern, while each MoE layer activates 8 of 352 routed experts plus a shared expert. Supporting a 1M-token context, it adds a Perception Encoder for image input and three Multi-Token Prediction layers.
About this model
Step 5 Preview is a multimodal sparse Mixture-of-Experts model built for agentic software engineering, long-horizon tool use, and finance-focused knowledge work. The model carries 600B total parameters and 27B active per token across 92 layers, with a 4,096 hidden size, 64 attention heads, and 4 KV heads. Sliding-window and full-attention layers alternate in a 3:1 pattern, while each MoE layer activates 8 of 352 routed experts plus a shared expert. Supporting a 1M-token context, it adds a Perception Encoder for image input and three Multi-Token Prediction layers.
Model specifications and capabilities are published by the model author and reproduced here from HF Model Card (stepfun-ai/Step-5-Preview). Released under StepFun Model License 1.0. Further reading: Blog
Deploy Private Inference Endpoint
Choose your hardware and inference engine to get deployment commands and performance benchmarks tailored to your infrastructure
Hardware
B200
1,440 GB
Engine
vLLM
SGLang
Deployment code
Access Restricted
Enter your email to get access to this content
Performance under load
Tokens/s (total)
Benchmarks measured by Vultr on B200 · SGLang. Throughput and latency vary with concurrency, input length and engine configuration, so treat these as a comparison baseline, not a service guarantee.
NVIDIA HGX B200
Unlock Next-Generation AI Power on Vultr Cloud GPU