Model ID
meta-models/Muse-Spark-Open-816B-A42B
Capabilities
Muse Spark Open 816B A42B
Muse Spark Open 816B A42B is a natively multimodal Mixture-of-Experts model for coding agents, tool use, and reasoning over images, audio, and video. It features 816B total parameters with 42B active, using a 62-layer architecture with 8,192 hidden size, 128 attention heads, and 16 KV heads. Every layer routes tokens to 8 of 256 experts, while the attention stack interleaves 46 sliding-window layers with 16 full-attention layers. Supporting a 1M-token context, it adds a 1.8B-parameter Perception Encoder and an audio encoder, with adjustable reasoning effort for agentic workloads.
About this model
Muse Spark Open 816B A42B is a natively multimodal Mixture-of-Experts model for coding agents, tool use, and reasoning over images, audio, and video. It features 816B total parameters with 42B active, using a 62-layer architecture with 8,192 hidden size, 128 attention heads, and 16 KV heads. Every layer routes tokens to 8 of 256 experts, while the attention stack interleaves 46 sliding-window layers with 16 full-attention layers. Supporting a 1M-token context, it adds a 1.8B-parameter Perception Encoder and an audio encoder, with adjustable reasoning effort for agentic workloads.
Model specifications and capabilities are published by the model author and reproduced here from HF Model Card (meta-models/Muse-Spark-Open-816B-A42B). Released under Muse Model License. Further reading: Blog
Deploy Private Inference Endpoint
Choose your hardware and inference engine to get deployment commands and performance benchmarks tailored to your infrastructure
Hardware
B200
1,440 GB
Engine
vLLM
SGLang
Deployment code
Access Restricted
Enter your email to get access to this content
Muse Spark Open is a gated model; ensure you have been granted access on Hugging Face and have authenticated your environment using a valid HF_TOKEN.
Performance under load
Tokens/s (total)
Benchmarks measured by Vultr on B200 · vLLM. Throughput and latency vary with concurrency, input length and engine configuration, so treat these as a comparison baseline, not a service guarantee.
NVIDIA HGX B200
Unlock Next-Generation AI Power on Vultr Cloud GPU