• Pricing
DashboardContact Sales
  • Blogs
  • Discover
  • Docs
  • Community
  • AgentBeta
⌘K

Over 80,000,000 Cloud Servers Launched

Over 80,000,000 Cloud Servers Launched

Cloud ComputeCloud GPUBare MetalFile SystemObject StorageBlock StorageManaged DatabasesCDNServerlessKubernetesContainer RegistryDirect ConnectLoad Balancers
RegionsAdvanced NetworkControl PanelOperating SystemsUpload ISO
Industry CloudOne-Click DeploymentUse Cases
Browse AppsBecome a Vendor
FAQDevelopers / APIsVultr DocsServer StatusBug BountyPromotionsSolution PartnersStart-Up Programs
Our TeamNewsBrand AssetsReferral ProgramCreator ProgramCareersSLALegalVultr Trust CenterContactYour Privacy ChoicesSubprocessorsAccessibility
Contact SalesSign Up

© Vultr 2026 | VULTR is a registered trademark of The Constant Company, LLC.

Terms of ServiceAUPDMCAPrivacy PolicyCookie Policy
Model Library
Arcee AI
PoolsideReflection AI
Hy4 FlashHy4Hy4 Preview
Tencent Hy3
  1. Docs
  2. More
  3. Model Library
  4. Tencent Hy4
  5. Hy4

Hy4

Hy4 is a multimodal Mixture-of-Experts model built for computer use, frontend and game development, financial analysis, and scientific research. Its language backbone holds 770B total parameters with 49B active, arranged in a 78-layer architecture with 6,144 hidden size and 64 attention heads. Gated DeepSeek Sparse Attention selects the top 2,048 tokens through IndexCache, while each of the 77 MoE layers activates 8 of 256 routed experts plus a shared expert. Supporting a 1M-token context, it pairs a 40-layer vision encoder with a 5-layer DFly2 drafter for speculative decoding.

Deploy with NVIDIA B200Contact Sales

About this model

BlogHF Model Card

Hy4 is a multimodal Mixture-of-Experts model built for computer use, frontend and game development, financial analysis, and scientific research. Its language backbone holds 770B total parameters with 49B active, arranged in a 78-layer architecture with 6,144 hidden size and 64 attention heads. Gated DeepSeek Sparse Attention selects the top 2,048 tokens through IndexCache, while each of the 77 MoE layers activates 8 of 256 routed experts plus a shared expert. Supporting a 1M-token context, it pairs a 40-layer vision encoder with a 5-layer DFly2 drafter for speculative decoding.

Model Type

Vision-Language Model

Released

November 20, 2026

License: Tencent Hy License

Parameters

770B

Model ID
tencent/Hy4-FP8
Capabilities
Text GenerationInstruction FollowingReasoningMathematical ReasoningCode Generation+5

Model specifications and capabilities are published by the model author and reproduced here from HF Model Card (tencent/Hy4-FP8). Released under Tencent Hy License. Further reading: Blog

Deploy Private Inference Endpoint

Choose your hardware and inference engine to get deployment commands and performance benchmarks tailored to your infrastructure

Hardware

B200

1,440 GB

Engine

vLLM
SGLang

Deployment code

INFERENCE COMMAND
Access Restricted

Enter your email to get access to this content

Powered by Vultr AgentBeta

Performance under load

23k18k14k9.2k4.6k0163264128256512Total Tokens / secConcurrent requests
Tokens/s (total)

Benchmarks measured by Vultr on B200 · vLLM. Throughput and latency vary with concurrency, input length and engine configuration, so treat these as a comparison baseline, not a service guarantee.

SS

Shivam Sharma

View Profile
View Profile

NVIDIA HGX B200

Unlock Next-Generation AI Power on Vultr Cloud GPU

Deploy NowContact Sales

NVIDIA HGX B200

Starting Price
$3.50
/GPU/hr
Deploy Now

Tech Talk: Running a Self-Improving AI Agent with Hermes on Vultr

From The Blog

Optimize CPU Spend to Accelerate AI: A FinOps Approach to Infrastructure Investment

November 18, 2026

KubeCon + CloudNativeCon 2026: Growing Our Open Source Community in Salt Lake City

November 16, 2026

Optimizing Agentic AI Workflows Through Full-Stack Infrastructure

November 13, 2026

View all posts