Deploying Tencent Hy4 Preview: vLLM vs SGLang Setup Guide + 1M Context Window API Tips

Deploying Tencent Hy4 Preview: vLLM and SGLang Setup Notes Tencent’s Hy4 preview is a 770B-parameter MoE model with 49B active parameters and a 1M context window. The weights are available on Hugging Face, ModelScope, GitCode, and CNB, including an FP8 quantized version. This guide walks through production deployment using vLLM or SGLang, plus the API calls you’ll need to actually use the model. Where to Find the Real Value in the README The official README is straightforward—architecture specs, benchmark numbers, license—but the most actionable content lives in the Inference and Deployment section. Both vLLM and SGLang are officially supported, and …