
Tencent's Hy4 reaches 770B parameters with 1M token context window
Highlights
- Hy4 expands to 770B parameters with 1M context window
- Inspect reasoning traces via Hugging Face chat_template.jinja
- Two reasoning modes: high (default) or no_think disabled
- Open-weight model available for local deployment
Tencent released Hy4 Preview, a new open-weight text-only large language model with 770B total parameters and a 1M token context window—a significant step up from its July predecessor Hy3 (295B parameters, 256K context). The model includes a configurable reasoning system with two effort levels: 'high' (default) and 'no_think' (reasoning disabled). Early testing shows the model's reasoning traces use informal, token-efficient language while working through creative tasks like generating SVG graphics. The model is available on Hugging Face at 1.56TB. This release signals continued competition in open-weight model development and demonstrates how reasoning traces can be inspected via chat templates to understand model decision-making.