#reasoning_traces

1 item tagged #reasoning_traces

Articles

GeneralTier 2

Tencent's Hy4 reaches 770B parameters with 1M token context window

Simon Willison · 5 min

Highlights

  • Hy4 expands to 770B parameters with 1M context window
  • Inspect reasoning traces via Hugging Face chat_template.jinja
  • Two reasoning modes: high (default) or no_think disabled
  • Open-weight model available for local deployment

Tencent released Hy4 Preview, a new open-weight text-only large language model with 770B total parameters and a 1M token context window—a significant step up from its July predecessor Hy3 (295B parameters, 256K context). The model includes a configurable reasoning system with two effort levels: 'high' (default) and 'no_think' (reasoning disabled). Early testing shows the model's reasoning traces use informal, token-efficient language while working through creative tasks like generating SVG graphics. The model is available on Hugging Face at 1.56TB. This release signals continued competition in open-weight model development and demonstrates how reasoning traces can be inspected via chat templates to understand model decision-making.