Tencent Releases and Open-Sources Hunyuan Hy3 Preview with 295B Parameters

Gate News message, April 23 — Tencent unveiled and open-sourced Hunyuan Hy3 preview, a hybrid mixture-of-experts language model featuring fast and slow thinking fusion. The model comprises 295 billion total parameters with 21 billion active parameters, supporting a maximum context length of 256K tokens. Hy3 preview is the first model trained after Hunyuan’s restructuring and Tencent’s most intelligent model to date. The company reports significant improvements in complex reasoning, instruction following, in-context learning, code generation, agentic capabilities, and inference performance. Chief AI Scientist Yao Shunyu stated that Hy3 preview marks the first step of Hunyuan’s reconstruction and expressed hope that open-source community feedback will enhance the formal version’s practical utility.

Tencent is simultaneously scaling pretraining and reinforcement learning to elevate the model’s intelligence ceiling and collaborating with multiple Tencent products through deep co-design to improve real-world performance. The company is also beginning to explore specialized model capabilities.

Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to Disclaimer.
Comment
0/400
No comments