Knowledge Base

Curated X posts, YouTube videos, repositories and articles on AI, web development and design. Updated every day, summarised by AI and searchable with AI search.

Topics

1 entry

Keyword: tencent-hunyuan

Repository:Tencent-Hunyuan/Hy4-preview5 Sept 2026
Tencent Hunyuan Unveils Hy4-preview: 770B MoE Model with Sparse Attention
The Tencent Hy Team has introduced Hy4-preview, a new flagship Mixture-of-Experts (MoE) model featuring 770B total parameters with 49B activated per token. The architecture incorporates MoE routing, Gated DeepSeek Sparse Attention, and a native MTP layer for speculative decoding.
344starsPython
From Video: Weekly AI Updates: Local Models, GPT-6 Astra, and Agent Architectures
AI & LLMs· Announcement

1 of 1 shown

Suggest Content

Do you have an interesting article, a video, or a tweet that belongs in our knowledge base? Write to us at office@webconsulting.at.

Let's talk about your project

Get in touch

Locations

Mattersburg
Johann Nepomuk Bergerstraße 7/2/14
7210 Mattersburg, Austria
Vienna
Ungargasse 64-66/3/404
1030 Wien, Austria

Parts of this content were created with the assistance of AI.

Knowledge Base

Tencent Hunyuan Unveils Hy4-preview: 770B MoE Model with Sparse Attention

Suggest Content

Let's talk about your project

Locations