# LLM.txt - Tencent Hy4 Makes Open-Weight AI Too Important to Ignore ## Article Metadata - **Title**: Tencent Hy4 Makes Open-Weight AI Too Important to Ignore - **URL**: https://www.llmrumors.com/news/tencent-hy4-open-weight-ai-zai-flywheel - **Publication Date**: August 30, 2026 - **Reading Time**: 9 min read - **Tags**: Tencent, Hy4 Preview, Open Weights, Z.ai, GLM-5.3-Flash, Chinese AI, Mixture of Experts, AI Infrastructure - **Slug**: tencent-hy4-open-weight-ai-zai-flywheel ## Summary Tencent's Hy4 preview pairs a 770B-parameter sparse backbone with Apache-2.0 weights. Together with Z.ai's GLM releases, it shows why open-weight AI is becoming a strategic market, not a side project. ## Key Topics - Tencent - Hy4 Preview - Open Weights - Z.ai - GLM-5.3-Flash - Chinese AI - Mixture of Experts - AI Infrastructure ## Content Structure This article from LLM Rumors covers: - Technical implementation details - Legal analysis and implications - Industry comparison and competitive analysis - Data acquisition and training methodologies - Financial analysis and cost breakdown - Human oversight and quality control processes - Comprehensive source documentation and references ## Full Content Preview TL;DR: Tencent released Hy4 preview on August 28 with a 770 billion-parameter sparse backbone, 49 billion active parameters per token, a separate 10 billion-parameter multi-token-prediction layer, a 1,048,576-position configuration, and weights under Apache-2.0.[1][2][5] The real story isn't a claimed benchmark win. Hy4, arriving days after Z.ai's GLM-5.3-Flash release, shows that open-weight AI is becoming a serious product and infrastructure strategy rather than a charitable side project. Here is the simple version. An AI model is the engine. The app, tools, cloud service, and evaluation system around it are the car. Tencent has made Hy4's engine downloadable, but it also put the easiest roads to that engine inside CodeBuddy, WorkBuddy, Tencent Cloud, and OpenRouter.[1][6] That matters because open weights give developers a real escape hatch. A team can inspect the artifact, run it with supported serving software, adapt it, or move it to another host. Tencent can still win by making its own managed route more convenient. Open weights and commercial cloud distribution are not opposites. They can be the same funnel. The timing makes the release more important. Our earlier GLM-5.3 analysis argued that public weights, papers, and serving tools can compound across model families. Hy4 is the immediate test of that thesis: a second major Chinese platform company has shipped another long-context, tool-oriented model with inspectable weights and a permissive license. Hy4 is not just a checkpoint on Hugging Face. Tencent launched it across coding, office, consumer, cloud, and model-routing surfaces. Z.ai is pursuing a related strategy with GLM-5.3 and GLM-5.3-Flash. The competitive question is shifting from who owns one model to who can make an open model easiest to evaluate, customize, serve, and improve. Hy4 In Plain English: A Giant Model That Wakes Only Part Of Itself Hy4 is a text-generation model built as a Mixture of Experts, or MoE. Imagine a newsroom containing hundreds of specialist desks. Each time the model processes a token, a router calls a small set of desks instead of waking the entire building. Tencent reports a 770B-parameter backbone with 49B parameters active per token. The first of its 78 layers uses a dense feed-forward network. The remaining 77 layers each contain 256 routed experts plus one shared expert, with the router selecting eight routed experts for a token.[2][4] That is roughly 6.4% of the backbone activated per token, but active-parameter count is not the same thing as latency, memory use, or cost. There is a counting wrinkle. Tencent's 770B figure excludes a native multi-token-prediction, or MTP, layer with another 10B total and 0.7B active parameters. Hugging Face therefore displays the repository as a 780B model.[2] Neither number is wrong. They count different boundaries, which is why model-size comparisons need footnotes. Hy4's configuration permits 1,048,576 positions. That is the model's maximum-position setting, not a promise that every provider will accept a million-token prompt at every output length, batch size, or concurrency level. Tencent-linked SGLang examples document 131,072-token BF16 service on H200 hardware and 262,144-token recipes on specified Blackwell systems.[8] What Tencent Actually Opened: Useful Weights, Not A Reproducible Training Recipe Tencent calls Hy4 open source. The precise description is open weights under Apache License 2.0, accompanied by an inspectable configuration, chat template, deployment recipes, and fine-tuning support.[2][4][5] Th... [Content continues - full article available at source URL] ## Citation Format **APA Style**: LLM Rumors. (2026). Tencent Hy4 Makes Open-Weight AI Too Important to Ignore. Retrieved from https://www.llmrumors.com/news/tencent-hy4-open-weight-ai-zai-flywheel **Chicago Style**: LLM Rumors. "Tencent Hy4 Makes Open-Weight AI Too Important to Ignore." Accessed September 2, 2026. https://www.llmrumors.com/news/tencent-hy4-open-weight-ai-zai-flywheel. ## Machine-Readable Tags #LLMRumors #AI #Technology #Tencent #Hy4Preview #OpenWeights #Z.ai #GLM-5.3-Flash #ChineseAI #MixtureofExperts #AIInfrastructure ## Content Analysis - **Word Count**: ~1,623 - **Article Type**: News Analysis - **Source Reliability**: High (Original Reporting) - **Technical Depth**: High - **Target Audience**: AI Professionals, Researchers, Industry Observers ## Related Context This article is part of LLM Rumors' coverage of AI industry developments, focusing on data practices, legal implications, and technological advances in large language models. --- Generated automatically for LLM consumption Last updated: 2026-09-02T00:37:14.414Z Source: LLM Rumors (https://www.llmrumors.com/news/tencent-hy4-open-weight-ai-zai-flywheel)