A glowing neural network pattern spreading through layers of code on a dark screen, bright orange and blue nodes illuminating hidden pathways in software infrastructure
News

GLM-5.3 Found 2,436 Real Vulnerabilities by Accident — Zhipu's Post-Training Surprise

GLM-5.3 uses the same base model as GLM-5.2. Every improvement came from post-training. But the cyber capability that emerged — finding 2,436 real vulnerabilities including 1,097 critical ones — was not part of the plan.

Zhipu AIGLM-5.3CybersecurityOpen Source AIChina

Zhipu AI released GLM-5.3 on August 14, and the coding benchmarks are impressive enough — a 50 per cent improvement over GLM-5.2 on their in-house code bench, open-source state-of-the-art on Terminal Bench 3.0. But the headline that grabbed 926 upvotes on Hacker News isn’t about coding. It’s about what happened when they scaled post-training and the model started finding real security vulnerabilities — 2,436 of them, across 269 open-source projects, including 1,097 medium-to-high severity issues. Some of the flaws had been sitting in production code for 40 years.

What is GLM-5.3? GLM is Zhipu AI’s frontier model series, built under the Z.ai brand. The 5.3 release uses the exact same base model as 5.2 — roughly 744 billion parameters. Every gain comes from post-training: reinforcement learning on long-horizon tasks, scaling up the training environments rather than the model itself. Think of it as the same brain, trained harder.

The Capability That Wasn’t Planned

Zhipu introduced vulnerability discovery data into the training mix expecting GLM-5.3 would get better at identifying isolated flaws. What they got was something qualitatively different. The model began reasoning across multiple stages of exploitation — not just finding a bug, but forming a coherent plan to exploit it end-to-end.

In Zhipu’s own words, the capability “developed faster than we expected” as training scaled. On CyberGym, which tests whether a model can identify and validate vulnerabilities in source code, GLM-5.3 scored 84.5 per cent — ahead of Anthropic’s Fable 5 at 83.8 per cent and GPT-5.6 Sol at 83.6 per cent. On ExploitBench, which requires deeper reasoning about real vulnerabilities, it more than doubled from GLM-5.2’s 24.4 per cent to 54.4 per cent.

The pattern is striking: the further up the exploitation chain a benchmark sits, the larger the gain from GLM-5.2 — and also the wider the remaining gap to the closed frontier. Fable 5 still scores 78.0 on ExploitBench and completes 247 exploitation tasks in six hours on ExploitGym, compared with GLM-5.3’s 130. Capability is growing fastest exactly where Zhipu is furthest behind.

2,436 Real Bugs, 45 Years of Impact

The benchmark numbers are one thing. The real-world results are another. Working with security teams in China, Zhipu ran GLM-5.3 against real codebases — system kernels, operating systems, browser engines, open-source infrastructure, web applications, network protocols. After expert review, screening, and deduplication, the model identified 2,436 vulnerabilities. Of those, 1,097 were medium-to-high severity, 107 were critical.

The findings span 45 years of code. The oldest vulnerability was introduced in 1981. On average, a vulnerability had lived 26.6 years before GLM-5.3 found it.

Zhipu has built a public Security Disclosure Ledger to track the findings through the coordinated vulnerability disclosure process. As of the announcement, 53 issues were publicly disclosed with CVE numbers where available; 2,383 remained under embargo. The ledger records the affected project, severity, and how long the flaw had been in the codebase.

The Coding Story Is Also Strong

The cyber capability may be the surprise, but GLM-5.3’s primary mission was coding. The results are legitimate:

  • Terminal Bench 3.0: 28.3, up from GLM-5.2’s 4.6 — a six-fold jump
  • DeepSWE v1.1: 66.9, up from 46.2
  • Agents’ Last Exam: 28.5, up from 23.8

According to The Decoder, GLM-5.3 is available now through the GLM Coding Plan and works with coding agents including ZCode, Claude Code, and OpenCode. Open weights are coming in two weeks, pending safety evaluation.

On Zhipu’s internal Z.ai Code Bench, the model delivers stronger agentic coding results than GLM-5.2 at every effort level while consuming fewer tokens. At High effort, it reaches 31.4 per cent task completion at roughly 50K output tokens — surpassing Claude Opus 4.8’s 29.5 per cent at 120K. That’s a 2.4x token efficiency advantage. Fable 5 still leads at 39.5 per cent on Max effort, but GLM-5.3 is closing the gap from a much lower price point.

Why This Matters

Two things stand out.

First, the emergent cyber capability raises the same uncomfortable question that every frontier lab is grappling with: as models get better at reasoning about code, they get better at breaking code. Zhipu is publishing a disclosure ledger and working with security teams — the responsible approach. But the fact that a model can find 1,097 critical vulnerabilities by accident, while being trained for something else, is a signal about where capability is heading. As Caixin Global noted, Zhipu is positioning GLM-5.3 directly against Anthropic and OpenAI on the cyber axis.

Second, this is a post-training story. Same base model as GLM-5.2. No new parameters. The entire gain came from scaling reinforcement learning environments — more tasks, more diverse scenarios, more compute spent on the training loop. If Zhipu can extract this much uplift from post-training alone, the implication for the rest of the field is that base model size is becoming less decisive than training methodology. That’s the same lesson DeepSeek’s V4 Pro GA delivered the same week, from a different angle.

NZ Angle

New Zealand’s small open-source community contributes to projects that are now being scanned by models like GLM-5.3. The disclosure ledger is public — any NZ developer contributing to infrastructure projects in the 269 scanned repos could find their code on that list. More broadly, the emergence of AI-driven vulnerability discovery shifts the economics of security auditing. Tools that used to require expensive penetration testing firms are increasingly available as API calls. For NZ’s under-resourced open-source maintainers, that’s a double-edged sword: the bugs get found faster, but so does the exploit potential.

❓ FAQ

Is GLM-5.3 open source? Weights will be released in approximately two weeks, after safety evaluation and hardening. The model is available now via the GLM Coding Plan API and through coding agents like ZCode, Claude Code, and OpenCode.

How does GLM-5.3 compare to Claude Fable 5? On coding benchmarks, GLM-5.3 trails Fable 5 on most metrics but closes the gap significantly from GLM-5.2. On CyberGym, GLM-5.3 actually edges ahead (84.5 vs 83.8). On exploitation benchmarks, Fable 5 remains substantially ahead. The key differentiator is price: GLM-5.3 is positioned as a much cheaper open-weights alternative.

What is the Security Disclosure Ledger? A public registry at cvd.z.ai maintained by Zhipu that tracks vulnerabilities found by GLM-5.3. It distinguishes between publicly disclosed issues (with CVE numbers) and those still under embargo. It records the affected project, severity, and how long the vulnerability existed in the codebase.

Should the emergent cyber capability worry people? The dual-use nature is real — a model that can find vulnerabilities for defensive purposes can theoretically find them for offensive ones. Zhipu’s decision to route findings through coordinated disclosure is the responsible approach. The broader question is whether every lab training frontier models is taking the same care.

How is this different from GLM-5.2? Same base model, different post-training. GLM-5.3 spent more compute on reinforcement learning across a broader range of environments — including vulnerability discovery. Every benchmark improvement, including the emergent cyber capability, came from the training process, not from a larger or re-architected model.

📰 Sources

Sources: Z.ai Blog, The Decoder, Pandaily, WCCFTech, Caixin Global, Tech Times