TIDEZINE.

GLM-5.3 Claims to Be the Strongest Open-Source Coding Model — Its Own Benchmarks Say Otherwise

Z.ai has launched GLM-5.3, a 743B-parameter model, but its official blog's own benchmark scores show it losing to Claude Fable 5 — and even falling behind Chinese rival Kimi K3 on some tests. The so-called "open-weights" aren't even downloadable yet.

GLM-5.3 Claims to Be the Strongest Open-Source Coding Model — Its Own Benchmarks Say Otherwise

Z.ai calls GLM-5.3 "the most capable open coding model," but flip open its own benchmark table and the story gets messier. On Terminal Bench 3.0, GLM-5.3 scored 28.3, trailing closed-source Claude Fable 5 (33.7) and GPT-5.6 Sol (34.6). On DeepSWE v1.1, which tests real GitHub issue resolution, its 66.9 also fell short of fellow open-source model Kimi K3's 67.5, as well as Fable 5's 69.7. An official document meant to prove GLM-5.3 is the best ended up making it pretty clear it isn't.

GLM-5.3 went live Thursday through the GLM Coding Plan subscription and ZCode, with API access and downloadable weights to follow in phases after security review. The model has 74.3 billion parameters, built on the GLM-5.2 base with expanded post-training. Z.ai's own words: "Scaling post-training is all we did for GLM-5.3" — over the past month, they added more environments, more diverse tasks, and more compute.

This release isn't about pushing scores higher — it's about saving tokens. On Z.ai's own Code Bench, GLM-5.3 hit 34.5% under Max effort, burning roughly 75,000 output tokens per task on average. GLM-5.2 scored 23.4% but burned 96,000 tokens. In other words: the new model scores higher while using less fuel. Compared to Claude Opus 4.8, Z.ai claims better token economics for GLM-5.3, but still admits it "remains behind Claude Fable 5, which reaches 39.5% at Max effort" — a line straight from their own blog.

The real highlight is in security testing. GLM-5.3 scored 84.5% on CyberGym, more than double GLM-5.2's score on vulnerability-discovery benchmarks. Z.ai says the model found 2,436 vulnerabilities across 269 open-source projects, with 1,097 rated medium-to-high risk. This is one of the few parts of the release that its own data didn't undercut.

Price is where open-source models can still compete. GLM-5.2's official API pricing runs $1.40 per million input tokens and $4.40 per million output tokens, with Z.ai claiming its overall API pricing is roughly one-tenth that of US frontier models. By comparison, GPT-5.3-Codex charges $1.75 in and $14 out, while Claude Opus 4.8 sits at the very top of Anthropic's price list. The GLM Coding Plan itself runs on a credit-based system, with off-peak usage discounted by half.

The "open-weights" label hasn't actually been fulfilled yet. The announcement states plainly that the weights won't be publicly released for another two weeks or so. What's available now is the subscription-based GLM Coding Plan and ZCode — not a downloadable file you can run yourself. Z.ai is a Beijing-based lab on the US Entity List, meaning US companies can't export controlled technology to it. Even so, Chinese open-source models have surpassed their American counterparts in token usage on OpenRouter, and the GLM series itself remains quite popular.

To sum up this self-undercutting announcement: GLM-5.3 beats its own predecessor and outperforms some open-source rivals, but on the most visible coding leaderboards, closed-source American frontier models still lead. And the "open-source" badge it's so proud of remains, for now, an IOU.

Related

Xbox Launches Mythic Achievements, Finally Scratching That Decade-Long Platinum Trophy Itch
Tech

Xbox Launches Mythic Achievements, Finally Scratching That Decade-Long Platinum Trophy Itch

Xbox has unveiled a new system called Mythic Achievements, awarded to players who fully complete a game's original achievement list. The system retroactively applies all the way back to Xbox 360-era titles, though it's currently only available to Xbox Insider testers.

Nick Valensi Shows Up at Jack White's Hollywood Gig — Plays Someone Else's Guitar Solo While on Break from The Strokes
Entertainment

Nick Valensi Shows Up at Jack White's Hollywood Gig — Plays Someone Else's Guitar Solo While on Break from The Strokes

The Strokes guitarist Nick Valensi unexpectedly appeared as a "special guest" at Jack White's Hollywood Palladium show during his break from the band's tour. His connection with White dates back to the 2002 Reading Festival.

Johnny Marr Talks New Album 'The Age Of Everything': The Case for Touring Songs Before Recording Them
Entertainment

Johnny Marr Talks New Album 'The Age Of Everything': The Case for Touring Songs Before Recording Them

Johnny Marr will release his fifth solo album on October 2, and he told NME about the rare approach this time around—taking eight songs out on the road before ever setting foot in the studio—as well as his thoughts on Fontaines D.C., The Cure, and what he's observed in the younger generation.

Father John Misty Wraps Existential Dread in Marvel Universe Imagery, Announces December US Tour After New Single
Entertainment

Father John Misty Wraps Existential Dread in Marvel Universe Imagery, Announces December US Tour After New Single

Father John Misty has released his new single "The X-panded Universe," borrowing superhero universe imagery to explore existential themes, while also announcing December US tour dates with Damien Jurado as opener.

La Roux Announces 2027 Tour, New Album "Old Flames" Bids Farewell to 17-Year Relationship
Entertainment

La Roux Announces 2027 Tour, New Album "Old Flames" Bids Farewell to 17-Year Relationship

Elly Jackson will embark on a 2027 tour spanning North America, Europe, and the UK, promoting her new album "Old Flames" alongside the run, with the final stop landing at Electric Brixton in London.

Zelda 40th Anniversary Orchestra Concert Quietly Adds Dates, Carnegie Hall and Hollywood Bowl Join the Tour Map
Entertainment

Zelda 40th Anniversary Orchestra Concert Quietly Adds Dates, Carnegie Hall and Hollywood Bowl Join the Tour Map

Less than a month after announcing its Legend of Zelda 40th Anniversary Orchestra Concert tour, Nintendo has quietly added new stops including New York's Carnegie Hall and the Hollywood Bowl, responding to fan complaints that the original 27-date run felt too limited.