Mistral Unveils Le Chonk, a 1T-Parameter Open Model

Mistral launched a public preview of Large 4, a one-trillion-parameter sparse model nicknamed Le Chonk, with open weights due October 27.

Read as article

Mistral Unveils Le Chonk, a 1T-Parameter Open Model

By @sharedot · · 8 pages

  • AI Frontier
  • Open Weight Models
  • Mistral
  • Benchmarks

Mistral launched a public preview of Large 4, a one-trillion-parameter sparse model nicknamed Le Chonk, with open weights due October 27.

A trillion parameters, born from a meme

Mistral has launched a public preview of Mistral Large 4, a one-trillion-parameter multimodal model code-named "Le Chonk," VentureBeat reports. The Paris lab says the model pushes it back toward the global open-weight frontier, with a focus on coding, cybersecurity, finance, manufacturing and visual grounding. WIRED adds that Mistral presents Le Chonk as the most capable open-weight model developed outside China and "very, very close" to some proprietary systems. The nickname deliberately nods to the viral "Le Chaton Fat" meme from June, a fictional fat-cat model the community invented; VentureBeat notes CEO Arthur Mensch and investor Marc Andreessen amplified the joke, and co-founder Guillaume Lample suggested ML4 can be viewed as an initial version of that imagined model, with still larger ones to come.

Sparse architecture and modest training bill

Although ML4 contains one trillion parameters, only 49 billion are active during inference, VentureBeat reports — a sparse mixture-of-experts design continuing the trend of huge total capacity with small active footprints. According to VentureBeat, the model was trained from scratch over roughly two months on 4,000 Nvidia Grace Blackwell GPUs in Mistral's own European data centers, which the company argues is modest relative to larger U.S. labs; its previous Large 3 model (675B total, 41B active) used 3,000 H200s. Mistral says it trained across more than 160 languages, including every official EU language. WIRED reports Mistral claims the model was trained from scratch rather than distilled from proprietary outputs, a pointed contrast amid US accusations against Chinese labs. The model accepts multimodal inputs but still produces text output, Lample confirmed to VentureBeat.

Benchmarks look strong but need caveats

Mistral's preliminary charts show ML4 at 62% on the DeepSWE v1.1 software-engineering benchmark, ahead of Beam, Qwen 3.8 Max, DeepSeek V4 Pro 0813 and GLM-5.3 as configured. VentureBeat cautions that the live DeepSWE leaderboard, selecting best configurations, puts GLM-5.3 and Kimi K3 near 69% and top closed models around 74%, so ML4's 62% is competitive but not an outright coding lead. Mistral also reports 15% on Harvey's Legal Agent Benchmark, 67% on the Finch finance benchmark, and visual-grounding scores of 42% on Dense200 and 73% on DIOR-RSVG. VentureBeat notes some competitor figures in Mistral's slides could not be independently located in public sources, and ML4 has yet to appear in Artificial Analysis' public evaluations, so ranking claims remain provisional until outsiders test the released weights.

Why cybersecurity is the strategic wedge

Mistral is pitching open weights specifically for security teams, VentureBeat reports. Its argument: enterprises cannot depend entirely on closed providers whose safety systems may refuse dual-use but legitimate defensive requests, so an open-weight model gives security teams greater control over code scanning, defensive testing and other high-volume security workflows without depending on a provider's changing moderation policy. Lample told WIRED that the stakes extend beyond Europe: "If you use a closed model, there is no guarantee it will still be there tomorrow." WIRED also reports the Trump administration temporarily restricted distribution of OpenAI and Anthropic models in June over cyberattack concerns, and that the White House reportedly asked American labs to withhold unreleased models even from the UK's AI Safety Institute — reminders that access to frontier AI can be unilaterally revoked, which WIRED says has opened the door for a Europe-based open-weight lab.

The bet: commoditized weights, valuable stack

ML4 arrives on a hot streak. VentureBeat and WIRED both report that in September Mistral raised about €3 billion (roughly $3.3 billion) at a post-money valuation above €21 billion — about $24 billion per Reuters — the largest equity raise by a European tech company. VentureBeat says Mistral now supports more than 125 enterprises including Airbus, ASML and HSBC, and that its stack has grown to include developer products, customization services, inference infrastructure and Mistral Compute. According to VentureBeat, Lample has scaled the science team from three researchers to roughly 300, and Lample told VentureBeat that customers increasingly need deployment, infrastructure and engineering support around complex AI workflows — Mistral is betting weights commoditize while the surrounding enterprise business carries the value.

What comes next

VentureBeat reports the weights are expected under a custom Mistral license on October 27, after roughly three weeks of testing with developers, cybersecurity leaders and government authorities; the preview period will also let Mistral continue reinforcement learning and tune the final checkpoint. WIRED confirms a final version is due by the end of the month. Meanwhile, the release lands amid a widening Western open-weight push: TechCrunch and Fortune report Reflection AI debuted Beam, a 501-billion-parameter open model, on October 5, meaning ML4 already has a direct Western rival's numbers in its own benchmark charts. The decisive test, as VentureBeat frames it, is whether ML4's final checkpoint holds up once independent evaluators can run it — after October 27, the nickname matters less than what developers can reproduce on their own hardware.

Sources

  1. venturebeat.com › Mistral debuts Large 4 'Le Chonk', a 1-trillion parameter text output model with high benchmarks planned for open weights release
  2. wired.com › Mistral Says Its New AI Model 'Le Chonk' Is the Best Open-Weight Offering Outside of China
  3. techcrunch.com › Reflection debuts Beam, an open-weight AI model to rival Chinese models at lower compute cost

More on AI Frontier