Fable 5 leads at 58%. The field ranges from 58% to 19%.
The headline metric is the solve rate (Reward): the share of tasks a model solves. A task counts as solved when the two experts' mean rubric score is at least 3.0/5 and the answer covers at least 60% of the checklist.
Explore the full leaderboard
The gap to expert performance is still wide.
Go deeper.
Methodology
The seven-step pipeline behind every task, from expert authoring to adjudicated gold data.
OpenDataset & reliability
What the 598 tasks are made of, and how closely two independent experts agree.
OpenLeaderboard
Full rankings and per-domain breakdowns for all six frontier models.
OpenFailure modes
Where and why each model breaks down, in experts' own written rationale.
OpenFive graded tasks
Read the prompt, six blind answers and both experts' grades, then reveal the models.
OpenGrounded in real European markets.
Every task is set in a named market. Only direct mentions count: a task that says "Nordics" or "DACH" is left out of the country counts. Percentages add up to more than 100% because many tasks name several markets.
Plus 20 more markets, shaded on the map by how often they appear.
Put your model on EuroExec.
Two ways to run your model on EuroExec. We'll run it and send you the item-level failures. Domain experts who want to write or grade the next batch can use the same form.
Full held-out evaluation
We run your model on the full held-out set and send back task-level scores, checklist coverage and both experts' written rationale for every answer.
Private checkpoint evaluation
Run EuroExec on unreleased checkpoints before launch. Results stay private to your team. We never train on, or sell data derived from, the held-out set we score you against.
You're on the list
We reply within one business day. What happens next:
- Labs: a short scoping call, then we run your model on the held-out set and send the item-level failures, checklist coverage and both experts' rationale.
- Domain experts: a short note on the authoring process and the domains we're expanding.
The next release adds new domains and more European jurisdictions. Requests hear about it first.