LakeQA - Mini: leaderboard
LakeQA (2026) tests LLM agents on exploratory multi-hop question answering over a data lake of about 40 million Data.gov and Wikipedia documents, where the agent must search, download and query the relevant files before answering. This board is exact match in percent on LakeQA-mini, a stratified 135-task subset of LakeQA-full; higher is better.
Metric: End-to-end exact match (%) on the 135 LakeQA-mini tasks, a stratified subset of LakeQA-full that preserves the reasoning-intensity distribution; the agent answers a multi-hop question over a data lake of about 40 million Data.gov and Wikipedia documents with one tool call per round (search, list, download, inspect, query) until it answers or hits the turn limit; exact match against the annotator-verified answer; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude Opus 4.5 | 45.93 | #156 |
| 2 | Claude Sonnet 4.5 | 33.33 | #250 |
| 3 | GPT-5.2 | 17.04 | #176 |
| 4 | Claude Haiku 4.5 | 11.11 | #568 |
| 5 | DeepSeek R1 | 6.67 | #473 |
| 6 | GPT-5 Mini | 2.22 | #348 |
| 7 | Llama 3.3 70B Instruct | 1.48 | #1357 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=lakeqa-mini · How It Works · Data refreshed daily, snapshot 2026-11-13.