Benchmark Catalog
26518 public benchmarks carry scores in the current fit, with source links and saturation forecasts. The catalogue on this page tracks more boards than the fit uses. The most broadly covered benchmarks are listed below.
| Benchmark | Category | Metric | Models | Saturation forecast |
|---|---|---|---|---|
| Open Portuguese LLM - ASSIN2 RTE | Macro F1 (%) | 637 | Estimated already saturated. | |
| Open Portuguese LLM - BLUEX | Accuracy (%) | 637 | Estimated already saturated. | |
| Open Portuguese LLM - ENEM | Accuracy (%) | 637 | Estimated already saturated. | |
| Open Portuguese LLM - FaQuAD NLI | Macro F1 (%) | 637 | Estimated already saturated. | |
| Open Portuguese LLM - OAB Exams | Accuracy (%) | 637 | Around January 2027. | |
| Open LLM Leaderboard - BBH | Score | 604 | Estimated already saturated. | |
| Open LLM Leaderboard - GPQA | Score | 604 | Estimated already saturated. | |
| Open LLM Leaderboard - IFEval | Score | 604 | Estimated already saturated. | |
| Open LLM Leaderboard - MATH Level 5 | Score | 604 | Estimated already saturated. | |
| Open LLM Leaderboard - MMLU-Pro | Score | 604 | Estimated already saturated. | |
| Open LLM Leaderboard - MuSR | Score | 604 | Estimated already saturated. | |
| Artificial Analysis Intelligence Index | Intelligence Index | 534 | Around May 2028. | |
| AA Humanity's Last Exam | General Knowledge & Language | Accuracy (%) | 520 | Around September 2027. |
| AA GPQA Diamond | Math, Logic & Reasoning | Accuracy (%) | 482 | Estimated already saturated. |
| AA CritPt | Math, Logic & Reasoning | Accuracy (%) | 461 | Around August 2027. |
| AA Long Context Reasoning | General Knowledge & Language | Accuracy (%) | 461 | Around January 2027. |
| AA Omniscience | General Knowledge & Language | Score | 457 | Around October 2027. |
| AA-Omniscience Accuracy | Accuracy (%) | 457 | Around July 2028. | |
| AA-Omniscience Hallucination Rate | Hallucination Rate (%) | 457 | Not forecast. | |
| AA-Omniscience Index - Business | Omniscience Index | 457 | Around May 2028. | |
| AA-Omniscience Index - Health | Omniscience Index | 457 | Around September 2028. | |
| AA-Omniscience Index - Humanities & Social Sciences | Omniscience Index | 457 | Around November 2027. | |
| AA-Omniscience Index - Law | Omniscience Index | 457 | Around November 2027. | |
| AA-Omniscience Index - Science, Engineering & Mathematics | Omniscience Index | 457 | Around January 2028. | |
| AA-Omniscience Index - Software Engineering (SWE) | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - C | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Dart | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Go | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - HTML | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Java | Omniscience Index | 457 | Around August 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - JavaScript | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Julia | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Kotlin | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - PHP | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Python | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - R | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Rust | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Swift | Omniscience Index | 457 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - TypeScript | Omniscience Index | 457 | Around January 2027. | |
| Wolfram LLM Benchmarking Project | Coding & Software Engineering | Correct Functionality (%) | 364 | Around January 2027. |
| AA IFBench | General Knowledge & Language | Accuracy (%) | 357 | Around January 2027. |
| AA TAU-2 Bench | Agentic & Tool Use | Accuracy (%) | 348 | Estimated already saturated. |
| AA Terminal-Bench Hard | Coding & Software Engineering | Accuracy (%) | 342 | Around January 2027. |
| Tau2-Bench Telecom | Agentic & Tool Use | Success Rate (%) | 339 | Estimated already saturated. |
| LLM Stats Score | LLM Stats Score (conservative rating) | 333 | Around September 2027. | |
| Chatbot Arena (Text - English) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Hard Prompts) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Instruction Following) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Non-English) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Software & IT Services) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text) | Elo | 327 | Around November 2027. | |
| Chatbot Arena (Text - Creative Writing) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Entertainment, Sports & Media) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Hard Prompts (English)) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Life, Physical & Social Science) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Multi-Turn) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Writing, Literature & Language) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Coding) | Arena Score | 325 | Forecast unavailable. | |
| Chatbot Arena (Text - Business, Management & Financial Ops) | Arena Score | 323 | Forecast unavailable. | |
| Tinybird AI SQL Benchmark - First-Attempt Success Rate | Questions answered with a valid query on the first attempt (%) | 320 | Estimated already saturated. |
Interactive version: theaggregate.ai/benchmarks/catalog · How It Works · Data refreshed daily, snapshot 2026-10-20.