Benchmark Catalog
23801 public benchmarks carry scores in the current fit, with source links and saturation forecasts. The catalogue on this page tracks more boards than the fit uses. The most broadly covered benchmarks are listed below.
| Benchmark | Category | Metric | Models | Saturation forecast |
|---|---|---|---|---|
| Open Portuguese LLM - ASSIN2 RTE | Macro F1 (%) | 633 | Estimated already saturated. | |
| Open Portuguese LLM - BLUEX | Accuracy (%) | 633 | Estimated already saturated. | |
| Open Portuguese LLM - ENEM | Accuracy (%) | 633 | Estimated already saturated. | |
| Open Portuguese LLM - FaQuAD NLI | Macro F1 (%) | 633 | Estimated already saturated. | |
| Open Portuguese LLM - OAB Exams | Accuracy (%) | 633 | Around January 2027. | |
| Open LLM Leaderboard - BBH | Score | 603 | Estimated already saturated. | |
| Open LLM Leaderboard - GPQA | Score | 603 | Estimated already saturated. | |
| Open LLM Leaderboard - IFEval | Score | 603 | Estimated already saturated. | |
| Open LLM Leaderboard - MATH Level 5 | Score | 603 | Estimated already saturated. | |
| Open LLM Leaderboard - MMLU-Pro | Score | 603 | Estimated already saturated. | |
| Open LLM Leaderboard - MuSR | Score | 603 | Estimated already saturated. | |
| Artificial Analysis Intelligence Index | Intelligence Index | 527 | Around May 2028. | |
| AA Humanity's Last Exam | General Knowledge & Language | Accuracy (%) | 513 | Around September 2027. |
| AA GPQA Diamond | Math, Logic & Reasoning | Accuracy (%) | 481 | Estimated already saturated. |
| AA CritPt | Math, Logic & Reasoning | Accuracy (%) | 453 | Around July 2027. |
| AA Long Context Reasoning | General Knowledge & Language | Accuracy (%) | 453 | Around January 2027. |
| AA Omniscience | General Knowledge & Language | Score | 449 | Around September 2027. |
| AA-Omniscience Accuracy | Accuracy (%) | 449 | Around June 2028. | |
| AA-Omniscience Hallucination Rate | Hallucination Rate (%) | 449 | Not forecast. | |
| AA-Omniscience Index - Business | Omniscience Index | 449 | Around May 2028. | |
| AA-Omniscience Index - Health | Omniscience Index | 449 | Around August 2028. | |
| AA-Omniscience Index - Humanities & Social Sciences | Omniscience Index | 449 | Around November 2027. | |
| AA-Omniscience Index - Law | Omniscience Index | 449 | Around November 2027. | |
| AA-Omniscience Index - Science, Engineering & Mathematics | Omniscience Index | 449 | Around January 2028. | |
| AA-Omniscience Index - Software Engineering (SWE) | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - C | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Dart | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Go | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - HTML | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Java | Omniscience Index | 449 | Around August 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - JavaScript | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Julia | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Kotlin | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - PHP | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Python | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - R | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Rust | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - Swift | Omniscience Index | 449 | Around January 2027. | |
| AA-Omniscience Index - Software Engineering (SWE) - TypeScript | Omniscience Index | 449 | Around January 2027. | |
| AA IFBench | General Knowledge & Language | Accuracy (%) | 358 | Around January 2027. |
| AA TAU-2 Bench | Agentic & Tool Use | Accuracy (%) | 349 | Estimated already saturated. |
| AA Terminal-Bench Hard | Coding & Software Engineering | Accuracy (%) | 342 | Around January 2027. |
| Tau2-Bench Telecom | Agentic & Tool Use | Success Rate (%) | 340 | Estimated already saturated. |
| Wolfram LLM Benchmarking Project | Coding & Software Engineering | Correct Functionality (%) | 339 | Around January 2027. |
| LLM Stats Score | LLM Stats Score (conservative rating) | 328 | Around September 2027. | |
| Chatbot Arena (Text - English) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Hard Prompts) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Instruction Following) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Non-English) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text - Software & IT Services) | Arena Score | 327 | Forecast unavailable. | |
| Chatbot Arena (Text) | Elo | 327 | Around October 2027. | |
| Chatbot Arena (Text - Creative Writing) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Entertainment, Sports & Media) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Hard Prompts (English)) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Life, Physical & Social Science) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Multi-Turn) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Writing, Literature & Language) | Arena Score | 326 | Forecast unavailable. | |
| Chatbot Arena (Text - Coding) | Arena Score | 325 | Forecast unavailable. | |
| Chatbot Arena (Text - Business, Management & Financial Ops) | Arena Score | 323 | Forecast unavailable. | |
| Chatbot Arena (Text - Math) | Arena Score | 319 | Forecast unavailable. |
Interactive version: theaggregate.ai/benchmarks/catalog · How It Works · Data refreshed daily, snapshot 2026-10-11.