MetaGAI - Data Card Quality: leaderboard
Metric: Qualitative average (1-5): mean judge Likert score of data cards generated zero-shot from the paper text alone, rated on faithfulness, relevance, accuracy, consistency and usefulness by GPT-OSS-120B, Llama-3.3-70B-Instruct and Qwen3-235B-A22B-2507 judges, on a stratified sample of 250 MetaGAI entries (2,541 verified paper, repository and Hugging Face triplets); higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3 30B A3B Instruct | 4.3 |
| 2 | GPT-5 Mini | 4.06 |
| 3 | Gemini 2.5 Flash Lite | 3.83 |
| 4 | Gemini 2.5 Flash | 3.76 |
| 5 | Gemma 3 27B (IT) | 3.72 |
| 6 | nemotron-3-nano-30B-a3B | 3.37 |
| 7 | Qwen 3 32B | 3.26 |
| 8 | Mistral Small 3.2 | 3.26 |
| 9 | GPT-5 Nano | 3.06 |
| 10 | GPT-OSS-20B | 3.06 |
Interactive version: theaggregate.ai/benchmark?slug=metagai-data-card-quality · How It Works · Data refreshed daily, snapshot 2026-10-07.