BLINKG - Basic - Subject Generation: leaderboard
Metric: F1 (%; expert-validated mappings for the template that builds each subject URI; 12 gold task instances; eight atomic CSV cases over a three-class ontology; macro-average of three runs). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro | 97 |
| 2 | Llama 3.3 70B Instruct | 91 |
| 3 | O3 | 90 |
| 4 | GPT-4o | 89 |
| 5 | Mixtral 8x22B Instruct | 50 |
Interactive version: theaggregate.ai/benchmark?slug=blinkg-basic-subject-generation · How It Works · Data refreshed daily, snapshot 2026-09-26.