BLINKG - Schema-Aligned - Function Output: leaderboard
Metric: F1 (%; expert-validated mappings for the transformed value that function produces; 10 gold task instances; GTFS-Madrid transit CSV files mapped to the LinkedGTFS ontology; macro-average of three runs). Source: arxiv.org. Saturation forecast: Estimated already saturated. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | O3 | 72 |
| 2 | Llama 3.3 70B Instruct | 71 |
| 3 | GPT-4o | 69 |
| 4 | Gemini 2.5 Pro | 29 |
| 5 | Mixtral 8x22B Instruct | 26 |
Interactive version: theaggregate.ai/benchmark?slug=blinkg-schema-aligned-function-output · How It Works · Data refreshed daily, snapshot 2026-09-26.