Teaching-Feedback Classification - Spanish Thematic (Zero-Shot): leaderboard

This benchmark re-runs a validated protocol for classifying open-ended teaching-evaluation comments, holding the annotation guide, splits and held-out evaluation fixed while varying the model. This board sorts Spanish university comments into four themes - methodology, evaluation, interaction, and attendance or engagement - with no examples in the prompt. The score is weighted F1, and the prompt carries the label definitions from the annotation guide.

Metric: Weighted F1 (%; four-way thematic classification of open-ended teaching-evaluation comments into methodology, evaluation, interaction and attendance or engagement, over the 233-comment held-out split of 1,165 annotated Spanish comments from the SIIAU teaching-evaluation system (single stratified split, seed 20260616); zero-shot prompting with the annotation guide's label definitions). Source: arxiv.org. Saturation forecast: Around February 2027. 3 models tracked.

Top models

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=teaching-feedback-classification-spanish-thematic-zero-shot · How It Works · Data refreshed daily, snapshot 2026-11-13.