Nepal Math Competency Grading (Teacher 1 Reference): leaderboard
Metric: Quadratic weighted Cohen's kappa (-1 to 1) between the model's competency-level assignments (Awareness, Application, Mastery, Influence for comprehension, knowledge, operational fluency and behavior and correlation) and those of the first senior mathematics teacher, over the handwritten Grade 10 Optional Mathematics answers of 33 students in Nepal (matrix, coordinate geometry, trigonometry, functions), transcribed by gemini-2.5-flash and graded with one master evaluation prompt at temperature 0.1; higher is better. Source: arxiv.org. Saturation forecast: Around March 2028. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash | 0.39 |
| 2 | Gemini 3 Pro | 0.27 |
| 3 | Llama 3.1 8B | 0.1 |
| 4 | Llama 3.3 70B | -0.03 |
Interactive version: theaggregate.ai/benchmark?slug=nepal-math-competency-grading-teacher-1-reference · How It Works · Data refreshed daily, snapshot 2026-10-07.