Nepal Math Competency Grading (Teacher 2 Reference): leaderboard
Metric: Quadratic weighted Cohen's kappa (-1 to 1) between the model's competency-level assignments (Awareness, Application, Mastery, Influence for comprehension, knowledge, operational fluency and behavior and correlation) and those of the second senior mathematics teacher, over the handwritten Grade 10 Optional Mathematics answers of 33 students in Nepal (matrix, coordinate geometry, trigonometry, functions), transcribed by gemini-2.5-flash and graded with one master evaluation prompt at temperature 0.1; higher is better. Source: arxiv.org. Saturation forecast: Around August 2028. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash | 0.35 |
| 2 | Gemini 3 Pro | 0.27 |
| 3 | Llama 3.1 8B | 0.12 |
| 4 | Llama 3.3 70B | -0.03 |
Interactive version: theaggregate.ai/benchmark?slug=nepal-math-competency-grading-teacher-2-reference · How It Works · Data refreshed daily, snapshot 2026-10-07.