HumRightsBench - Issue Identification (I2): leaderboard

Metric: Accuracy (%; x100 of the exact-set match rate on the second issue-identification multiple-choice question per sub-scenario, asking the same judgment another way; pilot HumRightsBench question set on right-to-water scenarios validated by human rights experts; each question asked with five seeds and shuffled answer order (Qwen 3.5-9B multiple-choice types over four), responses through each provider's structured-output interface, errored calls counted as incorrect). Source: arxiv.org. Saturation forecast: Around April 2027. 4 models tracked.

Top models

#ModelScore
1Gemini 3 Flash (Preview)71
2GPT-567.5
3Claude Opus 4.759.5
4Qwen 3.5 9B51.9

Interactive version: theaggregate.ai/benchmark?slug=humrightsbench-issue-identification-i2 · How It Works · Data refreshed daily, snapshot 2026-09-26.