MultiLangBench - C#: leaderboard

OpenAI October 19 release; implement SQLite 3.40.1 from documentation without network or installed SQLite; validate database effects against reference SQLite. Default released evaluation uses 272 hash-selected tests; the repository permits full-suite refinement if reported. Every embedded model/effort point retained; no cost-based or best-effort selection. Test Pass Rate (%); higher is better.

Metric: Test Pass Rate (%). Source: openai.com. Saturation forecast: Around January 2027. 22 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6 Astra (Max)90.8#6 (GPT-6 Astra)
2GPT-6.1 Sol (Max)89.6#7 (GPT-6.1 Sol)
3GPT-6.1 Sol (xHigh)74.3#7 (GPT-6.1 Sol)
4GPT-6 Astra (High)74#6 (GPT-6 Astra)
5GPT-6 Astra (xHigh)73.2#6 (GPT-6 Astra)
6GPT-6.1 Sol (High)72#7 (GPT-6.1 Sol)
7GPT-6 Astra (Medium)68.3#6 (GPT-6 Astra)
8GPT-6.1 Sol (Medium)63.9#7 (GPT-6.1 Sol)
9GPT-6 Luna (Max)43.6#56 (GPT-6 Luna)
10GPT-5.6 Sol (Max)29.2#19 (GPT-5.6 Sol)
11GPT-6 Luna (xHigh)24.5#56 (GPT-6 Luna)
12GPT-6 Astra (Low)18.8#6 (GPT-6 Astra)
13GPT-6 Luna (High)18.1#56 (GPT-6 Luna)
14GPT-5.6 Sol (xHigh)17.6#19 (GPT-5.6 Sol)
15GPT-6.1 Sol (Low)12.2#7 (GPT-6.1 Sol)

No result here: #3 Claude Opus 5.5, #8 Gemini 4 Argon, #9 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=multilangbench-c-1h5ypbj · How It Works · Data refreshed daily, snapshot 2026-10-20.