GlazyBench - Transparency (Zero-Shot): leaderboard

GlazyBench (2026) asks whether a model can predict how a ceramic glaze looks after firing from its recipe, given as oxide weight percentages, the unity molecular formula and firing conditions. This board is accuracy in percent at predicting the transparency, one of four classes from transparent to opaque, prompted zero-shot at temperature 0; higher is better.

Metric: Accuracy (%) predicting the fired glaze transparency (4 classes: transparent, translucent, semi-opaque, opaque; 3,322 test glazes) from its recipe (oxide weight percentages, UMF formula, cone and atmosphere as text), zero-shot, temperature 0, one label from the allowed set; outputs matching no label are left out of the metric; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 3 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.540#261
2GPT-4o Mini34.3#1667
3GlazyBench DeepSeek-v3 (checkpoint unspecified)32.6

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=glazybench-transparency-zero-shot · How It Works · Data refreshed daily, snapshot 2026-11-21.