GlazyBench - Transparency (5-Shot): leaderboard
GlazyBench (2026) asks whether a model can predict how a ceramic glaze looks after firing from its recipe, given as oxide weight percentages, the unity molecular formula and firing conditions. This board is accuracy in percent at predicting the transparency, one of four classes from transparent to opaque, with five labelled training recipes in the prompt; higher is better.
Metric: Accuracy (%) predicting the fired glaze transparency (4 classes: transparent, translucent, semi-opaque, opaque; 3,322 test glazes) from its recipe (oxide weight percentages, UMF formula, cone and atmosphere as text), five-shot with one stratified training example per class in rotation, temperature 0, one label from the allowed set; outputs matching no label are left out of the metric; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 3 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GlazyBench DeepSeek-v3 (checkpoint unspecified) | 41.3 | |
| 2 | GPT-4o Mini | 39.4 | #1667 |
| 3 | Claude Sonnet 4.5 | 38 | #261 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=glazybench-transparency-5-shot · How It Works · Data refreshed daily, snapshot 2026-11-21.