TempGlitch: leaderboard

Vision-language models (VLMs) are increasingly being explored for video game quality assurance, especially gameplay glitch detection. Most existing evaluations, however, treat glitches as static visual anomalies, asking models to detect failures from a single frame. We argue that this framing misses a key distinction: some glitches are spatial and visible in an isolated frame, whereas others are t

Metric: Acc. (1 FPS) (self-reported). Source: benchmarklist.com. 10 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 Mini52.4#212
2Gemma 4 31B52.3#200
3Ministral 3 14B51.9#650
4Claude 3 Opus51#571
5GPT-5.550.5#31
6Qwen 3.6 27B50.5#170
7Ministral 3 3B50.2#918

Interactive version: theaggregate.ai/benchmark?slug=tempglitch · How It Works · Data refreshed daily, snapshot 2026-10-20.