Also run here

Our Benchmarks

Smaller experiments and qualification checks run by The Aggregate: a single model, a single subject, or a floor every model sat on.

MEGA-Bench Hanoi re-run

Gemini 3.8 Flash on MEGA-Bench's 14-item Tower of Hanoi planning task, scored 58.2% with MEGA-Bench's own prompts and scorer (September 20). The row sits on the public board, and the check found five of its fourteen reference answers impossible.

Open the board

Predicting a small model from its name

Gemini 3.8 Flash predicted, question by question, where Llama 3.2 1B would fail on 498 MMLU-Pro and GSM8K items, knowing only its name: AUROC 0.71, but it took the 33% model for a 66% one (September 21).

Verbatim recital

Continuing a Project Gutenberg paragraph or an Apollo 11 transcript window word for word from a 12-word cue: every model tested scored 0 of 30 paragraphs and 0 of 24 transcript windows at 100 words (September 9).

Classifier qualification suite

The tests a model must pass before it becomes the benchmark classifier behind Task Explorer.

Open Task Explorer

Interactive version: theaggregate.ai/our-benchmarks/other-runs · How It Works · Data refreshed daily, snapshot 2026-10-11.