Gemini 1.5 Flash (Preview 0827): benchmark results

August 27 Gemini 1.5 Flash preview snapshot. Provider: Google. Released 2024-08-27. Access: API.

Aggregate Rating 1543 ± 51, rank #1798 of 10916 rated models, from 3 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Generate README Eval33.43Score (imported)79.2
ZebraLogic25Puzzle Accuracy (%)60.7
Aider Code Editing Leaderboard52.6Exercises completed correctly after one retry, pass_rate_2 (39.8

Interactive version: theaggregate.ai/model?slug=gemini-1-5-flash-preview-0827 · How It Works · Data refreshed daily, snapshot 2026-11-08.