BigCode: AI model benchmarks

AI models from BigCode. 4 models tracked, 4 with a unified ELO rating. Current best: starcoder2-15B (ELO 1391, rank #1171 overall). Most recent tracked release: 2024-02-28.

Rated models

RankModelProviderUnified ELOBenchmarks
1171starcoder2-15BBigCode1391 ± 130
1304starcoder2-7BBigCode1329 ± 128
1306starcoderBigCode1327 ± 193
1353starcoder2-3BBigCode1292 ± 124

Interactive version: theaggregate.ai/company?slug=bigcode · How It Works · Data refreshed daily, snapshot 2026-09-05.