KAT-Coder-Air V2.5: benchmark results

Provider: Kuaishou. Released 2026-07-10. Access: API.

Aggregate Rating 1622 ± 37, rank #816 of 10916 rated models, from 8 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Tinybird AI SQL Benchmark - Exactness52.85Result exactness vs human reference queries (0-100)76.2
Tinybird AI SQL Benchmark - Success Rate100Questions answered with a valid query within 3 retries (%)72
AI Chess Leaderboard (Continuation)797Elo68.1
Wolfram LLM Benchmarking Project41.6Correct Functionality (%)44.5
Tinybird AI SQL Benchmark - First-Attempt Success Rate92Questions answered with a valid query on the first attempt (42.2
SvelteBench85.6Average pass@1 (%)40
AI Chess Leaderboard (Reasoning)616Elo35
ObviousBench74.31Answer pass³ (%)26.7

Interactive version: theaggregate.ai/model?slug=kat-coder-air-v2-5 · How It Works · Data refreshed daily, snapshot 2026-11-08.