Skip to content
The Aggregate

Unified LLM rankings, daily

Models Task Explorer Subscriptions Trends Benchmarks Compare Daily brief
The Aggregate
Loading data...

HARE / MEM-SQL: leaderboard

Models answer database questions using previously verified SQL queries. Execution accuracy compares direct generation with distinct memory and schema-linking methods across the published datasets.

Source: arxiv.org.

Benchmark results

Results are published separately for each benchmark or evaluation setting.

  • HARE - A-MEM
  • HARE - A-MEM - On-Demand Schema Linking
  • HARE - BEAVER Origin - A-MEM
  • HARE - BEAVER Origin - BIRD-History
  • HARE - BEAVER Origin - DAIL-SQL
  • HARE - BEAVER Origin - MEM-SQL
  • HARE - BIRD Origin - A-MEM
  • HARE - BIRD Origin - BIRD-History
  • HARE - BIRD Origin - DAIL-SQL
  • HARE - BIRD Origin - MEM-SQL
  • HARE - BIRD-History
  • HARE - BIRD-History - On-Demand Schema Linking
  • HARE - DAIL-SQL
  • HARE - DAIL-SQL - On-Demand Schema Linking
  • HARE - Direct Generation
  • HARE - MEM-SQL
  • HARE - Spider 2.0 Origin - A-MEM
  • HARE - Spider 2.0 Origin - BIRD-History
  • HARE - Spider 2.0 Origin - DAIL-SQL
  • HARE - Spider 2.0 Origin - MEM-SQL
  • HARE - Spider Origin - A-MEM
  • HARE - Spider Origin - BIRD-History
  • HARE - Spider Origin - DAIL-SQL
  • HARE - Spider Origin - MEM-SQL

Interactive version: theaggregate.ai/benchmark?slug=hare-mem-sql-1f4y54i · How It Works · Data refreshed daily, snapshot 2026-11-17.

Built by Mikhail Doroshenko — AI researcher, co-author of Humanity’s Last Exam. Independent project; no affiliation with any AI lab. How It Works · Privacy · Terms · Support
A

Your Aggregate

Sign in to keep your work

Save custom rankings and get 50 free task analyses each day.

Continue with Google Continue with GitHub

No password to remember. Your public profile identifies saved work.

Your Aggregate

Account

  • Saved custom aggregate views
  • 50 free task analyses per day
Sign out