AgenticFinBench - Comparison: leaderboard

Financial agent research on230 real-world questions with eight categories and four complexity levels. Published quality score Q (0–100). AgenticFinBench230questions, native expert-defined quality score Q in0–100; score-table abbreviated labels bound to exact Table14 model/harness/effort/finance-tool configuration and Table15 execution controls. Most runs use2100s attempts; hosted client exceptions remain as published. Different harnesses are distinct source configurations, never pooled as one model run. Cohort includes Seed2.1Pro0915 and opaque DuMate as a named system, not an assumed underlying model.

Metric: Published quality score Q (0–100). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 18 models tracked.

Top models

#ModelScoreOverall rank
1GPT-6.1 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI; effort=high; finance-tools=✓; tool-scope=Live web search with finance queries; command execution)91.4
2GPT-5.6 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI; effort=high; finance-tools=✓; tool-scope=Web search / page access; command execution)91.23
3GPT-6 Astra (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI; effort=medium; finance-tools=✓; tool-scope=Web search / page access; command execution)88.09
4DeepSeek V4.1 Flash (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI 0.162.0-alpha.2; effort=high; finance-tools=✗; tool-scope=Search, page retrieval, command and file tools)86.4
5GPT-5.6 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=Pi 0.87.1; effort=high; finance-tools=✗; tool-scope=Search, page retrieval, shell, and file tools)85.85
6DeepSeek V4.1 Flash (Benchmark Sweep Run: source=AgenticFinBench; harness=DSH; effort=high; finance-tools=✗; tool-scope=web_search, web_fetch; shell, file, image, planning, and workflow tools)85.1
7Claude Opus 5.5 (Benchmark Sweep Run: source=AgenticFinBench; harness=Claude Code CLI; effort=medium; finance-tools=✗; tool-scope=WebSearch, WebFetch)84.93
8GPT-5.6 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=DSH 0.1.5-rc.1; effort=high; finance-tools=✗; tool-scope=Search, page retrieval, shell, and file tools)83.91
9DeepSeek V4.1 Flash (Benchmark Sweep Run: source=AgenticFinBench; harness=Pi; effort=high; finance-tools=✗; tool-scope=read, bash, edit, write, web_search, web_fetch)83.82
10Claude Opus 5.5 (Benchmark Sweep Run: source=AgenticFinBench; harness=DSH 0.1.5-rc.1; effort=medium; finance-tools=✗; tool-scope=Search, page retrieval, shell, and file tools)80.26

Interactive version: theaggregate.ai/benchmark?slug=agenticfinbench-comparison · How It Works · Data refreshed daily, snapshot 2026-11-06.