AgenticFinBench - Complexity L2: leaderboard
Financial agent research on230 real-world questions with eight categories and four complexity levels. Published quality score Q (0–100). AgenticFinBench230questions, native expert-defined quality score Q in0–100; score-table abbreviated labels bound to exact Table14 model/harness/effort/finance-tool configuration and Table15 execution controls. Most runs use2100s attempts; hosted client exceptions remain as published. Different harnesses are distinct source configurations, never pooled as one model run. Cohort includes Seed2.1Pro0915 and opaque DuMate as a named system, not an assumed underlying model.
Metric: Published quality score Q (0–100). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 18 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | DeepSeek V4.1 Flash (Benchmark Sweep Run: source=AgenticFinBench; harness=Pi; effort=high; finance-tools=✗; tool-scope=read, bash, edit, write, web_search, web_fetch) | 92.73 | |
| 2 | DeepSeek V4.1 Flash (Benchmark Sweep Run: source=AgenticFinBench; harness=DSH; effort=high; finance-tools=✗; tool-scope=web_search, web_fetch; shell, file, image, planning, and workflow tools) | 91.65 | |
| 3 | GPT-5.6 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI; effort=high; finance-tools=✓; tool-scope=Web search / page access; command execution) | 91.25 | |
| 4 | GPT-5.6 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=Pi 0.87.1; effort=high; finance-tools=✗; tool-scope=Search, page retrieval, shell, and file tools) | 90.96 | |
| 5 | DeepSeek V4.1 Flash (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI 0.162.0-alpha.2; effort=high; finance-tools=✗; tool-scope=Search, page retrieval, command and file tools) | 90.83 | |
| 6 | Claude Opus 5.5 (Benchmark Sweep Run: source=AgenticFinBench; harness=Claude Code CLI; effort=medium; finance-tools=✗; tool-scope=WebSearch, WebFetch) | 90.17 | |
| 7 | Gemini 4 Argon (Benchmark Sweep Run: source=AgenticFinBench; harness=Gemini CLI 0.64.0; effort=high; finance-tools=✗; tool-scope=google_web_search, web_fetch) | 89.41 | |
| 8 | GPT-6.1 Sol (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI; effort=high; finance-tools=✓; tool-scope=Live web search with finance queries; command execution) | 88.96 | |
| 9 | GPT-6 Astra (Benchmark Sweep Run: source=AgenticFinBench; harness=Codex CLI; effort=medium; finance-tools=✓; tool-scope=Web search / page access; command execution) | 88.88 | |
| 10 | Claude Opus 5.5 (Benchmark Sweep Run: source=AgenticFinBench; harness=Pi 0.87.1; effort=medium; finance-tools=✗; tool-scope=Public Pi agent; search, page retrieval, shell, and file tools; no MCP) | 88.5 |
Interactive version: theaggregate.ai/benchmark?slug=agenticfinbench-complexity-l2 · How It Works · Data refreshed daily, snapshot 2026-11-06.