Local Deep Research - SimpleQA: leaderboard

Community-reported SimpleQA results for distinct Local Deep Research runs, retaining pipeline version, retrieval settings, iteration count and sample size. The source generator prioritizes the reported percentage; accompanying outcome counts are preserved even when they disagree.

Metric: Reported accuracy (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 10 models tracked.

Top models

#ModelScoreOverall rank
1qwen3.6:latest (LDR Run: version=1.5.6; strategy=langgraph_agent; iterations=10; n=300; source=results/simpleqa/langgraph-agent/serper/qwen3.6-latest_2026-04-18.yaml)95.7
2qwen3.6-27b (LDR Run: version=1.6.7; strategy=langgraph-agent; iterations=10; n=300; source=results/simpleqa/langgraph-agent/serper/qwen3.6-27b_2026-05-01.yaml)95.7
3qwen3.6-27b (LDR Run: version=1.6.9; strategy=langgraph-agent; iterations=3; n=500; source=results/simpleqa/langgraph-agent/serper/qwen3.6-27b_2026-05-10.yaml)94.8
4qwen3.6-27b (LDR Run: version=1.6.10; strategy=langgraph-agent; iterations=3; n=400; source=results/simpleqa/langgraph-agent/serper/qwen3.6-27b_2026-05-11.yaml)93.5
5qwen3.5-9b (LDR Run: version=1.5.6; strategy=langgraph_agent; iterations=10; n=200; source=results/simpleqa/langgraph-agent/serper/qwen3.5-9b_2026-04-06.yaml)91.2
6gemma4-31b (LDR Run: version=1.5.6; strategy=langgraph-agent; iterations=10; n=300; source=results/simpleqa/langgraph-agent/serper/gemma4-31b_2026-04-22.yaml)90.3
7gpt-oss-120b (LDR Run: version=1.5.6; strategy=langgraph-agent; iterations=3; n=30; source=results/simpleqa/langgraph-agent/serper/gpt-oss-120b_2026-04-19.yaml)86.7
8gpt-oss-20b (LDR Run: version=1.5.6; strategy=langgraph_agent; iterations=10; n=346; source=results/simpleqa/langgraph-agent/serper/gpt-oss-20b_2026-04-12.yaml)85.4
9qwen3-4b (LDR Run: version=1.3.50; strategy=source_based; iterations=2; n=50; source=results/simpleqa/source-based/serper/qwen3-4b_2026-02-18.yaml)74
10gemma4-26b (LDR Run: version=1.5.6; strategy=langgraph_agent; iterations=10; n=300; source=results/simpleqa/langgraph-agent/serper/gemma4-26b_2026-04-14.yaml)73.1

Interactive version: theaggregate.ai/benchmark?slug=local-deep-research-simpleqa · How It Works · Data refreshed daily, snapshot 2026-10-20.