KGCE (With Knowledge Base) - Key-Step F1: leaderboard

Metric: F1 of action precision (completed over attempted actions) and key-step recall (%; 104 educational GUI tasks on Windows, Android and cross-platform workflows with school-specific software, decomposed into DAG sub-goals; the multimodal model drives the agent; with the structured JSON knowledge base of the school software injected into the prompt). Source: arxiv.org. Saturation forecast: Around December 2026. 3 models tracked.

Top models

#ModelScore
1GPT-4o47.71
2Gemini 2.0 Flash38.72

Interactive version: theaggregate.ai/benchmark?slug=kgce-with-knowledge-base-key-step-f1 · How It Works · Data refreshed daily, snapshot 2026-09-26.