Embedded Arena MCU QA (Direct Prompting): leaderboard

Metric: Accuracy (%) on the 30 expert-written question-answer pairs about deploying deep learning on microcontrollers (model compression, hardware constraints, framework-specific code and deployment troubleshooting), answered zero-shot in a single turn from the prompt alone; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.

Top models

#ModelScore
1GPT-560
2Gemini 2.5 Pro45
3GPT-5 Mini38.3
4Gemini 2.5 Flash33.3
5GPT-5 Nano31.7
6Gemini 2.5 Flash Lite16.7

Interactive version: theaggregate.ai/benchmark?slug=embedded-arena-mcu-qa-direct-prompting · How It Works · Data refreshed daily, snapshot 2026-09-29.