Falcon3-7B-Instruct: benchmark results

TII's Falcon3-7B-Instruct is a 28-layer decoder-only Transformer instruction model using grouped-query attention and a publisher-supported 32K context. Its pretraining uses 14 trillion tokens. Instruction post-training uses 1.2 million samples. Provider: TII. Released 2024-12-17. Access: Open.

Aggregate Rating 1376 ± 15, rank #1300 of 1654 rated models, from 250 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Portuguese NLU - MultiWikiQA PT78.3Character F1 (%)96.8
Open LLM Leaderboard - MuSR48.27Score95.5
Open LLM Leaderboard - IFEval76.12Score91.7
Open LLM Leaderboard - MATH Level 540.86Score90.7
Open PL LLM - PSC (multiple choice, 5-shot)87.5Binary F1 (%)87.1
MEDIC Benchmark79.83MEDIC Public Table Average86.3
Open Portuguese LLM - ASSIN2 RTE93.09Macro F1 (%)86.3
French LLM Leaderboard - IFEval FR62.33Score (%)83.3
Open Portuguese LLM - BLUEX61.34Accuracy (%)80.2
EuroEval Portuguese NLU - SST-2 PT82.25Matthews correlation coefficient (%)78.6
Open LLM Leaderboard - BBH56.32Score77.4
Open Japanese LLM - Xlsum JA Rouge129.22Score (%)76.7

Interactive version: theaggregate.ai/model?slug=falcon3-7b-instruct · How It Works · Data refreshed daily, snapshot 2026-10-24.