Falcon-H1-1.5B-Deep-Instruct: benchmark results

Provider: TII. Released 2025-05-20. Access: Open.

Aggregate Rating 1370 ± 32, rank #7164 of 10916 rated models, from 37 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Portuguese LLM - BLUEX57.16Accuracy (%)68.6
Open Portuguese LLM - ENEM67.95Accuracy (%)68.1
Open Portuguese LLM - OAB Exams45.19Accuracy (%)60.2
Open Portuguese LLM - FaQuAD NLI68.4Macro F1 (%)56.8
Open Portuguese LLM - ASSIN2 RTE86.82Macro F1 (%)38.8
UGI - Willingness (W/10)3.8W/10 Score29.3
Jais 3 Model Cards - QIAS-1 (IFM-audited)32.1Accuracy (%)25
Jais 3 Model Cards - SimpleQA Verified (Arabic) - Non-hallucination Rate3.8Non-hallucination rate (%)25
Jais 3 Model Cards - Arabic Linguistics - Parsing (IFM)40.6Accuracy (%)17.9
Jais 3 Model Cards - Arabic IFEval49.3Accuracy (%)14.3
Jais 3 Model Cards - IslamicEval 2025-1B (IFM-audited)42.4Accuracy (%)14.3
Jais 3 Model Cards - QIAS-2 (IFM-audited)56Accuracy (%)14.3

Interactive version: theaggregate.ai/model?slug=falcon-h1-1-5b-deep-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.