Apertus-8B-Instruct: benchmark results

Provider: Apertus. Released 2025-09-02. Access: Open.

Aggregate Rating 1477 ± 50, rank #2701 of 10916 rated models, from 17 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Grip on LLMs - HonestCityBench - Non-Text Modality38Appropriate acknowledgement rate (%; LLM judge)88.3
LongPIBench - Resume Screening95Attack success rate (%; share of 100 long synthetic resumes 85.7
LongPIBench - Code Review87Attack success rate (%; share of 100 long synthetic pull req78.6
LongPIBench - Paper Review92Attack success rate (%; share of 100 long synthetic conferen71.4
Grip on LLMs - HonestCityBench - Outdated Information26Appropriate acknowledgement rate (%; LLM judge)63.3
LongPIBench - Email Summary76Attack success rate (%; share of 100 long synthetic email th57.1
Grip on LLMs - Dutch Simplification - Amsterdam40.78SARI (0-100)56.7
Grip on LLMs - HonestCityBench - Average28Appropriate acknowledgement rate (%; mean of five categories55
Grip on LLMs - Dutch Simplification - INT Duidelijke Taal39.31SARI (0-100)53.3
Grip on LLMs - Dutch Simplification Average40.04SARI (0-100; mean of two datasets)50
Grip on LLMs - Dutch tinyARC66Accuracy (%; GP-IRT estimate from 100 tinyBenchmarks items, 48.3
Grip on LLMs - HonestCityBench - Incorrect Premise48Appropriate acknowledgement rate (%; LLM judge)40

Interactive version: theaggregate.ai/model?slug=apertus-8b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.