Teuken-7B-Instruct-v0.4: benchmark results

Provider: OpenGPT-X. Released 2024-11-26. Access: Open.

Aggregate Rating 1330 ± 22, rank #1430 of 1656 rated models, from 144 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LA Leaderboard - ClinDiagnosES63.81Semantic Answer Similarity (x100)95.5
LA Leaderboard - PAWS-X Spanish66.6Accuracy (%)92.6
LA Leaderboard - XNLI Galician48.97Accuracy (%)92.6
LA Leaderboard - PAWS Galician66.2Accuracy (%)91.2
LA Leaderboard - RagQuAS80.63Semantic Answer Similarity (x100)89.7
LA Leaderboard - TELEIA52.38Accuracy (%)84.6
LA Leaderboard - XNLI Catalan49.4Accuracy (%)80.9
LA Leaderboard - CatCoLA6.41MCC (x100)77.9
LA Leaderboard - COPA Spanish82.8Accuracy (%)75
LA Leaderboard - OpenBookQA Spanish33.8Accuracy (%)73.5
LA Leaderboard - Parafraseja63.6Accuracy (%)73.5
LA Leaderboard - TE-ca48.23Accuracy (%)72.1

Interactive version: theaggregate.ai/model?slug=teuken-7b-instruct-v0-4 · How It Works · Data refreshed daily, snapshot 2026-10-20.