llamaRAGdrama: benchmark results

kevin009's llamaRAGdrama, a Llama fine-tune for question-answering and retrieval-augmented generation, trained on dramatic text data enriched with factual sources to stay accurate under stylized prompts. Provider: kevin009. Released 2024-02-04. Access: Open.

Aggregate Rating 1469 ± 30, rank #878 of 1635 rated models, from 17 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - WinoGrande86.66Accuracy (%) (5-shot)99.3
Open LLM Leaderboard v1 - HellaSwag88.83Normalized accuracy (%) (10-shot)94.3
Open LLM Leaderboard v1 - ARC Challenge72.01Normalized accuracy (%) (25-shot)90.7
Open LLM Leaderboard v1 - TruthfulQA MC270.24MC2 (%) (0-shot)90.2
Open LLM Leaderboard v1 - GSM8K65.66Accuracy (%) (5-shot)80.4
Open Portuguese LLM - ASSIN2 RTE92.24Macro F1 (%)76.6
Open LLM Leaderboard - MuSR43.16Score71.7
Open LLM Leaderboard v1 - MMLU64.5Accuracy (%) (5-shot)71.5
Open Portuguese LLM - FaQuAD NLI73.42Macro F1 (%)69
Open Portuguese LLM - BLUEX54.66Accuracy (%)60.8
Open Portuguese LLM - ENEM62.98Accuracy (%)54.1
Open Portuguese LLM - OAB Exams42.73Accuracy (%)53.1

Interactive version: theaggregate.ai/model?slug=llamaragdrama · How It Works · Data refreshed daily, snapshot 2026-11-05.