Infinirc-Llama3-8B-2G-Release-v1.0: benchmark results

Provider: Infinirc. Released 2024-06-26. Access: Open.

Aggregate Rating 1306 ± 42, rank #8624 of 10916 rated models, from 14 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - MuSR46.09Score88.2
Open LLM Leaderboard - GPQA29.95Score55.6
Open LLM Leaderboard - BBH43.51Score30.7
Open LLM Leaderboard - MMLU-Pro21.6Score22.7
Open LLM Leaderboard - IFEval20.24Score12.3
Open Chinese LLM - CMMLU44.65Accuracy (%)12.1
Open Chinese LLM - WinoGrande59.59Accuracy (%)12.1
Open LLM Leaderboard - MATH Level 51.66Score12.1
Open Chinese LLM - TruthfulQA MC47.39Accuracy (%)10.2
Open Chinese LLM - C-Eval Semantic49.05Accuracy (%)9.5
Open Chinese LLM - HellaSwag50.51Accuracy (%)8.9
Open Chinese LLM Leaderboard42.94Official Nonzero-Task Mean (%)6.8

Interactive version: theaggregate.ai/model?slug=infinirc-llama3-8b-2g-release-v1-0 · How It Works · Data refreshed daily, snapshot 2026-11-08.