Engram - Llama3.1-8b-Insturct - Crafter Peak Progress: leaderboard

Engram v1 A3.T6.5, native task score (%), full reported method roster. Student backbone Llama3.1-8b-Insturct; parameter adaptation and trace-graph retrieval methods remain explicit configurations. Do not transfer adapted scores to the frozen base checkpoint. Source confidence intervals and exact row identities pinned. Held-out performance only, not resource efficiency or admission/retention rates.

Metric: Accuracy / task score (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 3 models tracked.

Top models

#ModelScoreOverall rank
1Llama3.1-8b-Insturct (Engram Run: task=Crafter;method=MAGE;effort=source-unreported)28.1
2Llama3.1-8b-Insturct (Engram Run: task=Crafter;method=Engram;effort=source-unreported)27.4
3Llama3.1-8b-Insturct (Engram Run: task=Crafter;method=BALROG;effort=source-unreported)20.6

Interactive version: theaggregate.ai/benchmark?slug=engram-llama3-1-8b-insturct-crafter-peak-progress · How It Works · Data refreshed daily, snapshot 2026-11-12.