TAC (Travel Agent Compassion) - With Welfare Guidance: leaderboard

The Travel Agent Compassion scenarios (CaML, arXiv 2606.18142; inspect_evals/tac_welfare) rerun with one sentence of animal-welfare guidance in the agent's system prompt, so the gap to the unguided board separates default behaviour from instruction-following. Score: welfare rate, the share of runs (%) that avoid the option harming animals. Higher is better. Source: https://compassionbench.com/tac

Metric: Welfare rate (%; the same scenarios with one sentence of animal-welfare guidance in the system prompt). Source: compassionbench.com. Saturation forecast: Around January 2027. 26 models tracked.

Top models

#ModelScoreOverall rank
1Claude Opus 5100#12
2GPT-6 Astra100#6
3Muse Spark 1.3100#25
4Grok 4.699.4#26
5Gemini 3.7 Flash98.7#23
6Claude Fable 5.198.7#9
7GPT-5.298.1#109
8GPT-5.6 Sol98.1#20
9Gemini 3.5 Flash98.1#59
10GPT-5.6 Terra96.8#40
11GPT-5.596.2#31
12Gemini 3.8 Flash95.5#22
13Claude Fable 594.9#15
14Claude Opus 4.894.2#36
15Claude Sonnet 4.692.3#90

No result here: #7 GPT-6.1 Sol, #8 Gemini 4 Argon, #10 Muse Wonder Full.

Interactive version: theaggregate.ai/benchmark?slug=tac-travel-agent-compassion-with-welfare-guidance · How It Works · Data refreshed daily, snapshot 2026-10-19.