Misguided Attention: leaderboard
Modified logic puzzles test whether models follow the actual question instead of recalling a familiar answer. Native task means retain their evaluation counts. A published out-of-range task score and the dependent overall metric remain unresolved; valid independent tasks are kept.
Source: cpldcpu.github.io.
Benchmark results
Results are published separately for each benchmark or evaluation setting.
- Misguided Attention - ball_and_bat_modified
- Misguided Attention - ball_and_bat_modified - o4-mini High 30000-token ceiling
- Misguided Attention - birthday_problem_easy
- Misguided Attention - birthday_problem_easy - o4-mini High 30000-token ceiling
- Misguided Attention - bridge_torch_easy
- Misguided Attention - bridge_torch_easy - o4-mini High 30000-token ceiling
- Misguided Attention - bridge_torch_impossible
- Misguided Attention - bridge_torch_impossible - o4-mini High 30000-token ceiling
- Misguided Attention - cabbage_detective
- Misguided Attention - cabbage_detective - o4-mini High 30000-token ceiling
- Misguided Attention - conjunction_fallacy_impossible
- Misguided Attention - conjunction_fallacy_impossible - o4-mini High 30000-token ceiling
- Misguided Attention - conjunction_fallacy_inverted
- Misguided Attention - conjunction_fallacy_inverted - o4-mini High 30000-token ceiling
- Misguided Attention - conjunction_fallacy_simplified
- Misguided Attention - conjunction_fallacy_simplified - o4-mini High 30000-token ceiling
- Misguided Attention - dead_schrodingers_cat
- Misguided Attention - dead_schrodingers_cat - o4-mini High 30000-token ceiling
- Misguided Attention - feathers_or_steel
- Misguided Attention - feathers_or_steel - o4-mini High 30000-token ceiling
- Misguided Attention - feeding_the_goat
- Misguided Attention - feeding_the_goat - o4-mini High 30000-token ceiling
- Misguided Attention - heavy_feather_modified
- Misguided Attention - heavy_feather_modified - o4-mini High 30000-token ceiling
- Misguided Attention - jugs_1_liter
- Misguided Attention - jugs_1_liter - o4-mini High 30000-token ceiling
- Misguided Attention - jugs_3_liters
- Misguided Attention - jugs_3_liters - o4-mini High 30000-token ceiling
- Misguided Attention - jugs_4_liters
- Misguided Attention - jugs_4_liters - o4-mini High 30000-token ceiling
- Misguided Attention - kings_mercy
- Misguided Attention - kings_mercy - o4-mini High 30000-token ceiling
- Misguided Attention - knights_knaves_easy
- Misguided Attention - knights_knaves_easy - o4-mini High 30000-token ceiling
- Misguided Attention - knights_knaves_impossible
- Misguided Attention - knights_knaves_impossible - o4-mini High 30000-token ceiling
- Misguided Attention - less_confusing_monty_hall
- Misguided Attention - less_confusing_monty_hall - o4-mini High 30000-token ceiling
- Misguided Attention - linear_growth_modified
- Misguided Attention - linear_growth_modified - o4-mini High 30000-token ceiling
- Misguided Attention - lonely_rabbit_impossible
- Misguided Attention - lonely_rabbit_impossible - o4-mini High 30000-token ceiling
- Misguided Attention - monty_appliance_game_show
- Misguided Attention - monty_appliance_game_show - o4-mini High 30000-token ceiling
- Misguided Attention - monty_appliance_simpler
- Misguided Attention - monty_appliance_simpler - o4-mini High 30000-token ceiling
- Misguided Attention - monty_defective_appliance
- Misguided Attention - monty_defective_appliance - o4-mini High 30000-token ceiling
- Misguided Attention - monty_four_computers
- Misguided Attention - monty_four_computers - o4-mini High 30000-token ceiling
- Misguided Attention - monty_hall_inverse
- Misguided Attention - monty_hall_inverse - o4-mini High 30000-token ceiling
- Misguided Attention - monty_three_computers
- Misguided Attention - monty_three_computers - o4-mini High 30000-token ceiling
- Misguided Attention - new_years_monty_hall
- Misguided Attention - new_years_monty_hall - o4-mini High 30000-token ceiling
- Misguided Attention - no_paradox_expected_hanging
- Misguided Attention - no_paradox_expected_hanging - o4-mini High 30000-token ceiling
- Misguided Attention - not_from_hanoi
- Misguided Attention - not_from_hanoi - o4-mini High 30000-token ceiling
- Misguided Attention - parallelism_50_machines
- Misguided Attention - parallelism_50_machines - o4-mini High 30000-token ceiling
- Misguided Attention - poisoned_hot
- Misguided Attention - poisoned_hot - o4-mini High 30000-token ceiling
- Misguided Attention - rabbit_inverted_monty_hall
- Misguided Attention - rabbit_inverted_monty_hall - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_cant_break
- Misguided Attention - riddle_cant_break - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_four_legs_morning
- Misguided Attention - riddle_four_legs_morning - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_goes_up_never_returns
- Misguided Attention - riddle_goes_up_never_returns - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_i_never_shave
- Misguided Attention - riddle_i_never_shave - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_occurs_once_in_a_second
- Misguided Attention - riddle_occurs_once_in_a_second - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_tall_when_young
- Misguided Attention - riddle_tall_when_young - o4-mini High 30000-token ceiling
- Misguided Attention - riddle_two_banks_money
- Misguided Attention - riddle_two_banks_money - o4-mini High 30000-token ceiling
- Misguided Attention - river_crossing_easy
- Misguided Attention - river_crossing_easy - o4-mini High 30000-token ceiling
- Misguided Attention - river_crossing_even_simpler
- Misguided Attention - river_crossing_even_simpler - o4-mini High 30000-token ceiling
- Misguided Attention - river_crossing_simple
- Misguided Attention - river_crossing_simple - o4-mini High 30000-token ceiling
- Misguided Attention - rope_burning_easy
- Misguided Attention - rope_burning_easy - o4-mini High 30000-token ceiling
- Misguided Attention - rope_burning_impossible
- Misguided Attention - rope_burning_impossible - o4-mini High 30000-token ceiling
- Misguided Attention - the_normal_barber
- Misguided Attention - the_normal_barber - o4-mini High 30000-token ceiling
- Misguided Attention - trolley_easy_forced
- Misguided Attention - trolley_easy_forced - o4-mini High 30000-token ceiling
- Misguided Attention - trolley_problem_easy
- Misguided Attention - trolley_problem_easy - o4-mini High 30000-token ceiling
- Misguided Attention - two_door_problem_exit
- Misguided Attention - two_door_problem_exit - o4-mini High 30000-token ceiling
- Misguided Attention - unstoppable_force_var1
- Misguided Attention - unstoppable_force_var1 - o4-mini High 30000-token ceiling
- Misguided Attention - unstoppable_force_var2
- Misguided Attention - unstoppable_force_var2 - o4-mini High 30000-token ceiling
Interactive version: theaggregate.ai/benchmark?slug=misguided-attention · How It Works · Data refreshed daily, snapshot 2026-11-17.