COLLIE: leaderboard

2,080 constrained text-generation instances across 13 constraint structures at word, sentence, paragraph and passage level, from Princeton NLP (2023); outputs are checked programmatically.

Source: arxiv.org.

Interactive version: theaggregate.ai/benchmark?slug=collie · How It Works · Data refreshed daily, snapshot 2026-09-05.