Pizza Words Browser - Exact Match: leaderboard
Deployed browser cohort only; cited five-seed paper row excluded. Exact public artifact umarsheikh303/pizza-words-gguf, seed0 Qwen3.5-0.8B LoRA merged and GGUF Q8_0 quantized. Greedy decoding, 50-token cap, export-manifest prompt/stop settings; official unordered-tree matcher port verified on507618 saved predictions. All1357 valid PIZZA test orders in denominator; refusals and nonparse outcomes are failures. Do not attribute trained scores to Qwen base. Metric: Fraction of all 1357 test orders (0–1). Source: https://arxiv.org/html/2611.18284v1
Metric: Fraction of all 1357 test orders (0–1). Source: arxiv.org. 1 model tracked. Updated 17 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Pizza Words Qwen3.5-0.8B (Q8_0) | 0.882 |
Interactive version: theaggregate.ai/benchmark?slug=pizza-words-browser-exact-match · How It Works · Data refreshed daily, snapshot 2026-11-17.