Pizza Words Browser - Unparseable Output: leaderboard

Deployed browser cohort only; cited five-seed paper row excluded. Exact public artifact umarsheikh303/pizza-words-gguf, seed0 Qwen3.5-0.8B LoRA merged and GGUF Q8_0 quantized. Greedy decoding, 50-token cap, export-manifest prompt/stop settings; official unordered-tree matcher port verified on507618 saved predictions. All1357 valid PIZZA test orders in denominator; refusals and nonparse outcomes are failures. Do not attribute trained scores to Qwen base. Metric: Fraction of all 1357 test orders (0–1). Source: https://arxiv.org/html/2611.18284v1

Metric: Fraction of all 1357 test orders (0–1). Source: arxiv.org. 1 model tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1Pizza Words Qwen3.5-0.8B (Q8_0)0.062

Interactive version: theaggregate.ai/benchmark?slug=pizza-words-browser-unparseable-output · How It Works · Data refreshed daily, snapshot 2026-11-17.