Tarsier2-7B: benchmark results

Provider: Other. Released 2025-04-25. Access: Open.

Aggregate Rating 1618 ± 38, rank #854 of 10916 rated models, from 27 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MoHallBench - Semantic Similarity Hallucination (Multiple Choice)87.5Multiple-choice accuracy (%; four-option multiple choice (gr100
MoHallBench - Sequential Inference Hallucination29.1Q-PairAcc (%; share of adversarial pairs in which the model 100
MoHallBench - Sequential Inference Hallucination Rate (Generative)5.7Hallucination rate (%; share of free-form descriptions of tr100
MoHallBench - Action-Action Hallucination (Multiple Choice)80.8Multiple-choice accuracy (%; four-option multiple choice (gr94.4
Reviso Captioning - DREAM-1K Precision41.5Precision (%)93.3
MoHallBench - Action-Action Hallucination26.9Q-PairAcc (%; share of adversarial pairs in which the model 88.9
MoHallBench - Object-Action Hallucination (Multiple Choice)73.7Multiple-choice accuracy (%; four-option multiple choice (gr88.9
MoHallBench - Scene-Action Hallucination (Multiple Choice)82.4Multiple-choice accuracy (%; four-option multiple choice (gr88.9
Reviso Captioning - DREAM-1K F139.2F1 (%)86.7
MoHallBench - Semantic Similarity Hallucination27.6Q-PairAcc (%; share of adversarial pairs in which the model 77.8
MoHallBench - Visual Similarity Hallucination31.7Q-PairAcc (%; share of adversarial pairs in which the model 77.8
TVBench54.7Average Accuracy74.1

Interactive version: theaggregate.ai/model?slug=tarsier2-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.