speechless-nl2sql-ds-6.7B: benchmark results

Provider: uukuguy. Released 2024-01-15. Access: Open.

Aggregate Rating 1210 ± 37, rank #9549 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K15.09Accuracy (%) (5-shot)37
Open LLM Leaderboard v1 - MMLU36.8Accuracy (%) (5-shot)18.9
Open LLM Leaderboard v1 - TruthfulQA MC240.55MC2 (%) (0-shot)14.5
Open LLM Leaderboard v1 - ARC Challenge36.35Normalized accuracy (%) (25-shot)13.9
Open LLM Leaderboard v1 - HellaSwag52.83Normalized accuracy (%) (10-shot)11.2
Open LLM Leaderboard v1 - WinoGrande55.96Accuracy (%) (5-shot)9.5

Interactive version: theaggregate.ai/model?slug=speechless-nl2sql-ds-6-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.