H2O Lightning 4B Release - DI Vision 12210 ECE - Image Temperature 0.65: leaderboard
H2O Lightning 4B Release - DI Vision 12210 ECE - Image Temperature 0.65: Top-option expected calibration error, ten equal-width bins (0-1). H2O-Lightning-4B official card: trained v1.4.1 weights (same weights served by v1.4.2), distinct from older trained v1.4.0 (additional training data documented). All current native runs retain v1.4.2 server, two-way one-engine vLLM0.30.0, calibration and profile, with explicit one-way/image-temperature variants. Owner-run full-text DI0.3 profile/default, JevBench counts, held-out and new-domain skill, text/vision indices, ECE and long-record-selector experiments retained. Skill is chance-rescaled accuracy (chance0/perfect100), with no finite theoretical floor. Copied BenchmarkHeaven ImageJevBench/resource composites and training-set measurements withheld. Native source condition: Image Temperature 0.65.
Metric: Top-option expected calibration error, ten equal-width bins (0-1). Source: huggingface.co. 1 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | H2O-Lightning-4B v1.4.1 | 0.11 |
Interactive version: theaggregate.ai/benchmark?slug=h2o-lightning-4b-release-di-vision-12210-ece-image-temperature-0-65 · How It Works · Data refreshed daily, snapshot 2026-11-12.