Dianjin-R1-7B: benchmark results

Provider: Other.

Aggregate Rating 1483 ± 33, rank #2629 of 10916 rated models, from 39 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FinRiskAtlas - Evidence-Grounded Processing - Institution Matching90Accuracy (%)87.5
QuantEval - Quantitative Reasoning (No CoT)38Accuracy (%; direct answer, no chain-of-thought)83.3
QuantEval - Quantitative Reasoning (CoT)42.8Accuracy (%; chain-of-thought prompting)75
FinRiskAtlas - FinRisk-Ask - Evidence-Request Alignment57.72ERA (%; DeepSeek-V4-Flash request-alignment judge)54.8
FinED-Bench - Financial Domain Knowledge Errors17.19F1 (%; financial domain knowledge errors: terminology misuse40
FinED-Bench - Financial Reasoning Errors8.66F1 (%; financial reasoning errors: conflicting expression, t40
FinReasoning (Deep Insight)70.8Rubric score (0-100): a judge score fused from DeepSeek-V3 a33.3
FinReasoning (Deep Insight) - Architectural Richness and Strictness77.1Rubric score (0-100): a judge score fused from DeepSeek-V3 a33.3
FinReasoning (Deep Insight) - Completeness and Comparative Analysis73.3Rubric score (0-100): a judge score fused from DeepSeek-V3 a33.3
FinReasoning (Deep Insight) - Justification and Causal Depth69.1Rubric score (0-100): a judge score fused from DeepSeek-V3 a33.3
FinED-Bench - General Knowledge Errors18.72F1 (%; general knowledge errors: illegal time, redundant sta30
FinReasoning (Deep Insight) - Factuality and Contextualization63.6Rubric score (0-100): a judge score fused from DeepSeek-V3 a27.8

Interactive version: theaggregate.ai/model?slug=dianjin-r1-7b · How It Works · Data refreshed daily, snapshot 2026-11-08.