Reflection Beam Safety - MBCT - 2025-08-21 - Exact Match: leaderboard
Molecular biology laboratory knowledge and troubleshooting,200 questions,exact-match multiple-response correctness; dated2025-08-21 release. Source-specific score; no fusion with a different harness or version is implied. Reflection Oct16 release links this technical report as its complete safety evaluations; final Beam model card links it too. Beam denotes final generic Beam1.0, numeric precision unreported; do not map to BF16, FP8 or NVFP4. Comparator names retained exactly as published; no provider/checkpoint/country/openness inference from abbreviated labels. Biological capability protocol: recommended sampling and highest available reasoning,65536 output tokens,256K context except Muse/GPTOSS128K; full benchmark3runs. Single-turn questions without tools/demos, agentic tasks in Inspect AI sandbox. Metric: Accuracy (%). Higher is better. Exact printed figure values; https://cdn.sanity.io/images/sp40emik/production/0579f5eaf1fa6776d11db7f02a376602c4510513-2280x1890.png?w=3840&fit=max
Metric: Accuracy (%). Source: reflection.ai. Saturation forecast: Around 2029. 13 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Kimi K3 | 59.33 | #29 |
| 2 | Qwen 3.8 Max | 59 | #31 |
| 3 | DeepSeek V4 Pro | 52.33 | #101 |
| 4 | GLM-5.3 | 52.17 | #40 |
| 5 | GLM-5.2 | 52 | #71 |
| 6 | DeepSeek V4.1 Flash | 52 | #35 |
| 7 | Inkling | 51.83 | #123 |
| 8 | Beam 1.0 | 48.5 | #97 |
| 9 | DeepSeek V4 Flash | 47.67 | #135 |
| 10 | GPT-OSS-120B | 46.67 | #336 |
| 11 | Nemotron 3 Ultra | 45.67 | #240 |
| 12 | Kimi K2.6 | 44.67 | #105 |
| 13 | Muse Glimmer 30B | 43.17 | #178 |
No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #7 Gemini 4 Argon.
Interactive version: theaggregate.ai/benchmark?slug=reflection-beam-safety-mbct-2025-08-21-exact-match · How It Works · Data refreshed daily, snapshot 2026-10-17.