Fireworks Ember-1 Release - SWE-bench Verified: leaderboard
Fireworks Research Ember-1 launch post (2026-09-23): controlled four-arm evaluation on the 500-task SWE-bench Verified suite comparing Ember-1 (built on Kimi K3 to shorten reasoning traces; reasoning effort unreported/default) against Fireworks' runs of Kimi K3 at reasoning efforts low, high and max (default). Agent harness, scaffold and repeat count are not disclosed in the post. Pass Rate (%), higher is better.
Metric: Pass Rate (%). Source: fireworks.ai. Saturation forecast: Around February 2027. 2 models tracked. Updated 19 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | Kimi K3 | Max | 93.2 | #61 |
| 2 | Ember-1 | 92.2 | #92 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=fireworks-ember-1-release-swe-bench-verified · How It Works · Data refreshed daily, snapshot 2026-11-20.