Tutorials, deep dives and product notes — built for developers.
Cognition’s FrontierCode 2.0 is a new 132-task mergeability benchmark. Interactive leaderboard with best-effort model scores, task pass rates, flag rates, harnesses, and actual evaluation cost per rollout. Updated October 30, 2026.
GPT-6 Luna vs GPT-5.4 Mini compared: rate card, context windows, knowledge cutoffs, and the shared Artificial Analysis harness where Luna leads the Intelligence Index 37 to 24 at 6.4x lower cost per task, while mini wins on speed. Vendor scorecard gaps stated honestly.
Interactive Terminal-Bench 3.0 leaderboard with Claude Opus 5 at 42.7%, GPT-5.6 Sol at 34.6%, GLM 5.3 at 28.3%, and all tracked frontier agent models ranked. Updated August 2026.
Claude Opus 5 vs Kimi K3: Opus 5 leads the independent BenchLM aggregate 85.88 to 79.98 and posts a 43.3–43.5% Frontier-Bench score that K3 has never even been tested on.
Claude Opus 5 vs Claude Fable 5: Opus 5 beats Fable 5 on 7 of 12 benchmarks including Frontier-Bench (+9.6) and OSWorld 2.0 — at half the price ($25 vs $50/1M output). Fable 5 edges SWE-bench Pro by just 0.8 pts. Full comparison with radar charts, pricing, data retention, and verdict.
Claude Opus 5 vs GPT-5.6 Sol: Opus 5 leads 9 of 12 benchmarks including SWE-bench Pro (+14.6 pts) and ARC-AGI-3 (3.9× better). Sol counters with Terminal-Bench 2.1 (91.9% Ultra) and DeepSWE. Opus 5 costs 17% less on output ($25 vs $30/1M). Full comparison with radar charts, pricing, and verdict.
Archived FrontierCode 1.1 Main leaderboard: Cognition results remain separate from independent Artificial Analysis runs; adds Kimi K3.1 Pro’s 47.1% AA Stirrup result. FrontierCode 2.0 is current and not score-comparable. Updated Oct 30, 2026.
DeepSWE v1.1: adds Cognition's SWE-2 Flash (60.1%, provider-reported) alongside Kimi K3.1 Pro (75.5%) and MiniMax M3.1 Flash (73.7%) as provider/model-card runs, separate from Datacurve's mini-swe-agent board. Muse Wonder Full (79.0%) remains the top provider score. Updated Nov 6, 2026.
Kimi K3 vs GPT-5.6 Sol: Sol leads 6 of 9 shared benchmarks including DeepSWE and Terminal-Bench 2.1. K3 wins FrontierSWE, BrowseComp, and AA-Briefcase at 40% lower cost. Sol Ultra hits 91.9% on Terminal-Bench. Full comparison with radar charts and pricing.
Kimi K3 vs Claude Fable 5 across 35 benchmarks: Fable wins 22, K3 wins 12, 1 tie. K3 leads Terminal-Bench 2.1, SWE Marathon (+7), BrowseComp, and took #1 on the Frontend Code Arena — all at 70% less cost. Fable dominates FrontierSWE (+5.4), HLE (+9.8), and vision. Full scorecard with radar charts and pricing analysis.
Kimi K3 vs Claude Opus 4.8: K3 leads all 9 shared coding benchmarks and costs 40% less. Opus 4.8 counters with independently verified scores, adjustable reasoning, and mature production tooling. Full comparison with radar charts and pricing tables.
Head-to-head comparison of MiniMax M2.7 vs DeepSeek V4 Flash — two open-weight budget coding models. Flash wins on raw code (91.6% LiveCodeBench, 79% SWE-bench Verified), M2.7 wins on agentic value (56.22% SWE-bench Pro, 78.1 points per dollar). Full benchmarks, pricing, and speed analysis.