Tutorials, deep dives and product notes — built for developers.
Cognition’s FrontierCode 2.0 is a new 132-task mergeability benchmark. Interactive leaderboard with best-effort model scores, task pass rates, flag rates, harnesses, and actual evaluation cost per rollout. Updated October 30, 2026.
Terminal-Bench 4.0: the tbench.ai public board remains led by Claude Opus 5.5 (64.8%). Adds Kimi K3.1 Pro (65.7%, Moonshot), Gemini 4 Carbon (64%, Artificial Analysis), GPT-6.1 Terra (50.3%) and MiniMax M3.1 Flash (38.1%) as separately labeled runs. Updated Oct 30, 2026.
Interactive Terminal-Bench 3.0 leaderboard with Claude Opus 5 at 42.7%, GPT-5.6 Sol at 34.6%, GLM 5.3 at 28.3%, and all tracked frontier agent models ranked. Updated August 2026.
FrontierBench v0.1 / Terminal-Bench 3.0: adds Snorkel AI's GLM-5.3 result (32.4% ±1.5, Claude Code) alongside Z.ai's distinct 28.3% launch result. Updated October 16, 2026.
Archived FrontierCode 1.1 Main leaderboard: Cognition results remain separate from independent Artificial Analysis runs; adds Kimi K3.1 Pro’s 47.1% AA Stirrup result. FrontierCode 2.0 is current and not score-comparable. Updated Oct 30, 2026.
DeepSWE v1.1: adds Kimi K3.1 Pro (75.5%) and MiniMax M3.1 Flash (73.7%) as provider/model-card runs, separate from Datacurve's mini-swe-agent board. Muse Wonder Full (79.0%) remains the top provider score. Updated Oct 30, 2026.
MCP Atlas: adds Meta Muse Spark Open at 89.2% (xhigh, model-card evaluation), alongside Scale’s and other provider-specific results. Muse Spark 1.2 remains highest at 90.3%. No hosted API price is published for Spark Open. Updated Oct 23, 2026.
Terminal-Bench 2.1: adds Meta Muse Spark Open at 76.4% from Meta’s Oct 15 model card, labeled separately from tbench.ai public rankings. DeepSeek V4.1 Flash remains public-board leader at 90.6%. Updated Oct 23, 2026.
SWE-bench Pro: Anthropic reports Opus 5.5 at 89.9%, Sonnet 5.5 at 81.3%, and newly added Haiku 5.5 at 64.8%. Vendor results remain separate from Scale's standardized rows. Updated October 16, 2026.