SWE-bench

Indexed results from SWE-bench. Each ranking retains its own metric and evaluation conditions.

SWE-bench Lite

sweBench · SWE-bench · Resolved tasks · percent

  1. OpenAI: GPT-4o (2024-08-06)openai36%
  2. OpenAI: GPT-4o (2024-08-06)openai21.67%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace