Skip to content

This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.

Notifications You must be signed in to change notification settings

usacognition/PRarena

 
 

Repository files navigation

PR Analytics: Volume vs Success Rate (auto-updated)

View the interactive dashboard for these statistics.

Understanding the Metrics

Different AI coding agents follow different workflows when creating pull requests:

  • All PRs: Every pull request created by an agent, including DRAFT PRs
  • Ready PRs: Non-draft pull requests that are ready for review and merging
  • Merged PRs: Pull requests that were successfully merged into the codebase

Key workflow differences: Some agents like Codex iterate privately and create ready PRs directly, resulting in very few drafts but high merge rates. Others like Copilot and Codegen create draft PRs first, encouraging public iteration before marking them ready for review.

The statistics below focus on Ready PRs only to fairly compare agents across different workflows, measuring each agent's ability to produce mergeable code regardless of whether they iterate publicly (with drafts) or privately.

Data sources

Explore the GitHub search queries used:


chart

Current Statistics

Project Ready PRs Merged PRs Success Rate
Copilot 96,545 89,370 92.57%
Codex 1,322,204 1,164,937 88.11%
Cursor 79,720 68,384 85.78%
Devin 38,067 24,760 65.04%
Codegen 3,837 2,632 68.6%

About

This repo tracks the opened and merged PRs by the top SWE coding agents by OpenAI, GitHub, and others. Updates every 3 hours.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • HTML 58.3%
  • Python 41.7%