reddit.com via Reddit

Claude Code hits 56% PR merge rate across 279 open-source submissions

anthropic coding tools claude-code agentic-coding open-source pr-automation

Key insights

  • Claude Code achieved a 56% PR merge rate across 279 autonomous submissions to real open-source repositories over ten days.
  • Open-source maintainers often accepted AI-generated changes without knowing an AI produced them.
  • This is the first publicly documented large-scale measurement of an AI coding agent's real-world PR acceptance rate.

Why this matters

A 56% merge rate at 279 PRs demonstrates that AI agents can now contribute to production codebases at a pace and acceptance rate that outpaces most human contributors, fundamentally changing the economics of open-source maintenance. For founders building developer tools or AI coding products, this is the first empirical signal that autonomous PR submission is a viable workflow rather than a demo-only concept. Technical leaders responsible for open-source dependencies now face a concrete supply-chain question: their review processes were not designed to detect or handle AI-generated contributions at volume, and the gap between that assumption and reality is already being exploited.

Summary

A developer using Claude Code autonomously submitted 279 pull requests across open-source repositories over ten days, with 80 merged at a 56% acceptance rate — the first published benchmark of Claude Code's real-world contribution performance at scale. The experiment ran without maintainers consistently knowing an AI generated the changes. The developer, GitHub user kimjune01, linked their profile rather than a single repo, leaving the full methodology open for replication by anyone willing to run a similar batch. Essentially: (Anthropic's Claude Code, open-source maintainers) are now in an undisclosed relationship where AI-generated patches land in production codebases at meaningful acceptance rates. - 279 PRs submitted over roughly 10 days, 80 merged, 56% acceptance rate on evaluated submissions - Maintainers were not always informed the contributions were AI-generated - Reddit commenters are split on whether this represents genuine contribution or synthetic noise injected into the open-source supply chain The real question the experiment surfaces isn't about Claude's capability; it's about whether open-source review processes are equipped to handle AI-generated contributions at volume.

Potential risks and opportunities

Risks

  • Open-source projects that merged AI-generated PRs without disclosure could face contributor agreement violations or license complications if their CLA terms require human authorship attestation
  • Widespread replication of this workflow could flood maintainer queues with low-signal AI patches, accelerating burnout in already under-resourced projects like those in the Linux, Python, and npm ecosystems
  • Security-sensitive repositories that merged undisclosed AI contributions face an unquantified backdoor risk if the AI was prompted or manipulated to introduce subtle vulnerabilities at scale

Opportunities

  • Developer tool companies (Linear, Graphite, Mergify) could build AI-PR triage layers that detect synthetic contributions and flag them for maintainers before review
  • Anthropic gains a concrete third-party benchmark to market Claude Code against competing agents (GitHub Copilot Workspace, Devin, SWE-agent) on real-world merge rate rather than synthetic evals
  • Open-source foundations (Apache, Linux Foundation, Python Software Foundation) have a concrete case study to accelerate policy work on AI contribution disclosure requirements, which could become a new compliance surface for enterprise contributors

What we don't know yet

  • Which repositories and language ecosystems were targeted — the full repo list has not been published, so replication and impact assessment remain incomplete
  • Whether any of the 80 merged PRs introduced subtle regressions or latent bugs that post-merge review has since caught
  • Whether kimjune01 disclosed AI authorship to maintainers in any cases, and if disclosure affected the acceptance rate

Originally reported by reddit.com

Read the original article →

Original headline: r/ClaudeAI: Developer Uses Claude Code to Submit 279 PRs to Open-Source Repos — 80 Merged at 56% Rate Over 10 Days