Shipping code faster with o3, o4-mini, and GPT-4.1


May 22, 2025

API

With OpenAI, CodeRabbit helps developers ship 4x faster and cut production bugs in half

CodeRabbit logo in white on a background of golden fur

CodeRabbit(opens in a new window) was launched in 2023 by a team of former engineering leaders who had felt the pain of slow, manual code reviews firsthand. While AI made it easier to write code, there weren’t tools to solve the biggest bottleneck: getting code shipped.

“You could generate a million lines of code,” says Sahil M. Bansal, Senior Product Manager at CodeRabbit. “But if your review process only supports 1,000 lines, that’s all you’re shipping.”

The insight was simple but powerful: the bottleneck in software development had shifted from code generation to code review. So the team focused on using OpenAI’s models not only to write code, but also to unlock the speed, accuracy, and intelligence required to review it. Over the last year, CodeRabbit has been used by more than 5,000 developers and 70,000 open-source projects.

Shifting AI from code generation to code review

As engineering teams leaned into AI for code generation, the limitations of manual code reviews became more apparent. Reviews were slow, repetitive, and missed critical issues–particularly across large, distributed teams, unfamiliar codebases or edge cases that are hard to detect. Valuable developer time was spent reviewing instead of building, and costly bugs were escaping into production.

CodeRabbit’s team knew the problem intimately. “Even when teams used AI to generate more code, they weren’t shipping faster,” Bansal explains. “The code review cycle was the bottleneck.” 

And while some companies attempted to solve this by encouraging reviews during development, CodeRabbit believed that the most effective check came just before shipping–once all the code came together, like tributaries feeding a river.

“We realized this was the most strategic moment to apply AI for code reviews,” says Aravind Putrevu, Director of Developer Marketing at CodeRabbit. “It’s when the risk is highest and the context is most complex.”

Unblocking reviews with OpenAI models

To solve the problem, CodeRabbit built a powerful multi-step review system powered by OpenAI’s LLMs. 

When a developer submits a pull request, CodeRabbit clones the repository into a sandboxed environment, enriches the diff with additional context that comes from code history, linters, code graph analysis, issue tickets, and developer conversations, before kicking off a multi-model analysis.

“We run recursive reviews using OpenAI models,” Putrevu says. “After enriching the context, we run multiple passes to ensure the comments are accurate, meaningful, and tailored to each team’s standards.”

CodeRabbit’s system uses a combination of OpenAI models for different tasks:

  • o4-mini and o3: use reasoning-heavy capabilities to power tasks like multi-line bugs and code refactors or architecture issues across files
  • GPT4.1: leverage the 1M token context window for review summarization, docstring generation, and routine QA checks
  • Customized LLM prompts: include each customer’s code review requirements, security posture, and best practices to validate

“We think of CodeRabbit as a senior engineer embedded in your workflow,” says Bansal. “It’s not just AI that reviews code. It’s a system that understands your codebase, your team’s habits, and your standards–powered by models with the reasoning depth to catch real issues.”

CodeRabbit also recently launched integration into Visual Studio (VS) Code, allowing developers to receive reviews in real time directly in their code editor. The tool now supports both code reviews in VS Code and in Pull Requests, ensuring flexibility for developers to review code individually right as they are coding, as well as collectively in their Pull Requests when all code commits come together.

Image showing a development IDE with Python code, and the Coderabbit assistant making a suggestion to improve the code

50% more accurate suggestions and faster PR merges

Since adopting OpenAI’s o3 model, CodeRabbit has achieved measurable improvements:

  • 50% increase in accurate suggestions: CodeRabbit’s reviews are significantly more precise, helping developers focus on meaningful issues without getting bogged down by unnecessary feedback​.
  • Improved pull request merge rates: More accurate code reviews have accelerated PR merges, streamlining development workflows for enterprise clients​.
  • Higher customer satisfaction: The reduction in false positives and improved code insights have led to greater customer satisfaction, especially among enterprises dealing with complex codebases​.

CodeRabbit continues to benchmark OpenAI’s models against competitors like Sonnet 3.5 and Google Gemini, consistently finding OpenAI’s models to be effective for their use case​. Looking ahead, they’re exploring further customization around o3‑mini and considering reinforcement fine-tuning to continue elevating their AI code review capabilities.

Delivering 4x speed, 50% fewer bugs, and 60x ROI

Developers using CodeRabbit already shipping code more quickly, with fewer errors, and freeing up time to focus on harder engineering problems:

  • 25-50% faster pull request cycles. “If it used to take an hour to get a PR out,” Bansal says, “you’re doing it in 30-45 minutes with CodeRabbit.”
  • 50% fewer bugs in production. Customers report significant reductions in escaped defects after implementing CodeRabbit’s AI-powered reviews.
  • 20-60x ROI. By reducing manual labor, improving reliability, and speeding up release cycles, CodeRabbit delivers measurable business impact.

CodeRabbit is continuing to scale adoption and expand its in-IDE support, making reviews even more immediate and accessible. The team is also exploring reinforcement learning and deeper customization using OpenAI’s o3 models, with the goal of making reviews smarter and more adaptive across environments in addition to faster.

Interested in learning more about ChatGPT for business?

Keep reading

View all

Cover media” data-nosnippet=”true” loading=”lazy” decoding=”async” data-nimg=”fill” class=”object-cover object-center” sizes=”(min-width: 1728px) 1728px, 100vw” srcset=”https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=640&q=90&fm=webp 640w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=750&q=90&fm=webp 750w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=828&q=90&fm=webp 828w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=1080&q=90&fm=webp 1080w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=1200&q=90&fm=webp 1200w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=1920&q=90&fm=webp 1920w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=2048&q=90&fm=webp 2048w, https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=3840&q=90&fm=webp 3840w” src=”https://images.ctfassets.net/kftzwdyauwt9/4X3HwsNsncluAzNEqlXFg3/558227ebd1d4edc388dc325ecbcd75f0/oai_Lowe_s_hero_4.5.png?w=3840&q=90&fm=webp”>

Lowe’s puts project expertise into every hand

APIMay 7, 2025

cover image” data-nosnippet=”true” loading=”lazy” decoding=”async” data-nimg=”fill” class=”object-cover object-center” sizes=”(min-width: 1728px) 1728px, 100vw” srcset=”https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=640&q=90&fm=webp 640w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=750&q=90&fm=webp 750w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=828&q=90&fm=webp 828w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=1080&q=90&fm=webp 1080w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=1200&q=90&fm=webp 1200w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=1920&q=90&fm=webp 1920w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=2048&q=90&fm=webp 2048w, https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=3840&q=90&fm=webp 3840w” src=”https://images.ctfassets.net/kftzwdyauwt9/2HBxiM1dDPpM1W56ehwgNi/01dc3dafe6aedcabc9808446492523ea/oai_Notion_1x1.png?w=3840&q=90&fm=webp”>

Bringing intelligence to every workflow

APIApr 3, 2025



Source link

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top