Artificial Intelligence1 min read

Why is Gemini 4 Carbon taking so long?

By · Published by Everything Blog

In short

The system spends roughly half of its total execution effort addressing unrelated code paths and guarding against scenarios already excluded by problem descriptions. Inefficiencies are further compounded by repetitive reading, with over a third of all examined code lines consisting of duplicate views. Researchers managed to reduce resolution times from 37 minutes to 28 minutes simply by prompting the system to confirm if it possessed sufficient details to implement a fix.

Key points

  • Prolonged completion times stem from procedural inefficiencies rather than an underlying…: Prolonged completion times stem from procedural inefficiencies rather than an underlying lack of technical comprehension.
  • Half of the model's total operational workload is wasted on tasks not requested in the or…: Half of the model's total operational workload is wasted on tasks not requested in the original bug reports.
  • Prompting the model to assess its readiness to code reliably shortens overall task comple…: Prompting the model to assess its readiness to code reliably shortens overall task completion times.

Sources checked by our analysis pipeline: 1

While benchmarking Gemini 4 Carbon on one of our private evals, we found something surprising: it spent close to an hour completing tasks that routinely took Opus and Astra only a few minutes:

Turns out we weren't alone in noticing this.

I don't really know how to properly emphasize this. Gemini 4 Carbon is unacceptably slow in real world usage.

Gemini 4 Carbon low: 22m21s

Opus 5.5 high: 9m33s

i really love gemini 4 carbon but its too slow. im losing my mind waiting just to stay focused and learn simple things

dude why is carbon so fucking slow

carbon is nearly unusable because of how slow it is, but people are majorly sleeping on it

To find out why, we traced every step of Carbon's runs and quantified what contributes to the slowness.

The Task

In each task, the agent gets a codebase from just before a bug was fixed, along with a report that describes the bug only by its symptoms. Its job is to diagnose the bug and fix it, without making any unrelated changes.

Much of…

Artificial Intelligence