Technology1 min read

Engineering Vitals in the Age of AI

By · Published by Everything Blog

In short

Engineering leaders are moving past simplistic activity tracking, like generated lines of code, in favor of measuring the speed and stability of their delivery pipelines. Software company Octopus is tracking engineering vitals to support the iterative loop of shipping, observing, and deciding. This framework enables organizations to adapt as AI tools like Claude empower smaller teams and non-traditional contributors to deploy changes. By relying on concrete delivery data rather than vague impressions, companies can better maintain service level objectives.

Key points

  • The speed of iterative shipping cycles acts as an effective proxy for long-term customer…: The speed of iterative shipping cycles acts as an effective proxy for long-term customer value.
  • Concrete pipeline data enables engineering leaders to optimize processes and uphold servi…: Concrete pipeline data enables engineering leaders to optimize processes and uphold service level objectives reliably.
  • Tracking operational vitals helps software organizations expand their capacity and enhanc…: Tracking operational vitals helps software organizations expand their capacity and enhance customer experience without sharp cost increases.

Sources checked by our analysis pipeline: 1

Every engineering organization is being asked the same question right now: is AI actually making us better at building software?

It’s a fair question. We’re spending real money on tokens and tooling, and we’re reshaping how our teams work. We should be able to say what we’re getting for it.

The answers I see tend to fall into two camps. The first counts activity: lines of code generated, tokens consumed, the percentage of code written by agents. The second skips straight to the destination, and declares that the only thing worth measuring is value.

LaunchDarkly’s recent Release Autopilot announcement is a good example of the second camp. It describes the goal they set for their AI software factory: maximize the valuable software reaching customers for each hour of human attention it takes to get it there.

That isn’t a goal. It’s an aspiration.

How do you count valuable software? Value shows up weeks or months after changes ship, and it’s the product of many decisions made across product, design, engineering, and sales. Value is a team sport. How do you…

Technology