Artificial Intelligence1 min read

Stop counting tokens, start counting what ships

By · Via MIT Tech Review AI · Published by Everything Blog

In short

Unchecked agentic workflows have already forced major shifts, from GitHub Copilot moving to metered credits to enterprise teams exhausting multi-year budgets within months. Because Gartner expects AI token expenses to outstrip average developer salaries by 2028, tracking raw consumption fails to reflect true business value. Evaluating spending based on reviewed code changes while monitoring rework preserves product quality. Additionally, adopting hybrid routing between frontier architectures and on-premises open-weight systems can significantly curb operational expenses.

Key points

  • Blanket token limits harm productivity because they penalize valuable software delivery w…: Blanket token limits harm productivity because they penalize valuable software delivery workflows alongside wasteful activity.
  • Engineering leaders should measure efficiency through the cost per merged pull request wh…: Engineering leaders should measure efficiency through the cost per merged pull request while closely monitoring defects and rework.
  • Deploying hybrid routing gateways allows firms to utilize frontier models for complex pla…: Deploying hybrid routing gateways allows firms to utilize frontier models for complex planning while assigning routine coding to local open-weight systems.

Sources checked by our analysis pipeline: 1

Sponsored

Stop counting tokens, start counting what ships

Why rationing agentic coding backfires, and what to measure instead.

Provided byHPE

When a developer gives an AI agent a coding task, the agent does more than answer once. It plans, generates code, runs tests, and repeats the process to correct errors. A single task can use 10 to 50 times more tokens than a basic chat prompt. The more useful the agent becomes, the more calls it makes. With per-token pricing, the workflows creating the most value can also become the most expensive.

The financial pressure is already visible. Uber reportedly exhausted its entire 2026 AI budget by April after expanding its use of Claude Code. GitHub Copilot moved from flat-rate pricing to metered credits. Gartner predicts that AI coding token costs will surpass average developer salaries by 2028.

The natural response is rationing usage caps, seat limits, and approvals before developers launch agents. But blanket limits can restrict the workflows delivering value. They also optimize the wrong number. Cost per token measures consumption, not results. Some spending reflects waste, including…

Artificial Intelligence