Artificial Intelligence1 min read

Introducing Unity Gateway Insights

By · Published by Everything Blog

In short

The capability leverages end-to-end records of agent sessions, capturing intermediate steps, inputs, outputs, tool calls, and latency to optimize system efficiency. It automatically flags simple prompts routed to high-cost frontier models, highlights consolidation opportunities, and uncovers recurring Model Context Protocol errors. Customers can review findings over flexible timeframes and add up to 10 customized questions to tailor their tokenomics reports.

Key points

  • Organizations can generate detailed tokenomics reports covering periods of one day, seven…: Organizations can generate detailed tokenomics reports covering periods of one day, seven days, or 30 days.
  • Users are able to query Genie directly to pinpoint which specific servers wasted the larg…: Users are able to query Genie directly to pinpoint which specific servers wasted the largest volume of tokens.
  • Savings opportunities are systematically ranked by the total volume of tokens at stake ac…: Savings opportunities are systematically ranked by the total volume of tokens at stake across analyzed sessions.

Sources checked by our analysis pipeline: 1

Automatically discover inefficiencies in your AI usage

by Adam Gurary, Alkis Polyzotis and Vishnu Kannan

When looking to cut AI costs, teams often start with budgets or open-source models. But agent traces can reveal other opportunities to save. At Databricks, trace analysis surfaced several: offline replays showed no performance gain from upgrading from Opus 4.8 to Opus 5, so we stayed on the cheaper 4.8; fixing common MCP errors recovered an estimated $1.2M in costs a year; and traces showed that simple prompts were going to expensive models, prompting us to adopt Smart Routing.

Today, we’re introducing Unity Gateway Insights, which automatically uses Genie to analyze millions of agent traces alongside your business data and ontology. It surfaces where tokens are being wasted: MCP errors that keep recurring, simple tasks running on expensive frontier models, and repeated workflows worth turning into shared skills, all in the context of your business and under the same governance as your other data.

If you already have traffic flowing through Unity Gateway, open AI Gateway > Observability > Insights and generate a report for…

Artificial Intelligence