Automatically discover inefficiencies in your AI usage
by Adam Gurary, Alkis Polyzotis and Vishnu Kannan
When looking to cut AI costs, teams often start with budgets or open-source models. But agent traces can reveal other opportunities to save. At Databricks, trace analysis surfaced several: offline replays showed no performance gain from upgrading from Opus 4.8 to Opus 5, so we stayed on the cheaper 4.8; fixing common MCP errors recovered an estimated $1.2M in costs a year; and traces showed that simple prompts were going to expensive models, prompting us to adopt Smart Routing.
Today, we’re introducing Unity Gateway Insights, which automatically uses Genie to analyze millions of agent traces alongside your business data and ontology. It surfaces where tokens are being wasted: MCP errors that keep recurring, simple tasks running on expensive frontier models, and repeated workflows worth turning into shared skills, all in the context of your business and under the same governance as your other data.
If you already have traffic flowing through Unity Gateway, open AI Gateway > Observability > Insights and generate a report for…