TechnologySaturday, October 17, 20262 min read

AI Gateway logs now show session affinity

By Engineering Blogs · Published by Everything Blog

In short

The AI Gateway now features a Sessions view that groups requests into sessions, displaying detailed information such as coding agent, cost, models, providers, and cache usage. This feature allows for easy filtering and management of sessions by turns, client, model, provider, authentication, or cost. Sessions can be hidden until the minimum turns filter is cleared, and session affinity routes each turn to the provider that served the previous one, optimizing for cached input. To group requests yourself, use the provided sessionId in providerOptions.gateway or the same x-session-id header on every request in a conversation. Requests without a sessionId are fingerprinted and appear as fingerp…

Key points

The AI Gateway now features a Sessions view that groups requests into sessions.: The AI Gateway now features a Sessions view that groups requests into sessions.
This view displays detailed information such as coding agent, cost, models, providers, an…: This view displays detailed information such as coding agent, cost, models, providers, and cache usage.
Sessions can be filtered by turns, client, model, provider, authentication, or cost.: Sessions can be filtered by turns, client, model, provider, authentication, or cost.

Sources checked by our analysis pipeline: 1

AI Gateway logs now have a Sessions view that groups requests into sessions and shows how session affinity routed each one. Each row shows the coding agent or app that ran the session, such as Claude Code, Codex, or Cursor, along with its cost, models, providers, and how much of its input was cached across every turn.

Open a session to see its cache hit rate, duration, and path. The path lists each turn with its model and timing, and names the provider serving the session along with any earlier ones. Session affinity sends each turn to the provider that served the one before it, so the provider already has most of the prompt in cache. A session that stays on one provider reads more of each prompt from cache.

Filter sessions by turns, client, model, provider, authentication, or cost. Single-turn sessions are hidden until you clear the minimum turns filter.

Session affinity runs by default on text and chat requests. To group requests yourself, send the same sessionId

in providerOptions.gateway

, or the same x-session-id

header, on every request in a conversation. Requests without one are grouped by a fingerprint of the conversation's opening and appear as fingerprinted sessions.

Read the session affinity documentation for more information on how AI Gateway identifies sessions.

Original source: vercel.com

AI Analysis

Tone

Neutral

In short

Key Points

The AI Gateway now features a Sessions view that groups requests into sessions.: The AI Gateway now features a Sessions view that groups requests into sessions.
This view displays detailed information such as coding agent, cost, models, providers, an…: This view displays detailed information such as coding agent, cost, models, providers, and cache usage.
Sessions can be filtered by turns, client, model, provider, authentication, or cost.: Sessions can be filtered by turns, client, model, provider, authentication, or cost.

Topics

Technology

AI Analysis

Tone

Neutral

In short

Key Points

The AI Gateway now features a Sessions view that groups requests into sessions.: The AI Gateway now features a Sessions view that groups requests into sessions.
This view displays detailed information such as coding agent, cost, models, providers, an…: This view displays detailed information such as coding agent, cost, models, providers, and cache usage.
Sessions can be filtered by turns, client, model, provider, authentication, or cost.: Sessions can be filtered by turns, client, model, provider, authentication, or cost.

Topics

Technology

'Efficacy of curbs not proved': SC against blanket internet ban on kids over safety
The Supreme Court has ruled that the right to access and use the internet is a fundamental right under Article 21 of the Constitution. However, the court emphasized that blanket restrictions on children's access to the internet are ineffective and disproportionate, and that some age-based restrictions and safeguards should exist to ensure the safety of children online. The court has ruled that the efficacy of curbs is not proved.
2 min read
Meta removes language that raised scraping and AI training concerns
Meta recently clarified its commercial terms of use, removing language that could have given the company the ability to scrape and train AI models from any publisher with a Meta business account. This update was met with concerns from legal experts who argued it could allow Meta to scrape any publisher's website and use the content for AI training. However, Meta spokespersons have since stated that the updated terms do not reflect a change in the company's web crawling methods, and the provision has been removed.
1 min read
'War booty': Cheap iPhone 18s advertised in Tehran after Hormuz shipwreck
The "war booty" iPhones advertised in Tehran are being sold at discounted prices, sparking concerns over potential scams and the impact of maritime tensions in the region. The advertisements have emerged after a reported shipwreck near the Hormuz Strait, with videos showing containers containing iPhones and perfumes floating in the sea. Cyber police advise buyers to avoid paying deposits or advance fees before inspecting the products and verifying sellers' identities.
1 min read

AI Gateway logs now show session affinity

In short

Key points

More in Technology