Artificial Intelligence1 min read

Apple Watch’s AI features for rewinding and recapping conversations begin beta testing

By · Via TechCrunch · Published by Everything Blog

In short

The new Apple Watch Series 12 software introduces four opt-in audio capabilities, including sound recognition, Shazam song identification, and two speech-tracking tools called Live Rewind and Siri Recaps. Live Rewind allows wearers to double-press the digital crown to read text from the prior 15 seconds, alerting nearby people with a chime and screen animation. Meanwhile, Siri Recaps generates structured summaries highlighting critical dates, prices, and deadlines without creating verbatim transcripts or saving raw voice data. Furthermore, the recapping feature automatically pauses whenever users listen to headphone music or turn on noise cancellation.

Key points

  • The four Audio Intelligence tools operate strictly on an opt-in basis for Apple Watch wea…: The four Audio Intelligence tools operate strictly on an opt-in basis for Apple Watch wearers.
  • Siri Recaps captures structured details like pricing and dates without saving raw audio o…: Siri Recaps captures structured details like pricing and dates without saving raw audio or producing full transcripts.
  • Unreviewed conversation summaries permanently delete from the device after seven days unl…: Unreviewed conversation summaries permanently delete from the device after seven days unless exported to Notes or Journal.

Sources checked by our analysis pipeline: 1

Apple’s AI-powered “Audio Intelligence” technology for the Apple Watch is now rolling out into beta testing, initially for developers in the iOS 27.3 update, after first being announced at the company’s Surprise and Shine hardware event in September. The technology includes a set of four opt-in AI features that allow Apple Watch Series 12 wearers to detect important sounds, identify songs, catch up on conversations, and take notes.

The sound recognition feature will help deaf and hard-of-hearing users identify important sounds like sirens, alarms, or doorbells from their watch, while the song recognition feature taps into Apple’s Shazam app to detect music playing in the background and identify the song name and artist.

However, the more potentially controversial features are those that listen to human conversations: Live Rewind and Siri Recaps.

Given the backlash to AI recording devices, like Meta’s AI glasses and other AI wearables, Apple has attempted to carve out a space where the features can be useful to Apple Watch owners, while still respecting the privacy of those around them.

With Live Rewind, the idea is to…

Artificial Intelligence