Technology1 min read

Apple’s latest watchOS beta includes its new always-on Audio Intelligence features

By · Via The Verge · Published by Everything Blog

In short

The test build introduces Live Rewind, an interaction that surfaces a text transcript of the prior 15 seconds of speech when a user double-presses the Digital Crown. Alongside this, Siri Recap listens in the background to automatically assemble titled key points once an in-person conversation concludes. To secure this persistent audio stream, processing occurs strictly on dedicated hardware separate from the operating system and installed apps. Saved notes and transcripts are shielded using end-to-end encryption across iCloud accounts with two-factor authentication enabled.

Key points

  • Wearers can question Siri about recently transcribed speech snippets or store them for fu…: Wearers can question Siri about recently transcribed speech snippets or store them for future reference.
  • Operating system components, third-party applications, and Apple cannot directly access t…: Operating system components, third-party applications, and Apple cannot directly access the raw audio data captured by the watch microphone.
  • Syncing saved summaries across multiple devices requires an active device passcode alongs…: Syncing saved summaries across multiple devices requires an active device passcode alongside two-factor iCloud authentication for end-to-end encryption.

Sources checked by our analysis pipeline: 1

Starting today, Siri can tune into the Apple Watch’s mic with Audio Intelligence features that are available in the new watchOS 27.3 developer beta rolling out now. The two new additions are Siri Recap, which uses “ambient listening” to generate summaries of your conversation, and Live Rewind, which generates text transcripts of the last 15 seconds of audio your watch’s mic detected.

Apple’s latest watchOS beta includes its new always-on Audio Intelligence features

Audio Intelligence lets Siri ‘rewind’ and summarize audio from your Watch’s mic.

Audio Intelligence lets Siri ‘rewind’ and summarize audio from your Watch’s mic.

- Live Rewind, which can help users recall what was just said in conversation. A double-press of the Digital Crown shows the previous 15 seconds of a conversation as a text snippet, so the user can catch something they may have missed or are less familiar with. Users can ask Siri about the content of the text or save it to the Siri app to revisit later.

- Siri Recap, which can create high-level summaries of conversations that users can review later to…

Technology