Artificial Intelligence1 min read

I tried Apple’s Siri Recaps. They’re surprisingly useful — and a little unsettling

By · Via TechCrunch · Published by Everything Blog

In short

The test software includes Siri Recaps to summarize daily notes, Live Rewind to review the prior 15 seconds of speech, sound detection, and Shazam recognition. Apple processes audio on-device without retaining raw recordings or speaker identities, while automatically redacting items like account numbers and government IDs. However, real-world evaluations revealed that persistent recording logged extraneous personal remarks and merged unrelated topics into single files.

Key points

  • On-device processing and data redaction help mitigate privacy risks associated with conti…: On-device processing and data redaction help mitigate privacy risks associated with continuous transcription tools.
  • Real-world tests show Siri Recaps accurately logs functional logistics but struggles to k…: Real-world tests show Siri Recaps accurately logs functional logistics but struggles to keep unrelated topics in separate files.
  • Persistent ambient listening can capture unintended casual remarks, raising concerns rega…: Persistent ambient listening can capture unintended casual remarks, raising concerns regarding continuous monitoring in private spaces.

Sources checked by our analysis pipeline: 1

On Tuesday, Apple rolled out a potentially controversial set of Audio Intelligence features into testing with the first developer beta versions of iOS 27.3 and watchOS 27.3. The betas bring four new AI features that allow Apple Watch Series 12 wearers to detect important sounds, identify songs, catch up on conversations, and take notes.

After just a day with Apple’s Siri Recaps feature on my Apple Watch, I can already see how its value may ultimately outweigh any creepiness factor that comes from the AI-powered audio recording and summarization it provides. However, I also see areas where AI-assisted note-taking can go too far, capturing things that aren’t worth remembering, and where there’s room for improvement.

The first two, sound and song detection, don’t represent potential privacy concerns; they are designed to detect either important sounds — like an alarm or doorbell — or identify a song using Shazam’s technology. The former helps deaf and hard-of-hearing users navigate the world, and the latter is something we’ve already done with our iPhone for nearly two decades now.

It’s the two other features,…

Artificial Intelligence