Artificial Intelligence1 min read

I let Apple’s always-listening AI summarize my life for two weeks

By · Via The Verge · Published by Everything Blog

In short

Apple is trialing an opt-in ambient listening feature called Siri Recap, which runs exclusively on the Apple Watch Ultra 4 and its S11 chip. The system attempts to resolve surveillance worries by discarding raw audio via Private Cloud Compute and automatically erasing unsaved summaries within seven days. Despite these strong safeguards, the watch provides no physical light or chime to alert surrounding people that recording is active. Consequently, the lack of voice training causes the software to confuse ambient media with real-life events.

Key points

  • Bystanders receive no warning when the device records because the watch lacks an external…: Bystanders receive no warning when the device records because the watch lacks an external indicator light or chime.
  • Refusing to train the model on user voices protects privacy but severely impairs the accu…: Refusing to train the model on user voices protects privacy but severely impairs the accuracy of generated summaries.
  • Background audio from sources like TikTok and Reddit can be mistakenly recorded as the us…: Background audio from sources like TikTok and Reddit can be mistakenly recorded as the user's real-life experiences.

Sources checked by our analysis pipeline: 1

Was it worth it?

I let Apple’s always-listening AI summarize my life for two weeks

Apple’s Siri Recaps make a lot of tradeoffs to protect privacy. But I’m not convinced the benefits outweigh the costs.

I let Apple’s always-listening AI summarize my life for two weeks

Apple’s Siri Recaps make a lot of tradeoffs to protect privacy. But I’m not convinced the benefits outweigh the costs.

I’ve been asking myself this quite a bit over the last month or so while testing both the Amazon Bee Frontier and Siri Recap on the Apple Watch Ultra 4. Both enable a wearable to ambiently listen to your conversations and, using AI, summarize them for you. Why? So you can remember better and, hopefully, stay more present.

The main difference is that Amazon’s Bee takes a maximalist (and frankly reality-bending) approach, whereas Apple is going for a more minimalist, privacy-first take. Both, however, require explicit disclosures to the people around you about recording what they say, and potentially follow-up explanations about how exactly this all works. This past week, I’ve been testing the…

Artificial Intelligence