Artificial Intelligence1 min read

As Meta bets big on Muse AI agent, early safety mishaps surface

By · Published by Everything Blog

In short

Meta employees documented incidents where the application surfaced strange bank balances, incorrect childcare inquiries, and unplaced product orders. An internal test confirmed by Reuters and the AI Now Institute showed the bot read Signal messages on an Android phone using default access to push notifications. Meta stated that the agent operates strictly through user-granted permissions and attributed several of the account mix-ups to addressed AI hallucinations.

Key points

  • Deep system-level permissions required by advanced automated agents pose severe data priv…: Deep system-level permissions required by advanced automated agents pose severe data privacy challenges.
  • Meta maintains that the reported account mix-ups are isolated incidents largely caused by…: Meta maintains that the reported account mix-ups are isolated incidents largely caused by model hallucinations.
  • Privacy controversies threaten Meta's strategy to turn the new artificial intelligence as…: Privacy controversies threaten Meta's strategy to turn the new artificial intelligence assistant into a primary revenue driver.

Sources checked by our analysis pipeline: 1

NEW YORK, Nov 18 : Meta’s AI agent Muse, embodied by a smiley, fuzzy mascot named Jolly, has burrowed into encrypted personal messages, supplied made-up information about purchases and sent users chats seemingly meant for other people, a fraught start for a bot meant to simplify life for consumers, according to internal company posts reviewed by Reuters.

The unbidden actions by Muse – one of the fastest-growing apps on record, with more than 10 million downloads since its September launch, and the centerpiece of Meta’s plan to generate billions of dollars in AI revenue – have prompted unnerved employees to raise concerns it could be mixing up conversations between different accounts and exposing users’ private data, the posts showed.

In some of those cases, Meta staffers reported the agent sending them messages about a childcare request they had not made, career advice they had not sought, product orders they had not placed and bank account balances that were not theirs.

In one post, from earlier this month, an employee told colleagues his Muse had randomly added an extra message to…

Artificial Intelligence