Artificial Intelligence1 min read

When tech workers have to quit their jobs to raise the alarm, it’s time to worry | Isabelle Ferreras

By · Via The Guardian Business · Published by Everything Blog

In short

Recent high-profile exits from leading labs like OpenAI and Anthropic demonstrate that workers must sacrifice their careers to warn the public about dangerous industry practices. Meanwhile, regulatory initiatives like the EU digital omnibus are actively delaying safety requirements for high-risk systems under pressure from corporate lobbying. To counter this, reformers argue that governance must be overhauled by eliminating silencing non-disclosure agreements, establishing whistleblower protections, and providing workers with co-decision rights over internal tools.

Key points

  • Autocratic corporate governance in frontier tech firms forces internal experts to quit be…: Autocratic corporate governance in frontier tech firms forces internal experts to quit before they can raise valid alarms.
  • Tech policy must shift from framing safety and innovation as opposites toward democratizi…: Tech policy must shift from framing safety and innovation as opposites toward democratizing corporate decision-making structures.
  • Workers require formal co-decision rights and collective bargaining to challenge algorith…: Workers require formal co-decision rights and collective bargaining to challenge algorithmic management and intrusive workplace monitoring tools.

Sources checked by our analysis pipeline: 1

Over the past two years, a troubling pattern has emerged across the world’s leading AI laboratories. Time and again, a safety researcher or engineer walks out of the door with a public warning that commercial pressures are overriding safety guardrails. Last month, the person who oversaw safety reports for OpenAI’s product releases said he was quitting the ChatGPT creator because the company’s culture was “broken” and the entire AI industry was too careless in developing the technology. The previous month it was a researcher at OpenAI’s rival Anthropic who quit, warning that he believed AI “could kill us all by the end of the decade”.

As a society we applaud the courage of these individuals and debate their warnings for a news cycle – and then we move on. But we miss the deeper institutional failure those resignations reveal: as the great political scientist Albert Hirschman made clear, exit is not voice.

When the only way for a conscientious engineer to raise the alarm is to leave, it is a clear sign that corporate governance in the industry is broken.…

Artificial Intelligence