Artificial Intelligence1 min read

Cyberattacks threaten to make open-source AI a little less open, Hugging Face exec warns

By · Via TechCrunch · Published by Everything Blog

In short

Recent security breaches across the sector have compromised third-party credentials, exposed proprietary model weights, and accessed sensitive customer billing records. In response, platforms are weighing stricter contributor vetting against the foundational ethos of universal access. Rather than closing off public participation, Hugging Face is deploying enhanced monitoring and rotating administrative access tokens more frequently to neutralize threats. Meanwhile, broader software hubs like GitHub are shortening token lifespans to combat malicious code injection across critical package registries.

Key points

  • Heightened platform security measures threaten to exclude independent researchers who lac…: Heightened platform security measures threaten to exclude independent researchers who lack formal institutional affiliations.
  • Hugging Face is actively bolstering network controls and rotating administrative tokens t…: Hugging Face is actively bolstering network controls and rotating administrative tokens to avoid restricting open user access.
  • GitHub supply chain security engineer Zach Steindler stressed that platforms should fix u…: GitHub supply chain security engineer Zach Steindler stressed that platforms should fix underlying vulnerabilities instead of merely restricting functionality.

Sources checked by our analysis pipeline: 1

The very qualities that make open AI platforms valuable, like open doors and rich data, might also make them vulnerable to more hacks, Irene Solaiman, chief policy officer and SVP of strategy at Hugging Face said on a recent episode of the Equity podcast.

The October attack on OpenCode, which targeted users’ third-party API keys and caused financial damage, is the latest example. It follows an incident this summer in which an OpenAI agent swarm breached Hugging Face in an apparent attempt to cover its tracks after accessing answers to cybersecurity evaluations.

The risks aren’t limited to platforms that invite open community contributions. On Monday, AI infrastructure startup Fireworks, which helps developers run and train open AI models, disclosed that attackers had accessed some customers’ model weights, datasets, and billing information. The company temporarily disabled certain self-service dataset functions as it investigates. While the attack isn’t necessarily due to Fireworks’ openness, it highlights how much valuable information is concentrated within AI infrastructure providers.

“The things I worry about making an open community targeted are also what makes it special,” Solaiman…

Artificial Intelligence