Artificial Intelligence1 min read

Building Software Got Faster. Building Trust Didn’t.

By · Published by Everything Blog

In short

The democratization of development has enabled employees across diverse occupations to produce software as effectively as trained engineers, leading many workers to abandon vetted commercial vendors. Yet the absence of rigorous code reviews and hardware testing has severely compromised application safety across industries. A recent evaluation of roughly 5,600 public AI-generated applications identified critical vulnerabilities in approximately one-third of the analyzed programs.

Key points

  • Widespread access to artificial intelligence code generators has displaced commercial ven…: Widespread access to artificial intelligence code generators has displaced commercial vendors in favor of unmonitored internal development.
  • Neglecting to review code, confirm its origin, or test it on hardware exposes corporate e…: Neglecting to review code, confirm its origin, or test it on hardware exposes corporate environments to extreme security hazards.
  • Unvetted modifications and custom code developed by small groups can actively pressure co…: Unvetted modifications and custom code developed by small groups can actively pressure commercial hardware manufacturers to modify business strategies.

Sources checked by our analysis pipeline: 1

Somewhere in your organization, someone has built or downloaded a piece of software you do not know about. It might be a browser extension, a small app that automates a report, or custom firmware on a device sitting on their desk. It was probably built with an AI tool, and nobody has checked the code, where its parts came from, or everything it does.

This is the age of software hyper-personalization. AI coding tools have made it easier than ever to change how software systems behave, reverse engineer software and device firmware, and build bespoke interfaces to meet unique wishes. It is both the tinkerer’s dream, and a software security nightmare.

Software personalization isn’t completely new. In 2005, I ran Linux as my laptop operating system at work. That involved a whole ecosystem of open-source software, including a window manager that I downloaded and compiled just to have something unique. I didn’t read all that code or do a deep analysis of the software supply chain. My trust was based on community sentiment and the relative rarity of visible security…

Artificial Intelligence