Artificial Intelligence1 min read

Pray for Chaos

By · Published by Everything Blog

In short

Centralized AI systems capable of securing all digital vulnerabilities threaten to permanently cement current power dynamics and marginalize humans. A chaotic trajectory introduces rampant bot activity, fabricated histories, and severe infrastructure failures that disable corporate networks and connected vehicles. However, this unstable environment forces society toward decentralized, custom operating systems, effectively preventing a single, unyielding power structure from taking hold.

Key points

  • Severe digital disruption prevents the establishment of unbreakable systems that threaten…: Severe digital disruption prevents the establishment of unbreakable systems that threaten human control.
  • Homogeneous infrastructures such as Linux will likely be replaced by individual, custom o…: Homogeneous infrastructures such as Linux will likely be replaced by individual, custom operating systems.
  • Widespread vulnerability serves as a counterweight against centralized systems that would…: Widespread vulnerability serves as a counterweight against centralized systems that would otherwise eliminate human economic value.

Sources checked by our analysis pipeline: 1

There’s two basic ways AI can play out, one is order, the other is chaos.

Order is the very dangerous one. If it turns out that models are actually capable of patching all the exploits, it’s hard to imagine what will disrupt the status quo. Fortunately, this seems unlikely, but that doesn’t mean order won’t prevail in the short term. At the end of my Yudkowsky debate we found a tangible point of disagreement. He thinks AI will be able to find a solution to the Prisoner’s dilemma. I know there already is a solution (it’s defect), EA people just aren’t happy about it.

If it won’t be order (and you better pray it won’t be order) that leaves chaos. AI that can play a whole society in hours can manufacture entire histories, years of archives of daily newspapers, and an Internet that never happened. The dead Internet theory is coming true before our eyes. Now I can still see the bots, soon I won’t be able to. Scratch that, I probably already often can’t.

Gwern wrote about this, it’s…

Artificial Intelligence