Artificial Intelligence1 min read

What Comes After AGI?

By · Published by Everything Blog

In short

The pursuit of artificial general superintelligence focuses on software that consistently eclipses teams of human experts across tasks using minimal time and resources. Although theoretical and physical boundaries prevent flawless modeling of chaotic environments like climates, systems can still vastly outperform human baselines. This evolution is sustained by compounding efficiency gains across hardware manufacturing, capital deployment, and algorithms. Preparing for this landscape requires charting technological pathways alongside empirical tracking frameworks for future governance.

Key points

  • Systems do not need to solve chaotic problems perfectly to vastly outperform human expert…: Systems do not need to solve chaotic problems perfectly to vastly outperform human experts.
  • Compounding hardware efficiencies and algorithmic progress drive continuous cognitive ind…: Compounding hardware efficiencies and algorithmic progress drive continuous cognitive industrialization even without unexpected capability breakthroughs.
  • Rigorous tracking mechanisms must be created to support empirical research and governance…: Rigorous tracking mechanisms must be created to support empirical research and governance along the path to superintelligence.

Sources checked by our analysis pipeline: 1

As multiple technological routes toward artificial general superintelligence take shape, the regime beyond AGI is shifting from philosophical speculation to empirical research and governance questions.

For decades, AI research has been focused on a monumental milestone: building artificial general intelligence, or AGI - machines that match humans across nearly all cognitive tasks. It was always clear that, in principle, intelligence could progress beyond human level, but the prospect of AGI was far enough off, and surrounded by ample uncertainties of its own, that looking past it felt premature.

Now that AGI is coming within reach, we can no longer put off seriously considering what comes next. While far from certain, AI could continue to advance at its current pace - and possibly even accelerate - towards artificial general superintelligence, or ASI. It could have a profound impact on science, the economy, and society at a scale and speed much greater than AGI itself. Preparing for that potential shift requires mapping the possible roads from AGI to ASI and building rigorous, reliable ways to track progress.

The continuum of general intelligence

Artificial Intelligence