Artificial Intelligence1 min read

METR updates its time horizon plot to add judgment-heavy tasks, finding some AI capabilities still grow exponentially but models lag at designing AI evaluations (Grace Huckins/MIT Technology Review)

By · Published by Everything Blog

In short

The updated framework tracks and benchmarks artificial intelligence performance across increasingly complex metrics. Researchers expanded their analysis by incorporating tasks that require substantial human-like judgment into the time horizon plot. While the data confirms that certain capabilities maintain an exponential rate of expansion, the models continue to lag specifically in designing AI evaluations. This dual-track progression outlines the precise frontiers where automated capabilities remain notably constrained.

Key points

  • Complex tracking efforts show that artificial intelligence performance is progressing une…: Complex tracking efforts show that artificial intelligence performance is progressing unevenly across metrics.
  • Systems that excel at exponential tasks still struggle to perform human-like judgment eva…: Systems that excel at exponential tasks still struggle to perform human-like judgment evaluations.
  • Benchmark analyses help identify critical boundaries where automated machine capabilities…: Benchmark analyses help identify critical boundaries where automated machine capabilities remain constrained.

Sources checked by our analysis pipeline: 1

New York Times: |

Ashley Capoot / CNBC: |

Joseph Howlett / Scientific American: |

Katie Paul / Reuters: |

William Sandlund / Financial Times: |

Ben Schoon / 9to5Google: |

CNBC: |

Courtney Rozen / Reuters: |

Axios: |

Bloomberg: |

Katie Nicora / CBS News: |

Barry Schwartz / Search Engine Roundtable: |

Harper Harwell / Birmingham Business Journal: |

Yoolim Lee / Bloomberg: |

Olivia Carville / Bloomberg: |

Maria Deutscher / SiliconANGLE: |

Bloomberg: |

Tim Genewein / DeepMind Institute: |

Bloomberg: |

Grace Huckins / MIT Technology Review: |

Julianna Bragg / Axios: |

New York Times: |

Wall Street Journal: |

This is a Techmeme archive page. It shows how the site appeared at 2:05 PM ET, November 20, 2026.

The most current version of the site as always is available at our home page. To view an earlier snapshot click here and then modify the date indicated.

Kirsten Korosec / TechCrunch: |

Krystal Hu / Reuters: |

Mark Gurman / Bloomberg: |

Jordan Novet / CNBC: |

Eric Geller / Cybersecurity Dive: |

Artificial Intelligence