Artificial Intelligence1 min read

Learning the language of machine learning

By · Published by Everything Blog

In short

Jacob Andreas, a newly tenured associate professor at MIT, is pioneering methods to help artificial intelligence models articulate what they learn without relying on external diagnostic tools. His background spans an undergraduate thesis on statistical machine translation at Columbia University and doctoral research at the University of California, Berkeley. These academic experiences occurred as the field shifted from transparent statistical formulas toward opaque deep learning techniques. By developing systems that verbally clarify their own computations, his team aims to make AI training significantly more natural and efficient.

Key points

  • Training artificial intelligence to describe internal processes in human language improve…: Training artificial intelligence to describe internal processes in human language improves model transparency for high-stakes deployments.
  • Modern deep learning models present unique interpretability challenges because they repla…: Modern deep learning models present unique interpretability challenges because they replaced earlier, more transparent statistical formulas.
  • Teaching neural networks to directly communicate their learned concepts enables more effi…: Teaching neural networks to directly communicate their learned concepts enables more efficient and robust model development.

Sources checked by our analysis pipeline: 1

When deploying deep learning models in high-stakes scenarios, researchers would like to understand how they work. Today, this requires unraveling an enormously complex network of internal processing nodes to understand what the model knows and how it will likely behave in practice.

Jacob Andreas would rather have the models explain themselves.

The newly tenured associate professor develops techniques that enable artificial intelligence models to communicate accurately about what they learned from their training data, in language humans can understand.

“Rather than needing to use all these external tools to try and understand what is going on under the hood, maybe we can train models to talk about themselves in a way that is accurate,” says Andreas, an associate professor in the Department of Electrical Engineering and Computer Science (EECS) and a member of the Computer Science and Artificial Intelligence Laboratory (CSAIL).

By studying how machines come to understand language, Andreas and his group work toward building intelligent systems that can learn about the world from human guidance and communicate effectively with human collaborators. They develop methods to make the training…

Artificial Intelligence