Artificial Intelligence1 min read

Thinking Machines Lab debuts Inkling 2 Small, a MoE model with 594B total and 17B active parameters, and plans to release weights next week after safety testing (Thinking Machines Lab)

By · Published by Everything Blog

In short

The architecture features 594 billion total parameters, but it relies on only 17 billion active parameters during runtime. Thinking Machines Lab is currently conducting safety testing on the system. Once these evaluations are finalized, the organization intends to publicly distribute the model weights next week.

Key points

  • Inkling 2 Small utilizes a sparse architecture that activates only 17 billion of its 594…: Inkling 2 Small utilizes a sparse architecture that activates only 17 billion of its 594 billion parameters.
  • Public availability of the model weights is slated to occur sometime next week.: Public availability of the model weights is slated to occur sometime next week.
  • Final safety testing must be fully completed before the organization releases the weights.: Final safety testing must be fully completed before the organization releases the weights.

Sources checked by our analysis pipeline: 1

Dina Bass / Bloomberg: |

Wall Street Journal: |

Emma Roth / The Verge: |

Djohnson / CyberScoop: |

Davey Alba / Bloomberg: |

Andrew E. Freedman / Tom's Hardware: |

Jaron Schneider / PetaPixel: |

Radhika Rajkumar / ZDNET: |

Tiffany Li / The Information: |

@metr_evals: |

Tom Warren / The Verge: |

Tom Warren / The Verge: |

Meghan Bobrowsky / Wall Street Journal: |

Natalia Kniazhevich / Bloomberg: |

Jay Peters / The Verge: |

Takashi Mochizuki / Bloomberg: |

Andrew Webster / The Verge: |

Brody Ford / Bloomberg: |

New York Times: |

Takashi Mochizuki / Bloomberg: |

New York Times: |

Kevin Breuninger / CNBC: |

Isabelle Bousquette / Wall Street Journal: |

Kelly Cloonan / Wall Street Journal: |

Reuters: |

Ben Schoon / 9to5Google: |

Los Angeles Times: |

Ivan Mehta / TechCrunch: |

Thinking Machines Lab: |

Wall Street Journal: |

Rocket Drew / The Information: |

Reuters: |

Elias Schisgall / Wall Street Journal: |

This is a Techmeme archive page. It shows how the site appeared at 7:15…

Artificial Intelligence