Artificial Intelligence2 min read

Voice AI in vogue: Nvidia releases new open transcription model

By · Via TechCrunch · Published by Everything Blog

In short

Nvidia has launched Nemotron 3.5 Transcribe, a 30-billion-parameter open-weight model that handles multilingual translation, speaker identification, and audio recordings up to one hour long. Alongside the model, the company debuted version 2 of its Granary open-source speech dataset to help developers adapt tools to specific professional jargon. Although the software cannot yet process live audio streams, it is flexible enough to operate across varied hardware from robotics chips to data center processors.

Key points

  • Developers can combine the transcription model with the Granary dataset to train tools fo…: Developers can combine the transcription model with the Granary dataset to train tools for specialized industry jargon.
  • Current technical limitations restrict the artificial intelligence model strictly to pre-…: Current technical limitations restrict the artificial intelligence model strictly to pre-recorded files rather than live audio streams.
  • The release expands Nvidia's speech portfolio alongside its 1.1-billion-parameter Parakee…: The release expands Nvidia's speech portfolio alongside its 1.1-billion-parameter Parakeet model amid growing industry competition in voice tech.

Sources checked by our analysis pipeline: 1

Nvidia on Wednesday released Nemotron 3.5 Transcribe, a free, open-weight model that transcribes audio in up to 40 languages. It also released version 2 of Granary, its open-source speech dataset.

Nvidia boasts that Nemotron 3.5 can translate 31 languages to and from English, handle recordings up to an hour long, and tell up to eight speakers apart. It claims to beat rivals on benchmarks, including Hugging Face’s Open ASR Leaderboard.

These tools target developers building apps for business meetings and medical transcription, two of AI’s most established footholds in the workplace. Nvidia says developers can use the model, the updated Granary dataset, and tools like its NeMo Speech model to customize apps to recognize an industry’s jargon in each language. One drawback: Transcribe works with recorded audio, not live streams.

Still, the company promises Transcribe, at 30 billion parameters, can run on a single chip, from the Jetson AGX Thor robotics controller and DGX Spark chip powering new laptops, to Blackwell datacenter chips. It joins Nvidia’s open-weight voice models, including the super small yet powerful Parakeet (1.1 billion parameters).

Nvidia’s latest voice entry comes during busy period of AI voice releases: Mistral shipped Voxtral 3 earlier this month; ElevenLabs launched Realtime for instant speech in voice agents; and Salesforce released Launa-Omni, its voice model.

Original source: techcrunch.com

Artificial Intelligence