NVIDIA Launches Open-Weight Model for Multilingual Transcription and Speaker Labels
NVIDIA Launches Open-Weight Model for Multilingual Transcription and Speaker Labels
Open Source AI

NVIDIA Launches Open-Weight Model for Multilingual Transcription and Speaker Labels

Hugging FaceOct 29, 2026

NVIDIA released an open-weight speech model for transcription, translation and speaker attribution, alongside Granary v2 data resources and fine-tuning recipes.

NVIDIA announced Nemotron 3.5 Transcribe on October 28, 2026, as an open-weight model for working with recorded speech. A single checkpoint supports transcription in 40 languages, translation to or from English in 31, speaker attribution in 13, and audio question answering. It can handle recordings up to an hour long and label as many as eight speakers. Developers can steer output with natural-language instructions, including requests for speaker labels or translation.

NVIDIA says the model is available through Hugging Face and ModelScope. The company reports that it ranks first among open-weight systems on several speech evaluations: its cited Hugging Face Open ASR results include 5.33% average word error rate (WER) for English, 4.62% across seven languages, and 10.98% on long-form audio. On Artificial Analysis’s speech-to-text measure, it ties for first among open-weight models at 2.8% AA-WER. These figures come from different tests and should not be treated as directly comparable.

The model combines a speech encoder with a hybrid Mamba–Transformer mixture-of-experts language model. Of its 30 billion total parameters, about 4 billion are active per token, according to NVIDIA. The company also reports a benchmark in which a forthcoming quantized version processed 100 hours of audio in under three minutes on one RTX PRO 6000 Blackwell Server Edition GPU; the test used 30-second clips at high concurrency. The available checkpoint can be served with vLLM, while local deployment through NeMo-Speech.cpp and quantized versions are described as forthcoming.

The release also includes Granary v2, a multilingual data collection and reusable curation pipeline, plus NeMo Speech fine-tuning resources. In a medical transcription case study, fine-tuning reduced WER on held-out speakers from 22.44% to 12.17%, a reported 45.8% relative reduction. On general English, however, WER rose slightly from 1.54% to 1.69%, underscoring that domain adaptation can involve trade-offs.

Industry Impact

More capabilities for speech workflows

Speech transcription, healthcare, software development

Overview

Nemotron 3.5 Transcribe gives developers an open-weight option for multilingual transcription, translation, speaker attribution and audio question answering. Its support for recordings up to an hour and eight speakers could suit meeting, media and customer-service workflows. The medical transcription case study indicates that fine-tuning can improve performance in a specialized domain, though general English WER rose slightly. Developers and product managers should assess results on their own audio and deployment requirements; NVIDIA’s reported benchmark scores come from different tests and are not directly comparable.

Key Impact Points

One checkpoint combines transcription, English translation, speaker labeling and audio question answering across multiple languages.

Open-weight access and fine-tuning resources give development teams options to adapt the model for domain-specific audio.

The medical case study shows a substantial WER reduction after fine-tuning, alongside a small regression on general English.

Opportunities

Build and adapt speech transcription workflows

Healthcare, media, customer service, software development

Organizations handling recorded audio can evaluate the model for multilingual transcription, translation, speaker attribution or audio question answering. Healthcare teams and vendors could test fine-tuning for medical transcription, while developers could build tools that organize long recordings by speaker or language. Granary v2 and NeMo Speech fine-tuning resources offer additional starting points for data curation and adaptation. These are opportunities to explore, not evidence of production outcomes: the medical case study also shows that domain gains can come with a general-English trade-off. Teams should validate accuracy, privacy, latency and serving costs on representative recordings before committing to a deployment.

  • Domain-adapted transcription services

    Problem: General-purpose transcription may not meet the accuracy needs of specialized audio, and long or multilingual recordings can require additional processing.

    Solution: Evaluate Nemotron 3.5 Transcribe and its fine-tuning resources on representative domain recordings, using speaker attribution or translation where relevant.

    Target Users: Healthcare transcription teams, speech software developers and organizations processing recorded conversations.

    Business Value: Better fit for domain terminology and workflows could reduce correction effort; NVIDIA’s medical case study reports a 45.8% relative WER reduction on held-out speakers after fine-tuning, with a slight general-English regression.

    Revenue Potential: Potential models include transcription services or workflow software, but the article provides no pricing or evidence of commercial adoption.

Reference link

https://huggingface.co/blog/nvidia/nemotron-transcribe-granary

Image Source Link

https://developer-blogs.nvidia.com/wp-content/uploads/2026/09/image3-18.webp

Community Discussion (0)

Loading discussions...