Inworld Open-Sources Voice Isolator: A Model That Cleans Speech of Noise in Real Time
Interview recordings, calls from a café, or a voice agent on a noisy street: other voices, music, and echo get in the way everywhere. Inworld has released Voice Isolator as open source, a model that splits audio into two tracks: clean speech and everything else. It runs in real time at 48 kHz and keeps even the speaker's breathing, and it was trained on 10,000 hours of speech. For voice products, this is a ready-made preprocessing block worth testing on your own recordings.
AI-processed from TG: @notboring_tech (Not Boring Tech); edited by Hamidun News
Anyone who has built a voice product knows this problem: in the lab everything works perfectly, but in real life the user speaks from a café, a car, or an office where people behind them are discussing their own business. Speech recognition starts mixing up words, speech synthesis and voice cloning get a dirty sample, and podcasts or interviews have to be cleaned by hand for a long time. Now developers have another open tool for this task: Inworld has released Voice Isolator as open source.
What the model does
The idea is simple: an ordinary recording goes in, and two tracks come out. The first contains only the speaker's voice. The second contains everything else: music, noise, echo, and background voices. This approach is convenient because you don't need to know in advance which specific noise is interfering. Background conversations, a playlist in the café, and the hum of an air conditioner all end up in the same "everything else" track.
According to the authors, the model preserves not only the words but also the character of the original recording, including breathing. This is an important detail. Many noise reducers noticeably "sterilize" speech: they remove inhalations and pauses, and the voice sounds like it's coming from a can. For voiceovers, podcasts, and voice assistants, natural breathing makes the sound more lifelike.
The model works in real time at a 48 kHz sampling rate. This is studio-quality audio, sufficient for music and professional speech. Standard telephony uses 8–16 kHz. Real-time processing means the model can be placed into a live call or stream, not just run over finished files. It was trained on 10,000 hours of speech.
Where this will be useful in practice
The first obvious scenario is voice agents. If a bot takes calls or communicates through a microphone in a noisy environment, a clean input track usually improves speech recognition. The less foreign speech the system hears, the less often it mistakes a neighbor's remark for a user's command.
The second scenario is data preparation. Those who collect voice samples for synthesis or cloning need clean recordings. Previously, the choice was between paid cloud services and complex pipelines. An open model lets you process an archive on your own infrastructure without sending recordings to third parties. This is especially useful when the recordings contain other people's personal data.
The third is content work: interviews, videos, streams, and podcasts. Separating voice from music or noise has become easier, and there's no need to buy a separate service for a single operation.
What is still unknown
The original announcement contains no comparative measurements. We don't know how much better or worse the model is than other open and commercial solutions, how it behaves under heavy noise, with overlapping speech from two people, or with accents. Hardware requirements are not specified, nor is latency on ordinary CPUs and GPUs, nor the license terms. For production use, these parameters are critical.
The claim that it "works in real time" should also be verified on your own hardware. The model may keep up with real time on a powerful GPU and fall behind on a weak laptop or a mobile device.
What a developer should do
A practical plan: take the inworld-ai/voice-isolator repository from GitHub, read the license, and run 20–30 of your own real recordings: from the street, from a car, from an open-plan office. Then compare speech recognition results with and without cleaning. If word errors drop noticeably and the voice doesn't sound artificial, the model can be integrated as a first processing step. If not, you'll spend a couple of hours on testing and learn that before integration.
The release itself shows that open audio tools are quickly catching up with paid cloud APIs. For teams building voice products, this is another reason to keep audio preprocessing in-house.
- Nov 22, 2026Agents Write Working Code in 95% of Tasks, But Leave a Vulnerability in Most of Them
- Nov 22, 2026LangChain, a Side Project Turned $3 Billion Startup in Four Years, Raises $300 Million
- Nov 22, 2026Cursor May Drop the Chinese Models Behind Composer 2
- Nov 22, 2026Signal Restricts Screenshots on Android and iOS: OS-Level AI Agents Can Read Chat Screens
Key Questions Answered
What the model does?
The idea is simple: an ordinary recording goes in, and two tracks come out. The first contains only the speaker's voice. The second contains everything else: music, noise, echo, and background voices. This approach is convenient because you don't need to know in advance which specific noise is interfering. Background conversations, a playlist in the café, and the hum of an air conditioner all end up in the same "everything else" track.
Where this will be useful in practice?
The first obvious scenario is voice agents. If a bot takes calls or communicates through a microphone in a noisy environment, a clean input track usually improves speech recognition. The less foreign speech the system hears, the less often it mistakes a neighbor's remark for a user's command. The second scenario is data preparation. Those who collect voice samples for synthesis or cloning need clean recordings. Previously, the choice was between paid cloud services and complex pipelines.
What is still unknown?
The original announcement contains no comparative measurements. We don't know how much better or worse the model is than other open and commercial solutions, how it behaves under heavy noise, with overlapping speech from two people, or with accents. Hardware requirements are not specified, nor is latency on ordinary CPUs and GPUs, nor the license terms. For production use, these parameters are critical. The claim that it "works in real time" should also be verified on your own hardware.
Test Frontier LLMs & Autonomous Agents in One Workspace
Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.
The AI world, distilled — once a week
Seven stories that actually mattered, hand-picked. No noise, no reposts, no press releases.
Done! Check your inbox for a confirmation.