ElevenLabs debuts AI Voice Isolator to remove unwanted noises from recordings

AI startup – ElevenLabs has added a new AI tool known as AI Voice Isolator to its portfolio, which allows users to filter out background noise from recordings. The tool addresses one of the main challenges creators face when recording where unwanted sounds may interfere with content.

Also read: HarperCollins and ElevenLabs Enhance Global Audiobook Accessibility with AI

The company made the new tool available on its platform starting Thursday. This comes days after ElevenLabs launched another product known as Reader app, which is a free-to-use tool, although with some restrictions.

Voice Isolator brings relief to early-stage creators

The tool filters out unwanted noises from content, be it for film, interview, or podcasts, bringing relief to creators. Creators often encounter unwanted noises like sounds of vehicles nearby, people chatting, and blowing wind.

To address this challenge, creators use mics with “ambient noise cancellation,” although these are not easily accessible to everyone.

“We just launched our voice isolator,” said ElevenLabs’ head of design Ammaar Reshi in a post on the X platform. Reshi further described the tool as:

“The best way to remove any background noise and extract crystal clear dialog from your content.”

Reshi also shared a video on the same post demonstrating how the AI Voice Isolator is used to remove background noises of a leaf blower and get “crystal clear speech of the speaker.”

According to VentureBeat who put the tool to test in three instances with random noises, the tool removed noises including banging on tables, opening or closing doors, and clapping.

We just launched our Voice Isolator! ????

The best way to remove any background noise and extract crystal clear dialog from your content

There was a method to our madness yesterdaypic.twitter.com/FBExEXHIsn https://t.co/AtMuwUb4AL

— Ammaar Reshi (@ammaar) July 3, 2024

ElevenLabs acknowledges gaps with the tool

According to Sam Sklar, who handles growth at the company, the Voice Isolator currently does not work on music vocals. But, users can still try it, and there are chances of achieving “success with some songs.”

The VentureBeat tests also showed that the tool does not recognize or remove some sounds like banging on the wall and snapping fingers.

Also read: ElevenLabs’ Sound Revolution: How AI is Reshaping the World of Audio Content!

While the model is free on the ElevenLabs platform, users who wish to remove background noises from larger files may have to opt for the paid plans. These start from $5 a month.

“We have a free plan on our site that comes with 10k characters/month, so it’s possible to use with 10 minutes of audio per month for free,” said Sklar.

The company has also indicated that there is room for improvement with the tool.

Cryptopolitan reporting by Enacy Mapakame