Dubbing

Translate audio and video files with ElevenLabs dubbing.

Overview

Dubbing allows you to translate content across 90+ languages in seconds with voice translation, speaker detection, and audio dubbing.

Automatic dubbing or video translation is a process for translating and replacing the original audio of a video with a new language, while preserving the unique characteristics of the original speakers’ voices.

The Dubbing v2 API is not yet live but is expected to launch in the coming weeks.

Dubbing new project

Guide

1Go to Dubbing in your navigation menu.
2

Upload your video or audio file, or select the Paste URL tab to dub a video from YouTube, TikTok, etc.

3Choose the language, or languages, you want to dub into.
4

Click the Advanced settings to adjust speaker similarity. This setting controls how closely your dubbed voice mimics the original speaker.

5

Click the generate button to submit your dub. You will be shown the cost and asked to confirm your request.

6Once your dub is ready, you’ll be able to download it from your list of dubs.

Dubbing new project advanced
settings

Cloning strength

Cloning strength is the configurable setting in Automatic Dubbing on the Alpha model. The default value of 7 works well for most content.

  • This is the advanced Dubbing version, which you can access by checking the Create a Dubbing Studio project box. Read more about it in the Dubbing Studio guide.

FAQ

ElevenLabs was founded on the idea of creating amazing dubbing; a tool that would allow you to create a perfect dub in any language you desire, using the original voice of the actors and preserving the original performance, making all content more accessible.

To get started, go to Dubbing and upload your audio or video file, or paste a URL to dub a video from YouTube, TikTok or elsewhere online .

Select the language or languages you want to dub into in the Choose languages selector. You’ll be charged for each language you select here. 

By default, you’ll use our latest Dubbing model, v2. Dubs created using the v2 model are completely automatic without any option to edit the content.

When using Dubbing v2 via the website, there’s a 2 GB and 180 minutes limit for the uploaded file, and you need to stay below both. The Dubbing v2 API is not yet live but is expected to launch in the coming weeks.

If you want a more in-depth explanation and guide on what Dubbing is and how to use it, we highly recommend reading the full documentation here.

If you want to create a Dubbing Studio project, so you can edit your dubs, you can also choose Use legacy v1 dubbing model in the Advanced options. This will allow you to create a Dubbing Studio project by checking the Create Dubbing project option. 

Note: Dubbing Studio is in maintenance mode and receives critical bug fixes only.

Dubbing is available on all our plans, including the free plan. Dubs generated on free plans are automatically watermarked, with no option to remove this. Watermarking is not available on our paid subscriptions.

The cost for dubbing depends on the duration of your dub, and the number of languages you’re dubbing into. The total cost will be displayed before you confirm your request.

You can output in the following formats:

  • MP4 (Video)
  • AAC (Audio)
  • AAF (Timeline data)
  • SRT (Captions)
  • WAV (Audio - separate tracks for each speaker, downloaded as zip file)

You can upload audio and video files in the following formats for Dubbing:

  • AAC
  • AIFF
  • AVI
  • FLAC
  • M4A
  • M4V
  • MKV
  • MOV
  • MP3
  • MP4
  • MPEG
  • MPG
  • OGA
  • OGG
  • OPUS
  • WAV
  • WEBA
  • WEBM
  • WMV
  • 3GPP

At the moment, ElevenLabs does not offer lip syncing as part of Dubbing. Lip sync is available in Image & Video, Flows, and Studio via third party models.

By default, when you create a new dub, our latest Dubbing v2 model will be used. Dubs created using the v2 model are completely automatic without any option to edit the content.

If you want to use Dubbing Studio, you can do this by selecting Use legacy v1 Dubbing model in the Advanced options when you create your dub, then check the Create Dubbing project option. 

It’s not possible to convert an existing automatic dub to a Dubbing project.

The new dubbing project will appear at the top of your list of dubbing projects, and will go through various stages while generating.

Once it has completed processing, click the three dots icon and select Edit to open your dubbing project.

For more information about Dubbing Studio, please see our overview.

If you downgrade your tier or cancel your subscription altogether, you will not be able to use the paid features anymore, such as Projects, Dubbing Studio, and Cloned Voices. However, at the time of writing this, we do not delete any of your data, and it will still be there when you feel ready to upgrade again.

A track clone refers to a voice clone that is derived from the entire track in a dubbing project. This means that the voice clone will be made from a combination of all of the clips on that track. This is the default behavior and is good for creating voice clones that have a bit of the characteristics of all the clips combined and usually give the AI enough data to create a proper clone. However, if the voice changes quite drastically throughout, it might create a voice that is a bit more unstable.

On the other hand, a clip clone refers to a voice clone that is derived from a specific clip on a track. This allows you to create different voice clones from specific clips and assign that same voice to other clips where you want the tonality or performance. This can be great if you feel like a specific track has exactly the performance you want and want to apply this to other clips too, or perhaps, you want to apply this to the whole track.

One helpful tip mentioned in the content is to find a clip that you like, where you feel the voice is good, right-click to create a clone from that clip, and then assign that clone to the whole track to achieve a consistent voice throughout. This is just one tip and may not work for all circumstances, but it can work very well in some cases.

Try using a different browser and turning off ad-blockers and pop-up blockers.

Under certain circumstances, some people might experience problems downloading conversions done in Studio (previously Projects) and videos or audio dubbed using the dubbing feature. The common denominator for this seems to be the browser where most people are using a browser called Brave, which is causing issues for them. However, we’ve also heard certain users experience issues with other browsers. In most cases, the issue seems to be resolved when they switch or test a different browser to download the files. We also recommend turning off any ad-blocker or pop-up blocker.

By default, when you create a new dub, our latest Dubbing v2 model will be used. Dubs created using the v2 model are completely automatic without any option to edit the content.

The edit button is only available when using Dubbing Studio, which is only available for our legacy v1 Dubbing model. To use Dubbing Studio, you will need to select Use legacy v1 Dubbing model in the Advanced options when you create your dub, then check the Create Dubbing project option. 

Note: Dubbing Studio is in maintenance mode and receives critical bug fixes only.

No results