Free Intensive Nov 21–22Free 2-day hands-on Vibecoding Intensive on Nov 21–22 at 16:00 MSK (Sat–Sun) · Live Cohort 3 starts Nov 23Join Free →Cohort 3 (Nov 23)
ReleaseInsight · On RadarElevenLabs Blog→ original

ElevenLabs Taught Ads Engine to Swap Hooks and Music in Video Ads and Dub Them

A successful video ad burns out over time, and a new version or a launch in another country usually means a reshoot. ElevenLabs has taught Ads Engine to change the hook (the first few seconds) and the music in a finished video, and to dub it into other languages with lip-sync. The tool pulls data from Google, Meta, LinkedIn and now TikTok ad accounts. That makes it possible to test versions and enter new markets without shooting again.

AI-processed from ElevenLabs Blog; edited by Hamidun News
ElevenLabs Taught Ads Engine to Swap Hooks and Music in Video Ads and Dub Them
Source: ElevenLabs Blog. Collage: Hamidun News.
Listen to article
Article Fact Sheet & Key Figures
ParameterDetails
Primary sourceElevenLabs Blog ↗
Editor-in-Chief
Key metric #1New hooks are written based on past winning ads, and the voiceover uses a clone of the narrator's voice
Key metric #2Dubbing v2 adapts phrasing to each language, while subtitles keep the brand's fonts
Key metric #3A native speaker can check the dub and the pronunciation of brand names before launch

Picture this: a brand has a video ad that performed really well. A couple of weeks later, the audience is used to it and returns start to drop. To freshen up the clip, you have to shoot a new opening.

To show it in another country, you need a dub and a re-edit. Because of this, many brands make fewer variants when a creative starts to fade, or they run the original everywhere without localization. ElevenLabs has updated Ads Engine, a service inside its ElevenCreative platform that builds and adapts ads to remove this dependence on reshoots.

It can now change the hook (the first seconds of a video, which determine whether someone watches to the end) and the music, dub videos into other languages using the Dubbing v2 model, translate subtitles, and work with the TikTok ad account.

How Ads Engine Gets Data and What It Does With It

The service connects to ad accounts on Google, Meta, LinkedIn, and now TikTok. It pulls in creatives that are already running, along with their performance stats, so the starting point is ads that have already worked. Based on them, the system creates new variants and localized versions: it translates text and subtitles, adapts images, and dubs the video.

The finished result can be sent back to the team for approval or pushed straight to the ad accounts. Live specialists can review the video before it goes out. In addition, Ads Engine monitors metrics and flags creatives that start to "burn out." The team has time to refresh them before returns fall.

Updating a Video Without Reshooting: Hooks and Music

Ads Engine finds the hook in the source video and writes new ones, drawing on what worked in the brand's previous ads. It then voices each variant with a digital copy of the original narrator's voice. According to ElevenLabs, the copy preserves tone, emotion, and speaking style. The lips of the person on screen are synced to the new line, and the subtitles are updated to match.

The second way to refresh a video is to change the soundtrack. For this, the service uses the ElevenLabs Music API, which composes original music by analyzing the tone, tempo, and emotion of the footage. Sound effects are placed on key moments, such as a "whoosh" on the closing card. According to the company, the music is cleared for broad commercial use. That removes a common question about track licensing.

The rest of the edit stays the same. The team can replace the original with the version they like or run several versions and compare them in an A/B test.

Localization: Dubbing and Subtitles

To enter new markets, Ads Engine uses Dubbing v2. According to the company's description, the model doesn't translate word for word. Instead, it picks phrasing suited to each language so the lines sound natural to native speakers. The original narrator's delivery (intonation, emotion, timing) is preserved. The lips are then synced to the new audio track, and the video looks as if it were recorded in that language from the start.

Subtitles are handled separately. The system removes the original text burned into the video and redraws it in the target language with the same timing and the brand's signature fonts. It's a small detail, but it's often the reason localized videos look homemade.

A native speaker, a localization specialist, can check the dub for accuracy and naturalness. They look at timing and at how brand and product names are pronounced. ElevenLabs describes this review as an option, which means the team itself will decide whether it's needed.

What This Means for Marketers and Product Managers

For now, this is an enterprise product: access goes through a form and a conversation with the sales team, and the announcement includes no public pricing and no self-serve sign-up. The article also contains no measurements such as conversion lift or budget savings: it describes capabilities, not test results. The quality of the voice clone, the lip-sync, and the adapted translation will have to be judged on your own videos, especially in languages with very different articulation.

The practical takeaway: if you have several strong videos and data on them, the flow of variants and localizations can be automated, letting you test hooks and music more often and enter new countries without a separate shoot. But for ads featuring a real person's face, it's worth agreeing on rights to the voice clone and likeness in advance. Keep human review at least for the first launches in each new country.

Story

Key Questions Answered

How Ads Engine Gets Data and What It Does With It?

The service connects to ad accounts on Google, Meta, LinkedIn, and now TikTok. It pulls in creatives that are already running, along with their performance stats, so the starting point is ads that have already worked. Based on them, the system creates new variants and localized versions: it translates text and subtitles, adapts images, and dubs the video. The finished result can be sent back to the team for approval or pushed straight to the ad accounts. Live specialists can review the video before it goes out.

What are the key details on Updating a Video Without Reshooting: Hooks and Music?

Ads Engine finds the hook in the source video and writes new ones, drawing on what worked in the brand's previous ads. It then voices each variant with a digital copy of the original narrator's voice. According to ElevenLabs, the copy preserves tone, emotion, and speaking style. The lips of the person on screen are synced to the new line, and the subtitles are updated to match. The second way to refresh a video is to change the soundtrack.

What are the key details on Localization: Dubbing and Subtitles?

To enter new markets, Ads Engine uses Dubbing v2. According to the company's description, the model doesn't translate word for word. Instead, it picks phrasing suited to each language so the lines sound natural to native speakers. The original narrator's delivery (intonation, emotion, timing) is preserved. The lips are then synced to the new audio track, and the video looks as if it were recorded in that language from the start. Subtitles are handled separately.

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Private AI Builders Community · Vibe Club

Ship AI Faster with Founders, Engineers & Weekly Architecture Reviews

Inside Vibe Club (hamidun.com/club) — weekly live masterminds with Zhemal Khamidun, Tech Radar, full LMS access, and 370+ production Claude Code skills.

Join Vibe Club →Explore Hamidun Academy
What do you think?
Loading comments…