鶹ýAV

Skip to content

Shelly Palmer - AI-Generated Audio for Video From DeepMind

Shelly Palmer has been named LinkedIn’s “Top Voice in Technology,” and writes a popular daily business blog.
shellypalmer240307
DeepMind has unveiled V2A, an AI-powered technology capable of generating audio from a video input

Greetings from Cannes. We've got a full day of programming on the Brand Innovators/Influential beach and at the Armani Caffe (details below). If you're here, please stop by.

In the news: DeepMind has unveiled V2A, an AI-powered technology capable of generating audio from a video input (not from a text description, but from the video input itself). As this technology matures, it's going to have an outsized impact on video creation workflows.

The company says the system can generate high-quality audio (including music, sound effects, and voiceovers) that is contextually appropriate and synchronized with the visual content. There are some examples on DeepMind's blog post.

Like it or not, this is the future. Inevitably, this technology will evolve to do exactly what DeepMind says it will do. Imagine describing your video to a text-to-video model like OpenAI's Sora or Google's Veo, then having DeepMind's V2A create the voiceover, soundtrack, and sound effects. Now, imagine combining these technologies into one interface where you simply describe what you want and have the AI create a complete production for you.

Depending on what you do for a living, this is either heaven or hell – perhaps it's a bit of both. Purists, you don't need to make the argument that AI will never be able to do what a human can do. If this tech stack is suitable for just 20 percent of video projects (corporate communications, memes, simple how-to-videos, etc.), the industry is going to feel it. As that percentage creeps up – and it will – we're going to be in a new world.

As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s

[email protected]

ABOUT SHELLY PALMER

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse- Omnicom Cove @ Cannesniversity’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named  he covers tech and business for , is a regular commentator on CNN and writes a popular . He's a , and the creator of the popular, free online course, . Follow  or visit . 

push icon
Be the first to read breaking stories. Enable push notifications on your device. Disable anytime.
No thanks