Adobe showed the Super Sonic project for creating sound effects for videos using AI

At its annual Max conference, Adobe showed off a proof-of-concept project called Super Sonic, a prototype of AI-powered software that can turn text into audio, recognize objects, and recognize the author’s voice to quickly create sound effects and background audio for video projects.

Image source: Adobe

«We wanted to give our users control over the process, […] to go beyond the original text-to-audio workflow, and that’s why we’ve been working on an audio app like this that really gives you precise control over energy and timing and turns it into an expressive tool.” — said the head of AI at Adobe, Justin Salamon.

Super Sonic uses AI to recognize objects anywhere in the footage to create a query and generate the desired sound. In another mode, the instrument analyzes various characteristics of the voice and the sound spectrum and uses the resulting data to control the generation process. The user does not have to use their voice; they can clap their hands, play an instrument, or extract the original sound in any other available way.

It is worth noting that Adobe traditionally presents a number of experimental features at the Max conference. In the future, many of them end up in the Adobe Creative Suite. Super Sonic could be a useful addition, for example, to Adobe Premiere, but so far the future prospects of the project are unclear, and it remains in the status of a demo version.

Previously, Super Sonic developers were involved in the development of Firefly’s generative AI feature called Generative Extend, which allowed short video clips to be extended by several seconds, including an audio track.

The ability to create sound effects from a text query or voice is a useful feature, but far from groundbreaking. Many companies, such as ElevenLabs, already offer similar commercial tools.

admin

Share
Published by
admin

Recent Posts

Hidden features of Microsoft Bing Wallpaper scared users

Microsoft has released the Bing Wallpaper app, which updates your desktop background daily using images…

18 minutes ago

“There will be more to come”: a Rockstar employee intrigued fans with “absolutely mind-blowing things” in GTA VI

While fans eagerly await the next GTA VI trailer, Rockstar Games' ambitious open-world crime thriller…

28 minutes ago

“James Webb” was the first in history to find the “Einstein zigzag” – a unique curvature of space-time

Gravitational lensing, predicted 90 years ago by Einstein, was confirmed by observation four years after…

59 minutes ago

The second Xiaomi electric car will be released a year after the first and will be noticeably different from it

Xiaomi's efforts to carve out its place in China's highly competitive electric vehicle market are…

2 hours ago