In the award-winning animation “The Wild Robot,” our robotic Roz realizes she should activate studying mode with a purpose to perceive and talk with the world round her. Her system not solely needed to study visible components, but in addition incorporate and interpret sounds as language.
Recently, Adobe’s generative AI platform, Firefly, has integrated sound era by way of prompting, and that expands immediately in a brand new announcement.
Generate Sound Effects (beta) was out there beforehand within the Firefly system. Users can use their very own voice to manage the type and pacing of the efficiency, so to talk (pun supposed). The sounds are generated rapidly, a fraction of the time spent creating visible property or utilizing generative AI.
This morning, I prompted Firefly to generate a robotic welcoming you to this website… and the ensuing audio was creepy sufficient to immediate nightmares (pun supposed). So, phrase recognition doesn’t look like in Generate Sound Effects by way of that route. The Text-to-Avatar system was extra acceptable for that immediate anyway. Perhaps we’re not but as subtle as Wild Robot Roz, who transitions in Chapter 20 of the guide: “…she no longer heard animal noises. Now she heard animal words.”
As of this morning (7/17/25), for me, “Text to Sounds (beta)” and “Voice to Sound Effects (beta)” are actually listed as choices for sound era within the Firefly net utility. Generate Sound Effects was once listed as an choice on the principle touchdown web page, however the revamped Generate Sound Effects is the place you truly land after you click on by way of both Text to Sounds or Voice to Sounds.
Moooooving alongside….the system additionally guarantees smoother motion and transitions within the Firefly video mannequin.
Also launching this morning is the power to generate photographs and movies by way of a number of integrations of different AI video fashions by way of Firefly. Of specific notice to video editors and photographers, Topaz Labs’ standard picture and video upscalers are headed to Firefly Boards (Adobe’s Firefly-powered temper board app that launched in June). Do we’ve got a future with Topaz Upscalers additional built-in into Firefly or…dream of goals… immediately in Premiere?? “Cannot compute!”
Google Veo 3 with audio is a brand new integration in Text to Video within the Firefly App and runway’s Gen-4 video is a brand new integration into Firefly Boards. Also coming quickly to the Boards is Moonvalley’s Morey, and Pika 2.2 is headed to the app.
No matter which mannequin is used, Adobe has made clear that the content material made by way of Firefly won’t be used to coach AI fashions. All of the integrations might be accessed immediately by way of Firefly. While Content Credentials are utilized to content material created in Adobe Firefly, which seems to nonetheless be the one commercially protected AI Video generator on the record (and when you choose your era choice, Adobe has made this abundantly clear).
Non-Adobe Models may also be turned off by a corporation, as seen right here in my increased instructional setup.
Also out there in Firefly video this A.M. is composition reference, keyframe cropping, and magnificence presets throughout the Firefly app. Text to Avatar (beta) involves the App as nicely.
More info is accessible by way of Adobe’s announcement.
Leave a Reply