This morning, Adobe debuted its upcoming Firefly Video Model with huge advancements to its generative AI video capabilities, designed to empower film editors and video professionals with tools to help inspire their creative vision, fill gaps in their timeline, and add new elements to existing footage.
Watch this short demonstration of what seems like magic:
Crazy, right? It is no stretch to say this is a massive leap forward. But you probably have a lot of questions, so… read on:
The company says the AI Video Model, like the other models in the Firefly family, is designed to be commercially safe (what does that mean?) and promises that it will soon be seamlessly integrated into workflows across Creative Cloud, Experience Cloud and Adobe Express.
Planned features include:
- Text to Video capabilities to generate video from text prompts; access a wide variety of camera controls such as angle, motion and zoom to fine-tune videos; and reference images to generate B-Roll that seamlessly fills gaps in your timeline.
- Image to Video capabilities to bring still shots or illustrations to life by transforming them into stunning live action clips.
- Generative Extend, a new Firefly-powered feature integrated in Premiere Pro, is designed to tackle several editorial challenges, including extending insufficient frames at the beginning or end of a clip, giving you extra footage to hold on a shot for another beat or to cover a transition, or creating seamless audio edits by generating “room tone” where none exists.
The new Video Model exemplifies Adobe’s approach to Generative AI with Firefly. Ultimately, Adobe believes AI can be a tool for, not a replacement of, human creativity, and that generative AI should be developed responsibly, starting with respect for creator rights. This means their AI models are only trained on content which they have permission to use, and never on their customers’ content. More on Adobe’s approach here.
What will the video quality and time duration be? We hear that the initial resolution is 720p (1,280 x 720 pixels) with a maximum length of five seconds. One trick to create a longer shot would be to screenshot the last frame and then extend it using the same tools. For the resolution, Adobe says their generative AI features are evolving rapidly and they plan to offer higher-resolution images, animation, video, and 3D output in the future.
You can find further details on these AI video innovations in Adobe’s blog, and you can read the official press release here.
Special: Legally download dozens of free Adobe books for a limited time!
Availability and Pricing
So, when and where will these features be available to users? Adobe says the upcoming Firefly Video Model will power their industry-leading video tools like Premiere Pro, and will available starting in public beta later this year. Considering there are only a few months left in 2024, that answer means “very soon.”
Presumably, AI video usage of Adobe Firefly will consume a greater level of Generative Credits than do the current image-related features, but we don’t yet have further information on how that will work. Another possibility Adobe is discussing is the Video Model being available through a premium Creative Cloud plan tier, versus a core set of generative AI capabilities included in the standard plan.
In the meantime, sign up below to get notified when Firefly Video is available – plus watch more jaw-dropping demos now:
Lastly, did you know? Adobe continues to expand their Free Stock Collection, adding 85,000+ pro-quality stock videos (with footage in HD and 4K) available today at no cost and royalty-free. Head over there and start downloading now!
See Also
- The 10 most common myths about Creative Cloud
- What are the differences between Adobe CC vs. CS6?
- Download free Adobe books (choose over 30 titles)
- Free! Watch 200+ new courses from Adobe MAX
- How to save 60% with the Student & Teacher Editions
- Free Adobe Stock! Download 1,000,000+ top images
Keep up with the latest on Adobe software — follow us on Facebook or Twitter, or subscribe to our RSS feed… You can also enter your email and have new articles sent directly to your Inbox. We are reader-supported; when you buy through links on our site, we may earn an affiliate commission.
