Ai Generative Fill in Premiere Pro, Powered by Adobe Firefly

Exciting developments are on the horizon for Adobe Premiere Pro users, as Adobe are developing the realm of generative AI video editing with its Firefly family. This cutting-edge technology aims to revolutionise the editing experience by introducing new tools that enable users to generate and manipulate video content using text prompts, similar to Photoshop’s Generative Fill feature.

The upcoming Firefly tools, in collaboration with potential third-party integrations from Runway, Pika Labs, and OpenAI’s Sora models, promise a game-changing approach to video editing. Users will gain the ability to seamlessly generate video content, add or remove objects, and even extend the duration of video clips, all through intuitive AI-driven workflows.

Adobe have released a short video which demos the incredible capabilities of generative fill used in video editing. From removing background objects, to adding object into the shot, and even onto the characters in frame! However, the integration of third-party AI models into Premiere Pro remains a subject of future exploration for Adobe, highlighting the company's commitment to offering users diverse options for enhancing their editing projects.

One notable aspect of these advancements is the potential for users to apply Adobe's Content Credentials labels to generated clips, indicating the specific AI models used in their creation. This transparency not only adds a layer of authenticity to the editing process but also allows users to understand and utilise various AI technologies seamlessly.

The collaboration between Adobe and third-party AI providers signals a significant step towards democratising AI-powered editing tools. By leveraging the unparalleled generative capabilities of models like OpenAI’s Sora, Adobe aims to elevate the editing experience for creative professionals, offering unparalleled flexibility and efficiency within the familiar Premiere Pro environment.

The subject of ai and its usage in art is a highly debated and seemingly controversial one amongst artists and designers alike, what are your thoughts? Do you think generative AI is useful for content creation, or does it take away from the process and end result? Let us know what you think in the comments below!