Generative Extend in Premiere Pro: Adobe’s AI Tool That Could Change Video Editing

Adobe Premiere Pro’s new AI tool could save video editors hours of time

Adobe has released Photoshop 25.9, the latest public beta of its image-editing software, adding a range of generative AI capabilities powered by its new Firefly Image 3 AI model. One of the first AI tools released was generative fill in Photoshop, which lets creators fill specific shapes or areas with AI-generated imagery. Now, generative fill is one of the most popular Photoshop tools, on par with the crop tool. Of the 11 billion images created using Adobe’s AI model Firefly, 7 billion of them were generated in Photoshop. Put another way, an average of 23 million images a day are made using generative fill, Nielson said. Part of the appeal of Adobe’s updates is that they are legitimate use cases for generative AI for professionals.

The possibility of “losing a generation of artists,” as she put it, is worrisome. There’s no shortage of experts arguing about whether AI is capable of producing art, but artists have already lost jobs in favor of AI, especially in entry-level or freelance positions. Job experts predict that AI is likely to reduce the number of overall job opportunities as it gets better at automating more menial tasks.

How Generative AI is unlocking creativity – the Adobe Blog

How Generative AI is unlocking creativity.

Posted: Thu, 17 Oct 2024 07:00:00 GMT [source]

Lightroom’s generative remove has better object detection and selection to remove photobombers and other intrusive elements. One is the text and image to video generation that Adobe previewed last month, accessible in the Firefly web app at firefly.adobe.com. This enables users to create five-second, 720p-resolution videos from natural-language text prompts. It’s also possible to generate video using still images as a prompt, meaning a photograph or illustration could be used to create b-roll footage. Adobe’s Firefly cloud service, which provides access to AI-based design tools, is also receiving new video editing capabilities. One of the additions is a feature that generates five-second clips based on text prompts.

Adobe’s Firefly ‘Bulk Create’ lets users edit thousands of images at once

We actively engage with policymakers and industry groups to help shape policy that balances innovation with ethical considerations. Our discussions with policymakers focus on our approach to AI and the importance of developing technology to enhance human experiences. Regulators seek practical solutions to address current challenges and by presenting frameworks like our AI Ethics principles—developed collaboratively and applied consistently in our AI-powered features—we foster more productive discussions.

It is fascinating how Adobe discusses and frames generative AI tools compared to its competitors. Unlike companies like OpenAI and Stability AI, Adobe has been serving creative professionals for decades — Adobe didn’t just pop up when the AI door opened. Adobe’s 30-plus years of creating tools for visual artists means its core audience is not universally champing at the bit for more generative AI technology; many are concerned about how AI may harm their business and the art space at large. Adobe pledges to attach Content Credentials to assets produced within its applications so users can see how it was made and plans to apply its approaches to the planned integration of third-party AI models. As you can see when comparing the sets of images in the figures above and below… you can have great influence over your set of generated images through this control.

Expand videos that are too short without reshooting

While Generative Extend might give them the footage they need, other creatives may be less enthused. It may mean that reshoots are no longer required, taking days of work (and income) away from the cast and crew. Generative Extend is a Premiere Pro feature that Adobe previewed earlier this year. It enables editors to add generated footage and audio to the start or end of a clip. Adobe says the tool can also correct eyelines and actions that change unexpectedly in the middle of a shot. Generative AI is already reshaping digital experiences in India, particularly in ecommerce and travel.

This technology also enables the extension of video clips and the smoothing of transitions, with integration into Adobe’s video editing software, Premiere Pro. Adobe has expanded its Firefly family of creative generative AI models to video, in addition to new breakthroughs in its Image, Vector and Design models. The Firefly Video Model, now in limited public beta, is the first publicly available video model designed to be “commercially safe,” Adobe said.

The company says it’s committed to taking a creator-friendly approach and developing AI following the company’s AI Ethics with principles of accountability, responsibility and transparency. This includes respecting creators’ rights and never training the development of AI by using customer content. The new tools will also help across all design workflows whether that’s creating variations of advertising and marketing graphics or mocking up digital drawings and illustrations. For example, it’s now easier to add patterns to fashion silhouettes for mood boards. And since Adobe Firefly’s features are integrated into the products you already know and likely use so often, you won’t have to waste time navigating new software. Instead, users will need to either click on their profile picture on the Firefly website or do the same inside Adobe’s Creative Cloud desktop or web app.

This is markedly different from most AI art programs that are targeted at amateurs and non-artists — professional photographers and illustrators can create better images than an AI image generator, after all. Making it quicker to fix those kinds of errors is the goal of Adobe’s AI, Stephen Nielson, senior director of product manager for Photoshop, told me. Photoshop also has new and intuitive features to accelerate core creative workflows and streamline repetitive tasks by using the Selection Brush Tool, Adjustment Brush Tool and enhancements to the Type Tool and Contextual Taskbar.

• For those who want it, it’s available in all versions of Adobe Lightroom beginning today as an “early access” feature.
• Several of Photoshop’s existing AI tools are designed for tasks like eliminating power lines, garbage cans, and other distractions from the background of a photo.
• When it comes to generative artificial intelligence (AI), one company that has been at the forefront on the software side is Adobe (ADBE -0.43%).
• Retype is another nifty tool that converts static text in images into editable text.

This is great for taking pre-made designs and color schemes and applying your brand to them, without spending hours recoloring or changing fonts and other elements. Photoshop Beta’s Generative Workspace allows your generated images to have a new home. Previously, when generating images, you had to manually click to open them and save them each as a file or an artboard—but the Generative Workspace allows you to keep track of all your generated images across the Adobe suite. “AI tools can either be used for evil or to steal stuff, but it can also be used for good, to make your process a lot more efficient,” said Acevedo.

Adobe also hopes that by building this AI for professionals, it won’t raise the typical red flags that other AI programs do. If it’s integrated well, creators might be more inclined to take advantage of it, said Alexandru Costin, vice president of generative AI at Adobe. Another feature, Lens Blur, allows you to blur any part of a photo to create more professional-looking cityscapes, portraits, or street photography. If you have a photo you love but want to swap the background, the latest Photoshop update allows you to generate a replacement background that matches the lighting, shadows, and perspective of the subject in the forefront.

Well, that’s possible to change, too, and like style variations, users change the composition with a descriptive text prompt. I saw this new direction for myself at this year’s Adobe MAX, where new announcements focused on AI as tools rather than gimmicks. New tools like Project Turntable, that enables you to easily rotate 2D vector art in 3D by generating the missing data to fill in the image – a 2D horse now has four legs as its turned.

Google ups Workspace price, makes Gemini AI features available for free

Adobe said it only trains the video model on stock footage and public domain data that it has rights to use for training its AI models. Adobe has also released more info about its own promises for “responsible innovation” for Firefly and this new generative AI video model. Adobe promises that its Firefly generative AI models are trained only on licensed content, such as Adobe Stock and public domain content. It also gets new intuitive features like the Generate Image feature, powered by the new Firefly Image 3 Model. Additionally, the Enhance Detail feature for Generative Fill has been improved to provide greater sharpness and detail for large images. Moreover,the new Selection Brush tool simplifies the process of selecting specific objects for editing.