Today, Photoshop adds a number of Firefly-based features that allow users to extend images beyond their borders with Firefly-generated backgrounds, use generative AI to add objects to images, and use a new generative fill feature to remove objects more precisely than content-aware fill.
These features are only in Photoshop beta. Adobe is also offering some of these features to Firefly beta users on the web (Firefly users have created over 100 million images).
This interface lets Photoshop users utilize natural-language text prompts to describe what Firefly should generate. All generative AI tools can produce unpredictable outputs. Adobe provides three prompt variations by default, but unlike the Firefly web app, users cannot iterate on one to obtain comparable results.
Photoshop sends sections of an image to Firefly—the business is also experimenting with sending the complete image—and creates a new layer for the results.
Before today’s announcement, Adobe’s Digital Imaging VP, Maria Yap, showed me these new features. Some of the outcomes were surprising, as with all generative AI. Firefly created a realistic reflection when asked to create a puddle under a running corgi. A vivid purple puddle was another option, but the model seems to function well at adding things and notably extending visuals outside their frame.
Firefly excels at landscapes since it was trained on Adobe Stock and other commercially safe images. Firefly struggles with text, like most generative image generators.
Adobe ensured secure model results. Adobe added precautions and used a training set. “We married that with a series of prompt engineering things we knew,” Yap said. “We exclude unsafe terms and words. We’re also considering another hierarchy: “If Maria selects an area that has a lot of skin in it, maybe right now—and you’ll actually see warning messages at times—we won’t expand a prompt on that one, just because it’s unpredictable.” We don’t want to go somewhere uncomfortable.”
Adobe automatically applies content credentials to AI-based Firefly photos.
Lightroom could use many of these features. Yap said that Firefly will be added to the company’s photo management tool, but she wouldn’t give a date.