Adobe Creative Cloud undergoes a significant transformation with the introduction of groundbreaking Luma AI Ray3 integration as a world-first.
Adobe has made a significant stride in the realm of AI video generation by integrating Luma AI's latest model, Ray3, into its Firefly platform. This move marks Adobe as the first third-party partner to launch Ray3 outside of Luma AI's Dream Machine platform.
Ray3, a groundbreaking AI video model, is built on a new multimodal reasoning system. This system enables the model to "think through" what a user is asking, plan complex scenes, and judge whether its own output makes sense. One of the key features of Ray3 is its reduced propensity for hallucinations compared to other AI video generators.
The model also offers native 1080p generation, initially for select partners but set to roll out generally. Ray3 supports native 10-, 12-, and 16-bit High Dynamic Range (HDR) ACES2065-1 EXR format, allowing for deeper shadows and brighter highlights. A neural upscaler in Ray3 can further upscale the output to 4K.
Adobe's strategy change aims to make Firefly the creative AI ecosystem of the future, an all-in-one platform for creative AI. Ray3 can generate cinematic, high-quality video footage of up to 10 seconds long. It can be used in the Firefly app for generating b-roll or background footage, and in the Firefly Boards app for exploring visual directions for environments, shot compositions, and camera perspectives.
To ensure transparency, Adobe adds Content Credentials to all AI-generated assets, allowing users to keep track of how they were generated. This means users are responsible for being aware of how they generated each asset, whether it was with Adobe's own Firefly or AI models from "trusted partners".
In addition to Ray3, Firefly is now including models from OpenAI, Ideogram, Pika, Black Forest Labs, Runway, with upcoming integrations planned with Moonvalley and Topaz Labs. Adobe initially integrated generative AI based on its own Adobe Firefly AI models, trained on licensed material. The company developing the AI-based video creation model Ray3 is not mentioned in the provided search results.
Adobe is offering unlimited free Ray3 generations for all customers on a paid Firefly plan or Creative Cloud Pro plan until 1 October. As an industry-standard package for creative work, Adobe Creative Cloud combines digital art software and video-editing software. With the addition of Ray3, Firefly is set to redefine the future of AI-generated content.
