Google DeepMind partnered with Primordial Soup to produce the short film 'ANCESTRA', premiering at the Tribeca Festival, which merges live-action with Google's video generation model, Veo. This collaboration involved over 200 professionals, aiming to put generative AI into the hands of filmmakers and push the boundaries of storytelling and technology.
The film tells the story of a mother, inspired by director Eliza McNitt's own dramatic birth experience. By combining Veo-generated footage with live-action scenes, McNitt described Veo as another lens to imagine the universe around her.
To create 'ANCESTRA', the team uploaded photos taken by McNitt's father and used Gemini to generate detailed aesthetic descriptions that served as prompts for new images and videos. Key concept art was generated by Imagen to define the overall look and mood of the film.
During the video generation process, the team faced challenges in matching the quality and color of live-action footage. By fine-tuning an Imagen model, they ensured consistency in artistic direction. Additionally, using Veo's motion matching capabilities, the team could precisely control camera movements to produce high-quality scenes.
For instance, in one scene, McNitt wanted viewers to journey through the human body, culminating in the birth of a baby via C-section. The team created a virtual 3D model of the body, recorded the draft shot's motion, and used Veo to generate new footage. The final shots were refined using traditional VFX and color grading, seamlessly integrating the AI-generated baby into the live-action footage.
'ANCESTRA' is the first of three short films produced in collaboration with Primordial Soup, aiming to complement existing creative workflows with generative AI, helping filmmakers overcome practical limitations. By collaborating with artists like McNitt and Aronofsky, DeepMind explores the creative potential of today's technologies.
Blogger's Review: 'ANCESTRA' showcases the immense potential of generative AI in filmmaking. By partnering with top artists, DeepMind not only drives narrative innovation but also opens new possibilities for traditional film techniques. This blend deserves deep reflection and emulation within the industry.