Google Videopoet

What is Google VideoPoet?

VideoPoet is a Google research project that turns a large language model into a video generator. It is built on pre-trained MAGVIT V2 video and SoundStream audio tokenizers, which convert images, videos, and audio clips into discrete codes a language model can process. An autoregressive language model then predicts the next piece of video or audio in a sequence to generate new content.

Because it is built for multimodal learning, VideoPoet handles text, images, and video together. That enables text-to-video generation, image generation from text, and editing of existing footage while keeping it consistent over time. It produces a wide range of motion, supports multiple video formats, and can generate audio matched to the visuals.

Who created Google VideoPoet?

VideoPoet was developed by a research team at Google, including Dan Kondratyuk, Lijun Yu, Xiuye Gu, José Lezama, Jonathan Huang, Rachel Hornung, Hartwig Adam, Hassan Akbari, Yair Alon, Vighnesh Birodkar, Yong Cheng, Ming-Chang Chiu, Josh Dillon, Irfan Essa, Agrim Gupta, Meera Hahn, and Anja Hauth.

What is Google VideoPoet used for?

• Text-to-Video: Turns written descriptions into videos.
• Image-to-Video: Animates still images.
• Video Inpainting: Fills in missing parts of a video.
• Video Outpainting: Extends the boundaries of existing footage.
• Video Stylization: Applies artistic styles to footage.
• Video-to-Audio: Generates audio that fits a video, without needing text instructions.
• Variable-length, high-motion videos: Produces dynamic clips of different lengths.
• Temporal consistency: Keeps transitions smooth and natural over time.
• Format flexibility: Generates square and portrait videos suited to social media.

Who is Google VideoPoet for?

VideoPoet suits content creators, digital marketers, video editors, social media managers, animators, graphic designers, film producers, advertising specialists, educators, and videographers — anyone who needs generated or edited video content.

Accessing VideoPoet

VideoPoet is available through Google’s research site, which showcases its demo outputs and capabilities. Example prompts demonstrate how a single text prompt, such as an astronaut riding a horse in a forest, can be rendered in different styles, including photorealistic, digital art, and animated oil painting.