Meta’s Movie Gen lets users animate photos into videos

Meta says it is working with filmmakers and creators as it eases toward the possible public release of a ‘Movie Gen’ AI model that turns images into custom videos based on simple text prompts.

Meta on Friday provided a look at a generative artificial intelligence model it is working on that lets people create short videos, complete with audio, from text prompts and photos.

The tech titan touted “Meta Movie Gen” as a “breakthrough” when it comes to using an AI engine to crank out video and audio.

Meta said it will get feedback from filmmakers and creators as it eases toward making the video-generating AI engine publicly available.

No release plans for Movie Gen were disclosed.

Text input summary: A sloth with pink sunglasses lays on a donut float in a pool. The sloth is holding a tropical drink. The world is tropical. The sunlight casts a shadow. Credit: Meta

“While there are many exciting use cases for these foundation models, it’s important to note that generative AI isn’t a replacement for the work of artists and animators,” Meta said in a post.

The model lets people use text prompts to create custom videos, including clips based on people’s photos, of up to 16 seconds long, according to Meta.

“Our model achieves state-of-the-art results when it comes to creating personalized videos that preserve human identity and motion,” Meta said.

“Imagine animating a ‘day in the life’ video to share on Reels and editing it using text prompts or creating a customized animated birthday greeting for a friend and sending it to them on WhatsApp.”

Movie Gen is the third wave of AI-powered video generation at Meta, according to the company.

The rise of AI-powered tools for creating realistic videos has prompted worries about “deepfakes” that pirate people’s likenesses.

More information:
Movie Gen: A Cast of Media Foundation Models, ai.meta.com/research/movie-gen/

© 2024 AFP

Citation:
Meta’s Movie Gen lets users animate photos into videos (2024, October 4)
retrieved 4 October 2024
from https://techxplore.com/news/2024-10-meta-movie-gen-users-animate.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.