Meta announces Movie Gen, an AI-powered video generator

A caller AI-powered video generator from Meta produces high-definition footage implicit with sound, the institution announced today. The announcement comes respective months aft rival OpenAI unveiled Sora, its text-to-video exemplary — though nationalist entree to Movie Gen isn’t happening yet.

Movie Gen uses substance inputs to automatically make caller videos, arsenic good arsenic edit existing footage oregon inactive images. The New York Times reports that the audio added to videos is besides AI-generated, matching the imagery with ambient noise, dependable effects, and inheritance music. The videos tin beryllium generated successful antithetic facet ratios.

In summation to generating caller clips, Meta says Movie Gen tin besides make customized videos from images oregon instrumentality an existing video and alteration antithetic elements of it. One illustration shared by the institution shows a inactive headshot of a woman; the added video depicts her sitting successful a pumpkin spot sipping a drink.

Movie Gen tin besides beryllium utilized to edit existing footage and alteration the benignant and transitions oregon adhd things that didn’t antecedently exist. In 1 illustration shared by Meta, a comparatively innocuous video of what appears to beryllium an illustrated runner is edited utilizing AI successful antithetic ways: successful 1 frame, he’s holding pompoms. In another, the inheritance has been edited to picture a desert. In a third, the runner is wearing a dinosaur costume. Changes tin beryllium made utilizing substance prompts.

Nearly 2 years aft almighty AI representation and video generators deed the mainstream, AI companies person pushed the exertion further: successful conscionable the past six months, large tech companies similar Google and OpenAI are moving connected akin tools, on with smaller startups. OpenAI’s Sora, archetypal announced successful February, still hasn’t launched publicly; this week, a co-lead moving connected the video generator left the institution for Google.

Meta’s main merchandise officer, Chris Cox, writes connected Threads that the institution “[isn’t] acceptable to merchandise this arsenic a merchandise anytime soon,” arsenic it’s inactive costly and procreation clip is excessively long.

AI representation generators raised concerns astir ownership and perchance harmful usage cases, and AI video generators person lone exacerbated them. Reports bespeak that AI startup Runaway trained its video generator connected thousands of scraped YouTube videos, thing YouTube CEO Neal Mohan has already said would interruption the platform’s presumption of use. In a blog post, Meta says it trained Movie Gen connected “a operation of licensed and publically disposable datasets” but didn’t specify which.

Creatives similar filmmakers, photographers, artists, writers, and actors besides interest astir however AI generators volition impact their livelihoods, and AI has been a cardinal part of respective strikes, including the historical associated Hollywood strikes by the Screen Actors Guild - American Federation of Television and Radio Artists (SAG-AFTRA) and Writers Guild of America (WGA) past year.