Meta recently introduced Movie Gen, an AI-powered text-to-video generator powered by the company’s in-house Llama Image foundation model. The new generator is capable of making soundtracks and background music as well as editing its videos as well.
Meta Movie Gen
Movie Gen is a tool under development by Meta that works similarly to Google’s Videopoet and Sora of OpenAI. Meta’s version uses its Llama Image foundation model and is designed for generating high-quality images and videos with sound. It does so with a 30B parameter transformer model that can generate videos of up to 16 seconds at a rate of 16 frames per second.
Meta boasts that you can edit elements of the Movie Gen-created videos through the generator. It is said to be capable of swapping the sky color, changing the color of the shirt, or adding more elements to your video.
Moreover, it can generate sounds thanks to being trained on a 13B parameter generation model. It can also line up the audio clip to the generated video.
The company boasts that its tool is more efficient and performs better than other AI text-to-video tools.
However, the tool isn’t officially available to the public, as of writing this and its launch wasn’t mentioned just yet. The AI-powered tool is expected to be rolled out to the company’s platforms namely Instagram, Facebook, and WhatsApp.
Ram found his love and appreciation for writing in 2015 having started in the gaming and esports sphere for GG Network. He would then transition to focus more on the world of tech which has also began his journey into learning more about this world. That said though, he still has the mentality of "as long as it works" for his personal gadgets.
