As one of many newest developments within the AI panorama, AI-powered video mills have been rising in recognition. These companies work equally to different generative AI instruments: Describe your required content material in a immediate, and the bot responds, hopefully delivering what you need.
Launched in June, Luma Dream Machine is an AI video generator with two capabilities: text-to-video and image-to-video. Luma solely creates brief movies — a number of seconds in size — however you may lengthen a video one other 5 seconds by including extra particulars to the immediate.
What’s extra, Luma is now operating Dream Machine 1.5, its newest mannequin, which is designed to raised perceive your prompts and generate extra real looking movies extra rapidly.
This is learn how to use Luma Dream Machine’s AI to create a brief video.
use Luma Dream Machine
To start out, head to the Dream Machine web site. Click on the “Attempt now” button and you will be prompted to sign up with a Google account.
Luma affords a wide range of plans primarily based on what number of movies it’s essential generate per thirty days and the way you intend to make use of them. The free plan affords you 30 movies every month with no industrial use allowed, whereas the Lite plan prices $10 per thirty days for 40 movies.
The most costly possibility is the Premier plan priced at $500 per thirty days, which comes with 2,400 movies every month.
Textual content-to-video immediate
Let’s begin with Luma’s text-to-video generator. Within the immediate discipline, kind an outline of the video you need. Be particular and embrace any essential particulars.
You may also describe the temper or ambiance you need to create. Be certain the choice for “Improve immediate” is checked, as that helps Dream Machine flip easy descriptions into extra detailed situations.
In order for you the video to maintain looping, test the choice for Loop. After you have typed the outline, click on Create.
Your video will queue up. Relying on the complexity of the scene, you’ll have to attend a number of minutes or longer for the video to look. Hover your mouse over the video to play it.
Now you can charge the video by giving it a thumbs up or thumbs down. I requested Dream Machine to create a video of a knight in shining armor battling a dragon respiration fireplace with each of them in entrance of a fort. The video seemed good, however the fireplace got here out of nowhere as a substitute of the dragon’s mouth. For that cause, I gave it a thumbs down.
If the video would not meet your necessities, you may all the time strive once more. Revise your unique immediate to right no matter aspect did not come out proper. In my case, I rewrote the immediate to particularly point out that the dragon needs to be capturing fireplace out of its mouth.
With the revised immediate, Dream Machine did a greater job. Every video you request seems on the primary display so as to play or tweak any of them.
Subsequent, you may lengthen the video by 5 seconds by including different particulars to the immediate. To do that, click on the Prolong button after which elaborate in your immediate with further directions. When executed, click on the up arrow to submit the brand new particulars.
You’ll be able to then preview the video to see if the brand new info exhibits up.
Picture-to-video immediate
Now that we have tried Luma’s text-to-video function, let’s transfer on to its image-to-video generator.
This functionality enables you to add photographs that Luma will use to create a video as a substitute of writing a immediate from scratch. You’ll be able to then submit your request with or and not using a description.
Two photographs work finest right here — the primary acts because the beginning body and the second because the ending body. Dream Machine’s job is to create footage in between these two frames. The pictures have to be in JPG, JPEG, or PNG format and ideally have a 16:9 side ratio, however Dream Machine can work with different codecs as properly.
To do that, click on the picture icon within the immediate. Choose the 2 photographs you want to use. You’ll be able to change the place of the 2 photographs by clicking the curved arrow between them or swap out one of many photographs by clicking the X.
Let’s strive submitting the request with none immediate to see what Dream Machine cooks up by itself.
Hover over the video to see the way it performs. You’ll be able to lengthen the video by 5 seconds by clicking the Prolong button and including one other aspect to the immediate.
In my case, Dream Machine prolonged a video I had requested primarily based on two images of the Statue of Liberty. The additional few seconds added a pleasant contact by lingering on a detailed up of the statue’s iconic torch.
To generate a extra particular video, add your two photographs after which kind an outline of what you need.
Hover over the ensuing video to see if it matches your description. If not, you may strive once more or lengthen the video by including extra particulars to the immediate.
I added two portrait photographs — considered one of Herbert Hoover and one other of Franklin D. Roosevelt. I requested Dream Machine to create a video altering Hoover into FDR, and it pulled off an efficient morph of the thirty first president turning into the thirty second.
I additionally tried the identical two photographs however and not using a description. On this case, the outcomes weren’t fairly as satisfying, as Dream Machine failed so as to add the cool morphing. Even once you take the picture route, including a immediate may help steer the outcomes to raised meet your expectations.
When you’re happy with the video, click on the Obtain button to obtain it as an MP4 file. You’ll be able to then play it in your default media participant or tweak it in your favourite video editor.
Total, I used to be happy with the efficiency of Dream Machine. I did should tweak and finesse the prompts to get my desired outcomes, however that is true of any generative AI software. In some instances, the movies took a very long time to generate, so you will should be affected person.
To study extra about Dream Machine, try Luma’s FAQ web page.