GOOGLE has unveiled a glimpse of its Lumiere platform in a new video.
Lumiere is a new artificial intelligence-powered video generation model developed by Google.
1
In a new video, the service is seen creating amazing 5-second-long videos based just on text prompts.
This technology marks a significant leap forward in the realm of artificial intelligence.
Lumiere uses a unique approach called Space-Time-U-Net (STUNet) to create realistic and coherent videos in a single pass.
The technology figures out where things are in a video and how they simultaneously move and change.
This translates to smoother, more coherent, and ultimately, more believable final products, unlike older methods.
Lumiere also generates 80 frames compared to 25 frames from Stable Video Diffusion, The Verge noted.
“We introduce Lumiere – a text-to-video diffusion model designed for synthesizing videos that portray realistic, diverse, and coherent motion – a pivotal challenge in video synthesis,” said Google researchers in a paper.
“We introduce a Space-Time U-Net architecture that generates the entire temporal duration of the video at once, through a single pass in the model,” they wrote.
Most read in News Tech
The system can carry out a variety of video editing tasks, such as converting still images to video.
It can also create videos in a specific style using reference images or text prompts.
Perhaps most notable, the platform can create animations by altering specific regions of an image, per the Economic Times.
The researchers did not that there is some risk of abuse when it comes to the platform.
“There is a risk of misuse for creating fake or harmful content with our technology,” they said.
“And we believe that it is crucial to develop and apply tools for detecting biases and malicious use cases to ensure a safe and fair use.”
Lumiere is not the only AI platform that carries a risk of misuse, ChatGPT and ElevenLabs have already been abused by cybercriminals.
ChatGPT, an advanced chatbot, has been used by amateur hackers to generate malware.
Meanwhile, ElevenLabs has been used to generate deepfakes of celebrities to spread misinformation.
READ MORE SUN STORIES
Deepfakes are synthetic media in which a person’s face or voice used in an existing video is replaced with someone else’s.
Most recently, the technology was used to create a fake voice recording of President Joe Biden.
