Picsart’s artificial intelligence research team (PAIR) has built a new generative AI model that can create entirely new video content from only text descriptions.
The main problem with text-to-video generative AI right now is that while the general idea of what is being created is consistent, its presentation is not. The main subjects often look slightly different frame to frame and the background is also inconsistent, which makes the finished video look like everything is constantly in motion and it, therefore, lacks realism. The team attempted to combat this.
The researchers explain that their key modification compared to other attempts at text-to-video generation involves “enriching the latent codes of the generated frames with motion dynamics” which allows them to keep the global scene and background time consistent. They also have managed to better preserve the context, appearance, and identity of the foreground subject compared to many other generative video systems.
“As experiments show, our method performs comparably or sometimes better than recent approaches, despite not being trained on additional video data.” The new generative AI doesn’t just make videos from text descriptions: it can also be used to change the appearance of an existing video, such as the case below where a video of a swan was changed by asking the AI to “make it Van Gogh Starry Night style.”
Unlike most research projects that can take months or years to be deployed publicly, it won’t be long until the PAIR text-to-video generative AI system becomes customer-facing. Picsart says that it plans to launch new software products that are built on this generative AI’s framework in the coming weeks.
Australia Latest News, Australia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Caltech Engineers Have Developed an Unusually Tough New MaterialCaltech engineers have made a significant breakthrough in the field of nano- and micro-architected materials by creating a novel material composed of multiple interconnected microscale knots. Compared to structurally identical but unknotted materials, the presence of knots in this new material si
Read more »
Rutgers pro day showed recruits how players are being developed, segues to spring visitsSome of Rutgers' top veterans showed out at pro day last week while some of Greg Schiano’s top targets took notice.
Read more »
New York nears deal creating first ban on gas stoves for new homes in the countryLawmakers in New York are gearing up to enact legislation that would prohibit gas stoves from being used in new buildings, including single-family homes and commercial properties.
Read more »
New York nears deal creating first ban in the country on gas stoves for new homesLawmakers in New York are gearing up to enact legislation that would prohibit gas stoves from being used.
Read more »
New State Mobile Reveals New KA-BOOM Mode In Latest UpdateICYMI: Check out the brand new KA-BOOM Mode being added to NewStateMobile in the latest update from Krafton, which is now live.
Read more »
In Downtown New York, a Persian New Year Dinner With a TwistFor this trio of New York creatives, celebrating Nowruz this year felt more important than ever.
Read more »