OpenAI’s Sora model is a leap forward for video-generation technology. How does it work, and what will it mean?
Late last week, OpenAI announced a new generative AI system named Sora, which produces short videos from text prompts. While Sora is not yet available to the public, the high quality of the sample outputs published so far has provoked both excited and concerned reactions.
How does Sora work? Sora combines features of text and image generating tools in what is called a “diffusion transformer model”. Sora uses the transformer architecture to handle how frames relate to one another. While transformers were initially designed to find patterns in tokens representing text, Sora instead uses tokens representing small patches of space and time.
Lumiere cannot make videos composed of multiple shots, while Sora can. Sora, like other models, is also reportedly capable of video-editing tasks such as creating videos from images or other videos, combining elements from different videos, and extending videos in time. If this is correct, future versions may have scientific applications for physical, chemical, and even societal experiments. For example, one might be able to test the impact of tsunamis of different sizes on different kinds of infrastructure – and on the physical and mental health of the people nearby.
Australia Latest News, Australia Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
OpenAI’s new generative tool Sora could revolutionize marketing and content creationAs with any technological advancement, professionals will need to adapt and find ways to integrate Sora into their workflows, leveraging its strengths to complement their own skills and creativity.
Read more »
Barnaby Joyce’s position on shadow frontbench in question after videoNationals Leader David Littleproud said he would talk to Barnaby Joyce about his position on the shadow frontbench.
Read more »
‘Not normal behaviour’: Joyce to miss party meeting as medication mix emerges as factor in videoNationals MP Barnaby Joyce has told several colleagues he was feeling the effects of medication mixing with alcohol when he fell off a planter box and continued his phone call.
Read more »
‘Football but not as you know it’: Hollywood star fronts powerful new NRL Vegas videoNRL: The voice of Hollywood actor Russell Crowe has been used to help draw more Americans to the game of rugby league ahead of the NRL's foray into the US next month.
Read more »
How will Russia remember Alexei Navalny? – video explainerThe Guardian's Andrew Roth looks at the prominent activist's rise to prominence, his legacy and how his death robs Russia’s beleaguered opposition of one of its most dynamic leaders
Read more »
Navalny's widow accuses Putin of killing him and vows to continue his workYulia Navalnaya posted a video on her dead husband&x27;s social media outlets saying Putin "killed the father of my children".
Read more »