OpenAI could also be dialing again its efforts within the video technology market with the shutdown of its Sora app, however ByteDance on Thursday confirmed that its new audio and video mannequin, Dreamina Seedance 2.0, is now rolling out in its modifying platform, CapCut.
ByteDance says the mannequin permits creators to draft, edit, and sync video and audio content material through the use of prompts, photos, or reference movies.
The phased rollout will start with CapCut customers in Brazil, Indonesia, Malaysia, Mexico, the Philippines, Thailand, and Vietnam, with extra markets added over time.
The information of the launch in CapCut follows a current report that stated the mannequinβs international rollout can be paused, whereas it labored to deal with mental property points that drew criticism from Hollywood over alleged copyright infringement. That doubtless explains the restricted variety of markets the place the mannequin is at the moment accessible inside CapCut.
In China, the mannequin is accessible to customers of ByteDanceβs Jianying app.
The video technology mannequin works with out reference photos, even when the creator solely makes use of a couple of phrases to explain the scene they take into account, ByteDance says in its announcement. CapCut can be good at rendering life like textures, motion, and lighting throughout a variety of visible views and angles, which the corporate notes may very well be used to edit, improve, or right creatorsβ personal footage.
One other use case can be permitting creators to check potential concepts based mostly on early ideas or sketches earlier than filming the actual video.
As well as, Dreamina Seedance 2.0 can be utilized for a variety of content material, together with cooking recipes, health tutorials, enterprise or product overviews, and movies with movement or action-focused content material, the place AI video fashions have traditionally confronted challenges, the corporate explains.
At launch, the mannequin helps clips of as much as 15 seconds lengthy throughout six facet ratios.
In CapCut, the mannequin will roll out throughout totally different areas, together with modifying options reminiscent of AI Video and technology instruments like Video Studio. It’ll additionally come to ByteDanceβs AI technology platform, Dreamina, and its advertising and marketing platform, Pippit.
Given its means to create life like content material, ByteDance says it has added security restrictions, so the mannequin gainedβt have the flexibility to make movies from photos or movies that include actual faces. CapCut may also block using unauthorized technology of mental property. (Nonetheless, if the restrictions had been working correctly, the mannequin can be accessible now in america. Doubtless, extra tweaks are nonetheless being made.)
The content material produced by Dreamina Seedance 2.0 may also embody an invisible watermark, which is able to assist to determine content material made with the mannequin when itβs shared off-platform, ByteDance added. This might assist in issues like takedown requests from rights holders within the occasion that the mannequin allowed copyright content material by way of.
ByteDance says it would companion with consultants and inventive communities because the mannequin rolls out to iterate and enhance upon the mannequinβs capabilities.





