OpenAI is engaged on a brand new instrument that may generate music based mostly on textual content and audio prompts, in accordance with a report in The Data.
Such a instrument could possibly be used so as to add music to current movies, or so as to add guitar accompaniment to an current vocal monitor, sources stated. It’s not clear when OpenAI plans to launch such a instrument or whether or not it will be out there as a standalone product (versus integrating with OpenAI’s ChatGPT and video app Sora).
One supply instructed The Data that OpenAI is working with some college students from the Juilliard College to annotate scores as a manner to supply coaching information.
Whereas OpenAI has launched generative music fashions previously, they predate the launch of ChatGPT; extra not too long ago, the corporate has been creating audio fashions targeted on text-to-speech and speech-to-text. Different firms with generative music fashions embrace Google and Suno.
Trendster has reached out to OpenAI for remark.
