Voice cloning startup ElevenLabs launched a brand new device for customers to generate sound results by way of prompts at this time. The corporate first introduced the challenge again in February.
The device, accessible to all customers beginning at this time, permits customers to sort in prompts like “waves crashing,” “metallic clanging,” “birds chirping” and “racing automobile engine” to generate snippets of sounds.
The sound results device also can generate instrumental musical clips of as much as 22 seconds with prompts comparable to guitar loops, jazz saxophone solos and music techno loops.
Free customers get 10,000 character generations per thirty days — a sound byte technology takes round 150 characters per request. Basically, free-tier customers can generate practically 60 sound results per thirty days. Additionally they must attribute the sound to “elevenlabs.io” within the title whereas publishing any content material containing the sound clip.
ElevenLabs stated that it used Shutterstock’s audio library containing licensed tracks as a device to coach its mannequin. The corporate added that customers that attempted out the device throughout the alpha testing part included online game builders, movie producers, social media content material creators and entrepreneurs.
The startup famous that the device doesn’t enable sound technology by way of prompts that violate its Prohibited Content material and Makes use of Coverage, which incorporates subjects like self-harm, threats to baby security and fraud.
Whereas there are just a few firms and startups engaged on AI-powered sound technology, ElevenLabs would possibly discover the music technology house crowded. Stability AI-backed Harmonai has launched Dance Diffusion; Google has labored on MusicLM; OpenAI has Jukebox; and Meta has its AudioCraft mannequin. TikTok and Adobe have additionally experimented with generative AI-based music creation instruments of their very own.
We’re launching an AI publication! Join right here to start out receiving it in your inboxes on June 5.