TikTok is testing a new “AI Song” feature that uses AI to create songs based on user-entered prompts, the company confirmed to TechCrunch. AI Song is an experimental feature and is currently only available to a select number of users. The feature is designed to be used for fun, not for trying to create the next viral song.
The company told TechCrunch that AI Song uses Bloom, a large language model, to generate lyrics based on text prompts. The lyrics are then combined with music from a pre-stored catalog created on TikTok.
TikTok user Jonah Manzano posted a walkthrough of the new feature for details on how it works. According to the video, AI Song starts by asking users to “enter a prompt to create a song.” TikTok provides some suggested prompts, such as “Going to concerts,” “A fresh start,” and “Pet cuddling.” Or, you can enter your own prompt. After you enter a prompt, the app will start creating your song.
After a few seconds, the app will generate lyrics related to your prompt and match it with music. You can change the vibe of the song by switching between “pop”, “EDM” and “Hiphop”. The end result is a strange song with lyrics based on the typed text prompt.
According to the video, the app notes that “there are rules to be followed” when using the AI Song. For example, the Feature may not be used to exploit or harm minors or to spread false or personal information that harms others. It also may not be used to defame, impersonate or harass others.
As with any beta mode, it’s unknown when or if AI Song will be released more widely. TikTok noted that it may change the name of the feature in the future.
TikTok isn’t the only company that has developed tools to help users create music for short-form videos. A few months ago, YouTube launched a “Dream Track” feature that allows creators to create 30-second AI-generated soundtracks. Users can create soundtracks with the voices of select artists including Alec Benjamin, Charlie Puth, Charli XCX, Demi Lovato, John Legend, Sia, T-Pain, Troye Sivan and Papoose.
It’s worth noting that while TikTok’s new feature isn’t designed for the music industry, TikTok parent ByteDance launched a free music production app in the United States last June to help musicians create and edit audio in a similar way to the portable smart digital audio workstations (DAW).
With Ripple, users can sing or hum a melody directly into the app, after which it will use machine learning to expand the melody and turn it into an instrumental song. The app’s model was trained on music licensed or owned by ByteDance. Ripple allows users to record, cut, trim and edit audio files easily on their mobile device.
The new AI Song feature comes as TikTok pushes deeper into the music industry. Last year, it launched its own subscription-only music streaming service called ‘TikTok Music’ in select countries to take on the likes of Spotify and Apple Music.
Although TikTok hasn’t shared details about when it plans to launch the streaming service in the United States, it’s been over a year since ByteDance applied for a trademark with the US Patent and Trademark Office for a service called “TikTok Music,” so we can probably expect a launch at some point.
