Sunday, November 1

Licensed Training Data and AI Music: How Generated Songs Are Made

AI music: mixing console and headphones in a quiet recording studio
Photo: Guillaume Bonzoms / Wikimedia Commons (CC0)

Search for new songs and you will find charts, playlists, and release roundups. Increasingly you may also find music that no human performer sang or played. AI music tools can produce a full track from a sentence like “dreamy synth pop about a night drive.”

AI music: mixing console and headphones in a quiet recording studio

That is exciting for some people and unsettling for others. Both reactions are reasonable. To judge them, it helps to know how these tools work and, in particular, where the music they learn from comes from.

The training data question sits at the centre of the debate, and it will shape which tools survive.

How a song is generated

Generative music systems are trained on large collections of recorded audio, along with descriptions of that audio. The model learns statistical patterns: what a drum groove usually does, how chords tend to move, what a certain genre sounds like. When you type a prompt, it builds new audio that fits those patterns.

Some systems create the instrumental parts and a synthetic voice together. Others generate sheet-music-like data, such as notes and timing, which a separate engine then turns into sound. The output can range from rough sketches to polished tracks, depending on the tool.

Importantly, the model does not store songs like a playlist. Yet researchers and rights holders have raised concern that models can sometimes reproduce parts of what they learned, which is why the origin of the training material matters.

Think of the difference between a musician who has listened to thousands of songs and a photocopier. The ideal system behaves like the first. Critics worry that some behave a little like the second.

Why licensing matters

Recorded music involves several layers of rights. There is the composition, owned by writers and publishers, and the recording, owned by performers and labels. Using someone’s catalogue to train a model touches both.

Some developers train only on music they have licensed or on material from creators who agreed. Others have been accused of using recordings without permission, and legal disputes over this are ongoing. The question of whether training counts as permitted use is not settled everywhere, and the answers may differ between countries.

Courts and lawmakers in several places are examining these questions, and the outcomes will influence how licensing deals are written. Until the rules settle, careful developers tend to favour clear agreements over legal gambles.

For users, this is not an abstract issue. If you use an AI tool to produce background music for a video or a podcast, the terms of the tool decide what you may do with it. Can you monetise it? Is attribution required? Does the platform allow it? A song that is free to make is not always free to use however you wish.

Commercial projects deserve extra care. A brand that publishes a track in an advert wants certainty that no one will later claim part of it, so some companies insist on tools that offer clear written assurances about rights.

AI music: what it means for artists and listeners

Artists have mixed feelings. Some see AI as a tool for sketching ideas, creating demos, or overcoming a blank page. Others worry about income and about systems learning from their work without a share of the benefit. Session musicians and composers of library music, who supply background tracks, may feel the pressure first.

Listeners face a transparency issue. Should streaming services label AI-generated tracks? Platforms are still working out policies on this, including how to deal with spam uploads that flood catalogues. Expect rules to continue evolving.

Quality is another point. AI music can sound impressive at first, but it often lacks the intention behind a human performance: the odd choice, the personal story, the live energy. Many listeners still seek out those qualities.

There are also hybrid uses that sidestep most of the controversy. A producer might use a tool to generate a drum pattern or a chord suggestion, then play and record the real song. In that role the software acts like a very fast sketchbook rather than a replacement for the musician.

What to check before you use it

If you plan to use an AI music tool, read the terms of service before publishing anything. Look for statements about how the model was trained, what rights you receive, and whether commercial use is allowed. Keep records of your prompts and outputs in case a question comes up later.

Avoid prompts that ask the tool to imitate a specific living artist’s voice or copy a known song. Besides the ethical issues, it may cause legal trouble.

Also be wary of services that make sweeping promises about safety without explaining their sources. A vague claim is not a licence.

The technology is moving quickly, and the rules are catching up. The fairest outcome is one where tools are built on properly licensed material and creators are paid when their work powers the machine. That would let AI music grow as a creative option rather than a source of conflict.

If you want to read around the subject, the Wikipedia article on music and artificial intelligence gives a plain overview, and two related pieces on this site are Saying Goodbye to an App: How to Save Your Check-Ins and Social Data and A Healthcare Data Breach Hits the Headlines: What Patients and Investors Should Do.

Until then, a cautious listener can support artists directly by buying music, attending shows, and following creators who explain how they work.

Join the conversation

Your email address will not be published. Required fields are marked *