Couverture musique

My first AI-assisted music creation

Discover my recipe for composing your own soundtracks, even without being a musician or an expert in artificial intelligence.

Growing up, we all wanted to learn to play a musical instrument at some point, whether it was the piano, violin, guitar, drums or saxophone.

But I was never good at any of these instruments.

Playing a musical instrument and creating my own songs remained a dream for me until artificial intelligence became available to the general public. The generation of images, texts and music has now become commonplace.

While surfing, I discovered AIVA, a company that uses machine learning technology to create songs. During the holidays, I created 12 musical compositions from scratch. The result of the AI is amazing!

Check out ‘Initiation’:

Soundtrack composed by AIVA (Artificial Intelligence Virtual Artist): https://www.aiva.ai

The 12 tracks :

1. The ordinary world: 00:00:00

2. The call: 00:02:02

3. The refusal: 00:04:42

4. Meeting: 00:07:24

5. Crossing: 00:09:54

6. New world: 00:12:51

7. The approach: 00:15:40

8. The battle: 00:18:39

9. The victory: 00:21:48

10. The last mission: 00:24:25

11. The resurrection: 00:27:38

12. The transformation: 00:30:55

1. The ordinary world composed by aiva.ai

2. The call composed by aiva.ai

3. The refusal composed by aiva.ai

4. Meeting composed by aiva.ai

5. Crossing composed by aiva.ai

6. New world composed by aiva.ai

7. The approach composed by aiva.ai

8. The battle composed by aiva.ai

9. The victory composed by aiva.ai

10. The last mission composed by aiva.ai

11. The resurrection composed by aiva.ai

12. The transformation composed by aiva.ai

My choices

The 12 musical compositions

They are based on the 12 stages of the « Hero’s Journey », a concept established by Joseph Campbell. This is a mainly interesting basis for building the hero’s initiatory journey. This pattern is found in many stories from all over the world, in particular, in literary works and the film industry.

Schematically, the hero experiences the following sequences:

  1. The hero is in an ordinary world
  2. The hero is called to adventure, which is presented as a problem or a challenge.
  3. The hero is initially reluctant, afraid of the unknown.
  4. The hero is encouraged by a mentor. Sometimes the mentor also gives a magic weapon, but does not accompany the hero, who has to face the challenges alone.
  5. The hero crosses the ‘threshold’ of the adventure, he enters an extraordinary world, he cannot turn back.
  6. The hero undergoes trials, meets allies and enemies.
  7. The hero reaches the most dangerous place, often deep inside, where the object of his quest is hidden.
  8. The hero undergoes the ultimate test, facing death.
  9. The hero takes the object of his quest.
  10. The hero takes the road back, where sometimes it is still a question of escaping the vengeance of those from whom the object has been stolen.
  11. The hero returns from the extraordinary world where he had ventured, transformed by the experience.
  12. The hero returns to the ordinary world and uses the object of the quest to improve the world, thus giving meaning to the adventure

The emotions

I decided to associate each of these stages with a main emotion, using Robert Plutchik’s emotion wheel.

I then linked the emotions to a music key, thanks to some nuggets discovered by chance on the internet (https://ledgernote.com/blog/interesting/musical-key-characteristics-emotions/):

MUSICAL KEYEMOTIVE EXPRESSION
A MAJORJoyful, Pastoral, Declaration of Love
A MINORTender, Plaintive, Pious
AB MAJORDeath, Eternity, Judgement
AB MINORGrumbling, Moaning, Wailing
B MAJORHarsh, Strong, Wild, Rage
B MINORSolitary, Melancholic, Patience
BB MAJORJoyful, Quaint, Cheerful
BB MINORTerrible, the Night, Mocking
C MAJORInnocently Happy
C MINORInnocently Sad, Love-Sick
C# MINORDespair, Wailing, Weeping
DB MAJORGrief, Depressive
D MAJORTriumphant, Victorious War-Cries
D MINORSerious, Pious, Ruminating
D# MINORDeep Distress, Existential Angst
E MAJORQuarrelsome, Boisterous, Incomplete Pleasure
E MINOREffeminate, Amorous, Restless
EB MAJORCruel, Hard, Yet Full of Devotion
F MAJORFurious, Quick-Tempered, Passing Regret
F MINORObscure, Plaintive, Funereal
F# MAJORConquering Difficulties, Sighs of Relief
F# MINORGloomy, Passionate Resentment
G MAJORSerious, Magnificent, Fantasy
G MINORDiscontent, Uneasiness

The instrumentations

AIVA offers more than thirty different instrumentations, such as Electronic, Pop, Ambient, Rock, Fantasy, Jazz, Sea Song, Tango…

From the key and the instrumentation, let’s go for the generation of compositions directly with AIVA. Generating, listening, discarding, retaining, … this is the longest part of the work.

Which can be accompanied by some improvements: adjusting the BPM (beats per minute), deleting an introduction that is a bit long or lengthening a piece that is a bit short by generating new sequences, we are clearly in the finishing touches!

The last piece didn’t suit me. I wanted a ‘jazz’ atmosphere but Aiva’s suggestions were too cartoonish. I decided to import a track I love (GoGo Penguin), to force the composition from that specific influence. Artificial intelligence works wonders!
You get an original composition, even from a well-known track. And for the finishing touches, I replaced some of the instruments that were proposed by Aiva. For the melody, I tested the tuba, the bassoon and finally chose the cello.

BPMAtmosphère (https://abbeyroadinstitute.nl/blog/emotion-in-music-part-ii-a-practical-approach/)
60 – 80 relaxing, introspective, even depressive, but also loving and less dramatic.
80 – 100moderately alert and engaging, feelings of accomplishment, rewarding, and sometimes also relaxing.
100 – 120lively, exciting or agitated situations, feelings of power.
120+ high energy situations, feelings of excitement, anger or drama.

Note: I also used Audacity to record the 12 tracks on a single track and Auphonic to equalise/enhance the whole.

The cover

Did I tell you that the cover was made with Craiyon, an artificial intelligence for the graphics?

Couverture musique
IMAGE COMPOSED BY CRAIYON.COM

To get this image (after multiple attempts and text modifications), here is the text I typed: high definition rainbow webtoon image of a person about to live a voyage of initiation.

Music and creativity

Countless studies have looked at how music affects our creativity; a positive state of mind, relaxation, inspiration and a little bit of concentration.

It’s up to you!