My Expedition to Machine-Generated Music Using Tensorflow Magenta Part 1: Linkin Park

in #utopian-io2 years ago (edited)

Repository

https://github.com/tensorflow/magenta

Introduction

Linkin Park fans cannot forget their music. Sadly, we cannot hear it again, because of the death of the late Chester Bennington. Although replicating his voice is unfortunately impossible based on current technology, replicating all the other instruments are possible.
I have tried using two NVIDIA Tesla V100 16GB SXM2 GPUs and the MusicVAE model (https://magenta.tensorflow.org/music-vae) to generate music based on MIDI files of songs from the albums of Linkin Park.

This is a blog post in the format of project promotion post, supported by Utopian.io.

Post Body

image.png
Can we forget him? No.
image.png
Can we forget them? No.

I became a fan of Linkin Park a bit before his death. That was when I was starting to listen to a lot of music. I didn't before. And it was shocking to see him go months into Linkin Park.

Because of this, when I found out about the Magenta project while I was working on a programming project related to music, I thought instantly of Linkin Park. If I could replicate their Nu-metal music using Magenta.

I took no time wasted and immediately trained around 15 Linkin Park Midi files, composed of songs that are in the nu-metal albums Hybrid Theory and Meteora. This Link is the downloadable .tfrecord file generated using This Manual.

Refer to Training Your Own MusicVAE for how you can train yourself. I have used the hierdec-trio_16bar config and you will want to use the same if you are working on replicating popular music or band music like me. You can also generate piano music like Bach with the Performance RNN Model in the same package.

It took me about a week on one Tesla V100 GPU for 200k steps, in a batch size of 32.

Generation was done using This Command. Five samples were generated.

image.png
image.png
image.png
image.png
image.png

The results were not impressive. Because of overfitting, the sounds resembled one specific song in one of the Linkin Park's nu-metal albums. The results are available Here. (Quiz: What is the song?)

In my next post, I will address the expansion of data trained to create actual original music that replicates Linkin Park. This one is gonna be actually good. Please look forward to it!

Although I think my first test was unsuccessful, please rate the generated music and how you think about it!

If you want to generate new music using this trained model, Download the Checkpoint from Here and use Tensorflow Magenta to generate using This Command.

Resources

MusicVAE model (https://magenta.tensorflow.org/music-vae) in Tensorflow Magenta (https://github.com/tensorflow/magenta)
FreeMidi.org (https://freemidi.org/)
FLAC Synthesizer by Musescore (https://musescore.com/ or https://github.com/musescore/MuseScore)

Series Backlinks

This is the first post of a series of blog posts on Machine-Generated Music. The collection of posts will expand based on new selections on genres and music artists or bands.

Sort:  

Thanks for sharing this information about the Tensorflow Magenta project. Even though I am not proficient in the field, I think it is a fascinating stuff.

That said, I would have appreciated a more comprehensive post. The project is wide, and there should be extensive information to share about it.

Moreover, the qualities of a good blog post depend on volume, structure, and the editorial content of the post. Considering all these, I think you need to improve the volume and the editorial part of your future posts. If you want your readers to get the information you are sharing, make it descriptive.

Thank you. I hope to receive better contributions from you!

Your contribution has been evaluated according to Utopian policies and guidelines, as well as a predefined set of questions pertaining to the category.

To view those questions and the relevant answers related to your post, click here.


Need help? Chat with us on Discord.

[utopian-moderator]

Thank you for your review, @tykee! Keep up the good work!

Hi @ehf!

Your post was upvoted by @steem-ua, new Steem dApp, using UserAuthority for algorithmic post curation!
Your post is eligible for our upvote, thanks to our collaboration with @utopian-io!
Feel free to join our @steem-ua Discord server

Congratulations! This post has been upvoted from the communal account, @minnowsupport, by ehf from the Minnow Support Project. It's a witness project run by aggroed, ausbitbank, teamsteem, someguy123, neoxian, followbtcnews, and netuoso. The goal is to help Steemit grow by supporting Minnows. Please find us at the Peace, Abundance, and Liberty Network (PALnet) Discord Channel. It's a completely public and open space to all members of the Steemit community who voluntarily choose to be there.

If you would like to delegate to the Minnow Support Project you can do so by clicking on the following links: 50SP, 100SP, 250SP, 500SP, 1000SP, 5000SP.
Be sure to leave at least 50SP undelegated on your account.

Hello, as a member of @steemdunk you have received a free courtesy boost! Steemdunk is an automated curation platform that is easy to use and built for the community. Join us at https://steemdunk.xyz

Upvote this comment to support the bot and increase your future rewards!

Hey, @ehf!

Thanks for contributing on Utopian.
We’re already looking forward to your next contribution!

Get higher incentives and support Utopian.io!
Simply set @utopian.pay as a 5% (or higher) payout beneficiary on your contribution post (via SteemPlus or Steeditor).

Want to chat? Join us on Discord https://discord.gg/h52nFrV.

Vote for Utopian Witness!