music-generator

KO | EN

gitlite — search

#typescript #ai-agents #ai #dsh-plugin #deepseek-harness #open-source #cli #claude-code #codex #developer-tools #react #windows

music-generator

★ 44 Open GitHub ↗

Multi-Instrument music generation using C-RNN-GAN with MIDI format input 🎼

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Contributors][contributors-shield]][contributors-url]
[![Forks][forks-shield]][forks-url]
[![Stargazers][stars-shield]][stars-url]
[![Issues][issues-shield]][issues-url]
[![MIT License][license-shield]][license-url]

<div align="center">

<h3 align="center">music-generator</h3>

Multi-Instrument music generation using C-RNN-GAN with MIDI format input
 
 <a href="https://github.com/seyedsaleh/music-generator">Explore the docs »</a>
 
 
 <a href="https://colab.research.google.com/drive/1T7FZd5krcsOHAki55z0GL2jeNbS7GuTq?usp=sharing">Demo Music Generation (Google Colab)</a>
 ·
 <a href="https://colab.research.google.com/drive/1bxy2XzbMsUhgLSDcQH_ElKL7K-dGGjD-?usp=sharing">Demo Multi-Instrument Music Generation (Google Colab)</a>
 .
 <a href="https://github.com/seyedsaleh/music-generator/issues">Report Bug & Request Feature</a>
 
</div>

<details>
 <summary>Table of Contents</summary> 
 <ol>
 <li>
 <a href="#about-the-project">About The Project</a>
 <ul>
 <li><a href="#built-with">Built With</a></li>
 </ul>
 </li>
 <li><a href="#parts">Parts</a></li>
 <li><a href="#results">Results</a></li>
 <li><a href="#license">License</a></li>
 <li><a href="#datasets">Datasets</a></li>
 <li><a href="#refereces">Refereces</a></li>
 <li><a href="#contact">Contact</a></li>
 <li><a href="#roadmap">Roadmap</a></li>
 </ol>
</details>

## About The Project

<img src="https://user-images.githubusercontent.com/47852354/141186269-d31ec094-8061-4edc-b862-8e1deb3da46f.png" width="600"> Generative adversarial networks have been proposed as a way of efficiently training deep generative neural networks. We propose a generative adversarial model that works on continuous sequential data, and apply it by training it on a collection of classical music. We conclude that it generates music that sounds better and better as the model is trained, report statistics on generated music, and let the reader judge the quality by downloading the generated songs.

Recently, generative neural networks have taken the stage for artistic pursuits, such as image generation and photo retouching. Another area where these deep learning networks are beginning to leave a mark is in music generation. In this project, our goal is to explore the use of **LSTM** and **GAN neural networks** to generate music that seems as if it were human-made.
By treating the notes and chords within **MIDI** files as discrete sequential data, we were able to train these two models and use them to generate completely new MIDI files.

Listen to our results! :smile:

(<a href="#top">back to top</a>)

### Built With

Major frameworks/libraries used to this project:

* [Python 3.8](https://www.python.org/)
* [Tensorflow , Keras](https://www.tensorflow.org/)
* [Midi2audio](https://github.com/bzamecnik/midi2audio)
* [Music21](https://web.mit.edu/music21/)
* [Numpy](https://numpy.org/)

(<a href="#top">back to top</a>)

## Parts

**MIDI format**
an acronym for Musical Instrument Digital Interface, a technical standard that describes a communications protocol, digital interface, and electrical connectors that connect a wide variety of electronic musical instruments, computers.

**Music21** is a powerful library in python whose tools are very helpful for creating, analysis and processing of audio files like songs, melodies and etc..
In this project, we have used this library for our purposes of converting the MIDI files into notes, categorizing of notes for preparing the training data, and choosing the playing instruments for the output of our GAN and converting it back to MIDI.

**MIDI Class:**
- Parser
- sequence preparation
- MIDI creation

**Parsing MIDI file and preparing the training data and preparing data for C-RNN-GAN network**
 <img src="https://user-images.githubusercontent.com/47852354/141293958-b829dce5-64e2-439b-b45b-4667608d13b6.png" width="650">

**Model Class:**
- Discriminator
- Generator
- Train
- Plot loss function
- Save model

**Generative Adversarial Network (GAN) vs. LSTM**
 <img src="https://user-images.githubusercontent.com/47852354/141293644-9504c1c3-1713-4533-a91d-8e4637edd961.png" width="350">
<img src="https://user-images.githubusercontent.com/47852354/141293667-67f8be01-d6ad-4a91-8058-bb928048a771.png" width="250">

**C-RNN-GAN Network Structure**
 <img src="https://user-images.githubusercontent.com/47852354/141293801-1402eb14-6e05-4ff4-a2eb-5af0abcbf239.png" width="400">

The project has been done with aid of GPU Computing and the use of NVIDIA cuDNN and NVIDIA CUDA Toolkit. It helped us to use Tensorflow with GPU support for computing and learning with more compatibility.
The model has been trained on an **NVIDIA GeForce GTX 1080Ti GPU**.
**CUDA** is a parallel computing platform interface that allows software developers to use GPUs for ML computing.

(<a href="#top">back to top</a>)

## Results
 <img src="https://user-images.githubusercontent.com/47852354/141289514-87b11009-2835-407f-8cf3-dc99ed860811.png" width="300">

https://user-images.githubusercontent.com/47852354/141285440-be56d13f-abb4-4956-9ae3-c6845ed1fd12.mov

https://user-images.githubusercontent.com/47852354/141285431-a525b350-857f-470a-9465-7935a80a06d6.mov

(<a href="#top">back to top</a>)

## License

Distributed under the MIT License. See `LICENSE.txt` for more information.

(<a href="#top">back to top</a>)

## Datasets

<ol>
 <li>
 GiantMIDI-Piano is a classical piano MIDI dataset contains 10,854 MIDI files of 2,786 composers. The curated subset by constraining composer surnames contains 7,236 MIDI files of 1,787 composers. GiantMIDI-Piano are transcribed from live recordings with a high-resolution piano transcription system. <a href="https://github.com/bytedance/GiantMIDI-Piano">find out more on Github</a>
 <ul>
 <li>Qiuqiang Kong, Bochen Li, Jitong Chen, and Yuxuan Wang. "GiantMIDI-Piano: A large-scale MIDI dataset for classical piano music." arXiv preprint arXiv:2010.07061 (2020). https://arxiv.org/pdf/2010.07061</li>
 </ul>
 </li>
 <li>Persian MIDI Dataset</li>
 <li>The Lakh MIDI Dataset</li>
 </ol>

(<a href="#top">back to top</a>)

## Refereces

[1] *Mogren, Olof. (2016). C-RNN-GAN: Continuous recurrent neural networks with adversarial training. [arXiv:1611.09904](https://arxiv.org/abs/1611.09904).*

[2] *“Generating Music with GANs—An Overview and Case Studies” at ISMIR 2019 (November 4th at Delft, The Netherlands). [salu133445.github.io/ismir2019tutorial](https://salu133445.github.io/ismir2019tutorial/).*

[3] *Goodfellow, Ian & Pouget-Abadie, Jean & Mirza, Mehdi & Xu, Bing & Warde-Farley, David & Ozair, Sherjil & Courville, Aaron & Bengio, Y.. (2014). Generative Adversarial Nets.  [ArXiv](https://arxiv.org/abs/1406.2661).*

(<a href="#top">back to top</a>)

## Contact

Seyedmohammadsaleh Mirzatabatabaei - [@seyedsaleh](https://github.com/seyedsaleh) - seyedsaleh.edu@gmail.com

Salman Amimotlagh - [@SMotlaq](https://github.com/SMotlaq) - pilot.motlaq@gmail.com

Project Link: [https://github.com/seyedsaleh/music-generator](https://github.com/seyedsaleh/music-generator)

(<a href="#top">back to top</a>)

## Roadmap

- [x] Multi-instrument by partitioning and joining each part (Music21 Instrument package)
- [ ] Use offset, duration, velocity with pyPianoroll package
- [ ] UI mobile and desktop application to create music
- [ ] using CGANs network to avoid falchs

See the [open issues](https://github.com/seyedsaleh/music-generator/issues) for a full list of proposed features (and known issues).

(<a href="#top">back to top</a>)

---
<div align="center">

 <img src="https://user-images.githubusercontent.com/47852354/138564509-b5dffb4e-f48b-4db5-b8a4-1385ef2b22c8.png" width="110">
 <img src="https://user-images.githubusercontent.com/47852354/138607395-e18bfc7a-204c-495a-914f-bd5cf8436ca4.jpg" width="70">

</div>

[contributors-shield]: https://img.shields.io/github/contributors/seyedsaleh/music-generator.svg?style=for-the-badge
[contributors-url]: https://github.com/seyedsaleh/music-generator/graphs/contributors
[forks-shield]: https://img.shields.io/github/forks/seyedsaleh/music-generator.svg?style=for-the-badge
[forks-url]: https://github.com/seyedsaleh/music-generator/network/members
[stars-shield]: https://img.shields.io/github/stars/seyedsaleh/music-generator.svg?style=for-the-badge
[stars-url]: https://github.com/seyedsaleh/music-generator/stargazers
[issues-shield]: https://img.shields.io/github/issues/seyedsaleh/music-generator.svg?style=for-the-badge
[issues-url]: https://github.com/seyedsaleh/music-generator/issues
[license-shield]: https://img.shields.io/github/license/seyedsaleh/music-generator.svg?style=for-the-badge
[license-url]: https://github.com/seyedsaleh/music-generator/blob/master/LICENSE.txt

music-generator

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README