Deep Learning

Music
A curated list is to gather scientific articles, thesis, and reports that use
deep learning approaches applied to music.

Himanshu Ramchandani
M.Tech | Data Science
Credit:
https://github.com/ybayle/awesome-deep-learning-music

Year Articles, Thesis and Reports Code

1988 Neural net modeling of music No

1988 Creation by refinement: A creativity paradigm for gradient No

descent learning networks

1988 A sequential network design for musical applications No

1989 The representation of pitch in a neural net model of chord No

classification

1989 Algorithms for music composition by neural nets: Improved No

CBR paradigms

1989 A connectionist approach to algorithmic composition No

1994 Neural network music composition by prediction: Exploring the No

benefits of psychoacoustic constraints and multi-scale
processing

1995 Automatic source identification of monophonic musical No

instrument sounds

1995 Neural network based model for classification of music type No

1997 A machine learning approach to musical style recognition No

1998 Recognition of music types No

1999 Musical networks: Parallel distributed perception and No
performance

2001 Multi-phase learning for jazz improvisation and interaction No

2002 A supervised learning approach to musical style recognition No

2002 Finding temporal structure in music: Blues improvisation with No

LSTM recurrent networks

2002 Neural networks for note onset detection in piano music No

2004 A convolutional-kernel based approach for note onset detectio No

in piano-solo audio signals

2009 Unsupervised feature learning for audio classification using No

convolutional deep belief networks

2010 Audio musical genre classification using convolutional neural No

networks and pitch and tempo transformations

2010 Automatic musical pattern feature extraction using convolution No

neural network

2011 Audio-based music classification with a pretrained convolution No

network

2012 Rethinking automatic chord recognition with convolutional No

neural networks

2012 Moving beyond feature design: Deep architectures and No

automatic feature learning in music informatics
2012 Local-feature-map integration using convolutional neural No
networks for music genre classification

2012 Learning sparse feature representations for music annotation No

and retrieval

2012 Unsupervised learning of local features for music classification No

2013 Multiscale approaches to music audio feature learning No

2013 Musical onset detection with convolutional neural networks No

2013 Deep content-based music recommendation No

2014 The munich LSTM-RNN approach to the MediaEval 2014 No

Emotion In Music task

2014 End-to-end learning for music audio No

2014 Deep learning for music genre classification No

2014 Recognition of acoustic events using deep neural networks No

2014 Deep image features in music information retrieval No

2014 From music audio to chord tablature: Teaching deep No

convolutional networks to play guitar

2014 Improved musical onset detection with convolutional neural No

networks

2014 Boundary detection in music structure analysis using No

convolutional neural networks
2014 Improving content-based and hybrid music recommendation No
using deep learning

2014 A deep representation for invariance and music classification No

2015 Auralisation of deep convolutional neural networks: Listening t GitHub

learned features

2015 Downbeat tracking with multiple features and deep neural No

networks

2015 Music boundary detection using neural networks on No

spectrograms and self-similarity lag matrices

2015 Classification of spatial audio location and content using No

convolutional neural networks

2015 Deep learning, audio adversaries, and music content analysis No

2015 Deep learning and music adversaries GitHub

2015 Singing voice detection with deep recurrent neural networks No

2015 Automatic instrument recognition in polyphonic music using No

convolutional neural networks

2015 A software framework for musical data augmentation No

2015 A deep bag-of-features model for music auto-tagging No

2015 Music-noise segmentation in spectrotemporal domain using No

convolutional neural networks
2015 Musical instrument sound classification with deep convolutiona No
neural network using feature fusion approach

2015 Environmental sound classification with convolutional neural No

networks

2015 Exploring data augmentation for improved singing voice GitHub

detection with neural networks

2015 Singer traits identification using deep neural network No

2015 A hybrid recurrent neural network for music transcription No

2015 An end-to-end neural network for polyphonic music transcriptio No

2015 Deep karaoke: Extracting vocals from musical mixtures using No

convolutional deep neural network

2015 Folk music style modelling by recurrent neural networks with GitHub
long short term memory units

2015 Deep neural network based instrument extraction from music No

2015 A deep neural network for modeling music No

2016 An efficient approach for segmentation, feature extraction and No

classification of audio signals

2016 Text-based LSTM networks for automatic music composition No

2016 Towards playlist generation algorithms using RNNs trained on No

within-track transitions
2016 Automatic tagging using deep convolutional neural networks No

2016 Automatic chord estimation on seventhsbass chord vocabular No

using deep neural network

2016 DeepBach: A steerable model for Bach chorales generation GitHub

2016 Bayesian meter tracking on learned signal representations No

2016 Deep learning for music No

2016 Learning temporal features using a deep neural network and i No

application to music genre classification

2016 On the potential of simple framewise approaches to piano No

transcription

2016 Feature learning for chord recognition: The deep chroma GitHub
extractor

2016 A fully convolutional deep auditory model for musical chord No

recognition

2016 A deep bidirectional long short-term memory based multi-scale No

approach for music dynamic emotion prediction

2016 Event localization in music auto-tagging GitHub

2016 Deep convolutional networks on the pitch spiral for musical GitHub
instrument recognition

2016 SampleRNN: An unconditional end-to-end neural audio GitHub

generation model
2016 Robust audio event recognition with 1-max pooling No
convolutional neural networks

2016 Experimenting with musically motivated convolutional neural GitHub

networks

2016 Singing voice melody transcription using deep neural networks No

2016 Singing voice separation using deep neural networks and F0 Website
estimation

2016 Learning to pinpoint singing voice from weakly labeled No

examples

2016 Analysis of time-frequency representations for musical onset No

detection with convolutional neural network

2016 Note onset detection in musical signals via No

neural-network-based multi-ODF fusion

2016 Music transcription modelling and composition using deep GitHub

learning

2016 Convolutional neural network for robust pitch determination No

2016 Deep convolutional neural networks and data augmentation fo Website

acoustic event detection

2017 Gabor frames and deep scattering networks in audio No

processing

2017 Vision-based detection of acoustic timed events: A case study No

on clarinet note onsets
2017 Deep learning techniques for music generation - A survey No

2017 JamBot: Music theory aware chord based generation of GitHub

polyphonic music with LSTMs

2017 XFlow: 1D <-> 2D cross-modal deep neural networks for No

audiovisual classification

2017 Machine listening intelligence No

2017 Monoaural audio source separation using deep convolutional GitHub

neural networks

2017 Deep multimodal network for multi-label classification No

2017 A tutorial on deep learning for music information retrieval GitHub

2017 A comparison on audio signal preprocessing methods for deep GitHub

neural networks on music tagging

2017 Transfer learning for music classification and regression tasks GitHub

2017 Convolutional recurrent neural networks for music classificatio GitHub

2017 An evaluation of convolutional neural networks for music No

classification using spectrograms

2017 Large vocabulary automatic chord estimation using deep neur No

nets: Design framework, system variations and limitations

2017 Basic filters for convolutional neural networks: Training or No

design?
2017 Ensemble Of Deep Neural Networks For Acoustic Scene No
Classification

2017 Robust downbeat tracking using an ensemble of convolutiona No

networks

2017 Music signal processing using vector product neural networks No

2017 Transforming musical signals through a genre classifying No

convolutional neural network

2017 Audio to score matching by combining phonetic and duration GitHub

information

2017 Interactive music generation with positional constraints using No

anticipation-RNNs

2017 Deep rank-based transposition-invariant distances on musical No

sequences

2017 GLSR-VAE: Geodesic latent space regularization for variation No

autoencoder architectures

2017 Deep convolutional neural networks for predominant instrume No

recognition in polyphonic music

2017 CNN architectures for large-scale audio classification No

2017 DeepSheet: A sheet music generator based on deep learning No

2017 Talking Drums: Generating drum grooves with neural networks No

2017 Singing voice separation with deep U-Net convolutional GitHub
networks

2017 Music emotion recognition via end-to-end multimodal neural No

networks

2017 Chord label personalization through deep learning of integrate No

harmonic interval-based representations

2017 End-to-end musical key estimation using a convolutional neura No

network

2017 MediaEval 2017 AcousticBrainz genre task: Multilayer No

perceptron approach

2017 Classification-based singing melody extraction using deep No

convolutional neural networks

2017 Multi-level and multi-scale feature aggregation using pre-traine No

convolutional neural networks for music auto-tagging

2017 Multi-level and multi-scale feature aggregation using GitHub

sample-level deep convolutional neural networks for music
classification

2017 Sample-level deep convolutional neural networks for music No

auto-tagging using raw waveforms

2017 A SeqGAN for Polyphonic Music Generation GitHub

2017 Harmonic and percussive source separation using a No

convolutional auto encoder
2017 Stacked convolutional and recurrent neural networks for music No
emotion recognition

2017 A deep learning approach to source separation and remixing o No

hiphop music

2017 Music Genre Classification Using Masked Conditional Neural No

Networks

2017 Monaural Singing Voice Separation with Skip-Filtering GitHub

Connections and Recurrent Inference of Time-Frequency Mas

2017 Generating data to train convolutional neural networks for GitHub

classical music source separation

2017 Monaural score-informed source separation for classical musi GitHub

using convolutional neural networks

2017 Multi-label music genre classification from audio, text, and GitHub
images using deep features

2017 A deep multimodal approach for cold-start music GitHub

recommendation

2017 Melody extraction and detection through LSTM-RNN with No

harmonic sum loss

2017 Representation learning of music using artist labels No

2017 Toward inverse control of physics-based sound synthesis Website

2017 DNN and CNN with weighted and multi-task loss functions for No
audio event detection
2017 Score-informed syllable segmentation for a cappella singing GitHub
voice with convolutional neural networks

2017 End-to-end learning for music audio tagging at scale GitHub

2017 Designing efficient architectures for modeling temporal feature GitHub

with convolutional neural networks

2017 Timbre analysis of music audio signals with convolutional neu GitHub
networks

2017 Deep learning and intelligent audio mixing No

2017 Deep learning for event detection, sequence labelling and No

similarity estimation in music signals

2017 Music feature maps with convolutional neural networks for No

music genre classification

2017 Automatic drum transcription for polyphonic recordings using GitHub

soft attention mechanisms and convolutional neural networks

2017 Adversarial semi-supervised audio source separation applied No

singing voice extraction

2017 Taking the models back to music practice: Evaluating GitHub

generative transcription models built using deep learning

2017 Generating nontrivial melodies for music as a service No

2017 Invariances and data augmentation for supervised music GitHub

transcription
2017 Lyrics-based music genre classification using a hierarchical GitHub
attention network

2017 A hybrid DSP/deep learning approach to real-time full-band GitHub

speech enhancement

2017 Convolutional methods for music analysis No

2017 Extending temporal feature integration for semantic audio No

analysis

2017 Recognition and retrieval of sound events using sparse coding No

convolutional neural network

2017 A two-stage approach to note-level transcription of a specific No

piano

2017 Reducing model complexity for DNN based large-scale audio No

classification

2017 Audio spectrogram representations for processing with Website

convolutional neural networks

2017 Unsupervised feature learning based on deep models for No

environmental audio tagging

2017 Attention and localization based on a deep convolutional GitHub

recurrent model for weakly supervised audio tagging

2017 Surrey-CVSSP system for DCASE2017 challenge task4 GitHub

2017 A study on LSTM networks for polyphonic music sequence Website

modelling
 2018 MuseGAN: Multi-track sequential generative adversarial GitHub
networks for symbolic music generation and accompaniment

2018 Music transformer: Generating music with long-term structure No

2018 Music theory inspired policy gradient method for piano music No
transcription

2019 Enabling factorized piano music modeling and generation with GitHub
the MAESTRO dataset

2019 Generating Long Sequences with Sparse Transformers GitHub

Credit:
https://github.com/ybayle/awesome-deep-learning-music
Data Science ML Full Stack Roadmap
https://github.com/hemansnation/Data-Science-ML-Full-Stack-2022

Join the Data Science & ML Full Stack WhatsApp Group Community here:
If the group is full, please join another one.

https://chat.whatsapp.com/B7Mdp6QTMJ0KZYGWrziT3Y

https://chat.whatsapp.com/HWDSJU4KXrXJIcn5Npp3Gm

https://chat.whatsapp.com/DmATV5uaVY7IKrTMHDiHnr

https://chat.whatsapp.com/Blz2n8QYSgdKWfQbJZxHtJ

Join Telegram for Data Science ML AI Resources:

https://t.me/+sREuRiFssMo4YWJl

Connect with me on these platforms:

LinkedIn: https://www.linkedin.com/in/hemansnation/

Twitter: https://twitter.com/hemansnation

GitHub: https://github.com/hemansnation

Instagram: https://www.instagram.com/masterdexter.ai/

Are you a professional?

DM for One-on-One sessions for Python, Data Science, Machine Learning,
and Data Engineering.
Here: https://bit.ly/3U6zQvQ