From Audio to Symbolic Encoding
Automatic music transcription (AMT) aims to convert raw audio to symbolic music representation. As a fundamental problem of music information retrieval (MIR), AMT is considered a difficult task even for trained human experts due to overlap of multiple harmonics in the acoustic signal. On the other hand, speech recognition, as one of the most popular tasks in natural language processing, aims to translate human spoken language to texts. Based on the similar nature of AMT and speech recognition (as they both deal with tasks of translating audio signal to symbolic encoding), this paper investigated whether a generic neural network architecture could possibly work on both tasks. In this paper, we introduced our new neural network architecture built on top of the current state-of-the-art Onsets and Frames, and compared the performances of its multiple variations on AMT task. We also tested our architecture with the task of speech recognition. For AMT, our models were able to produce better results compared to the model trained using the state-of-art architecture; however, although similar architecture was able to be trained on the speech recognition task, it did not generate very ideal result compared to other task-specific models.
Code (0)
등록된 구현이 없습니다.
Tasks
Information RetrievalMusic Information RetrievalMusic TranscriptionRetrievalspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Barwise Section Boundary Detection in Symbolic Music Using Convolutional Neural Networks
Current methods for Music Structure Analysis (MSA) focus primarily on audio data. While symbolic music can be synthesized into audio and analyzed using existing MSA techniques, such an approach does not exploit symbolic …
Boundary DetectionMusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training
Symbolic music understanding, which refers to the understanding of music from the symbolic data (e.g., MIDI format, but not audio), covers many music applications such as genre classification, emotion classification, and…
ClassificationEmotion ClassificationGenre classificationRepresentation LearningA Semantic Framework for Neuro-Symbolic Computing
The field of neuro-symbolic AI aims to benefit from the combination of neural networks and symbolic systems. A cornerstone of the field is the translation or encoding of symbolic knowledge into neural networks. Although …
Frechet Music Distance: A Metric For Generative Symbolic Music Evaluation
In this paper we introduce the Frechet Music Distance (FMD), a novel evaluation metric for generative symbolic music models, inspired by the Frechet Inception Distance (FID) in computer vision and Frechet Audio Distance …
FADMusic GenerationMusic ModelingConditioning Deep Generative Raw Audio Models for Structured Automatic Music
Existing automatic music generation approaches that feature deep learning can be broadly classified into two types: raw audio models and symbolic models. Symbolic models, which train and generate at the note level, are c…
Music Generation