paper-with-me

홈 › Papers

Polyphonic Piano Music Transcription System Exploiting Mutual Correlations of Different Musical Note States

2024-07-08 · IEEE Access 2024 7 · Taehyeon Kim, Donghyeon Lee, Man-Je Kim, Chang Wook Ahn

Generally, polyphonic piano music transcription systems are designed to estimate and determine pitch activities along with various note states for each audio frame. While the music transcription system has multiple uses in the Music Information Retrieval (MIR) field, due to the complicated structures of the note events, precisely predicting various note states is still regarded as a challenging task. Accordingly, approaches to designing neural network architectures have evolved to facilitate the joint prediction of each note state. However, recent models have not been able to efficiently exploit mutual correlations among different note states. The key contribution of our work is that we verified mutual correlations between the different note states and reflected them in the model architecture. It enables the transcription system to recognize clearer note events and produce high-quality real-world results. We propose a kernel-sharing feature extractor module for exploiting those mutual correlations in the feature extraction step. Moreover, to make a system recognize the shape of the pitch envelope, we added some connections between the note state-specific detector modules in the note state detection step. The efficacy of our architecture was thoroughly validated in a series of experiments using the publicly available MAESTRO datasets proposed by Google Magenta. Furthermore, ablation studies are performed to demonstrate notions of those mutual correlations and show the impact and significance of the suggested approach.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Information RetrievalMusic Information RetrievalMusic Transcription

Similar Papers 제목 키워드 기반

Modeling Temporal Dependencies in High-Dimensional Sequences: Application to Polyphonic Music Generation and Transcription

2012-06-27 · Nicolas Boulanger-Lewandowski, Yoshua Bengio, Pascal Vincent

We investigate the problem of modeling symbolic sequences of polyphonic music in a completely general piano-roll representation. We introduce a probabilistic model based on distribution estimators conditioned on a recurr…

Language ModelingLanguage ModellingMusic GenerationMusic Modeling

Nonlinear Denoising, Linear Demixing

2021-09-22 · NeurIPS Workshop ICBINB 2021 12 · Rainer Kelz, Gerhard Widmer

We cast the combinatorial problem of polyphonic piano transcription as a two stage process. A nonlinear denoising stage maps spectrogram representations of arbitrary piano music with unknown timbral characteristics onto …

Denoising

An End-to-End Neural Network for Polyphonic Piano Music Transcription

2015-08-07 · Siddharth Sigtia, Emmanouil Benetos, Simon Dixon

We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music languag…

Language ModelingLanguage ModellingMusic Transcriptionspeech-recognition+1

Rhythm Transcription of Polyphonic Piano Music Based on Merged-Output HMM for Multiple Voices

2017-01-29 · Eita Nakamura, Kazuyoshi Yoshii, Shigeki Sagayama

In a recent conference paper, we have reported a rhythm transcription method based on a merged-output hidden Markov model (HMM) that explicitly describes the multiple-voice structure of polyphonic music. This model solve…

Rhythmvalid

PIANOTREE VAE: Structured Representation Learning for Polyphonic Music

2020-08-17 · Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang 외

The dominant approach for music representation learning involves the deep unsupervised model family variational autoencoder (VAE). However, most, if not all, viable attempts on this problem have largely been limited to m…

Music GenerationRepresentation Learning