paper-with-me

Papers

D3RM: A Discrete Denoising Diffusion Refinement Model for Piano Transcription

2025-01-09 · Hounsu Kim, Taegyun Kwon, Juhan Nam

Diffusion models have been widely used in the generative domain due to their convincing performance in modeling complex data distributions. Moreover, they have shown competitive results on discriminative tasks, such as image segmentation. While diffusion models have also been explored for automatic music transcription, their performance has yet to reach a competitive level. In this paper, we focus on discrete diffusion model's refinement capabilities and present a novel architecture for piano transcription. Our model utilizes Neighborhood Attention layers as the denoising module, gradually predicting the target high-resolution piano roll, conditioned on the finetuned features of a pretrained acoustic model. To further enhance refinement, we devise a novel strategy which applies distinct transition states during training and inference stage of discrete diffusion models. Experiments on the MAESTRO dataset show that our approach outperforms previous diffusion-based piano transcription models and the baseline model in terms of F1 score. Our code is available in https://github.com/hanshounsu/d3rm.

📄 PDF Abstract BibTeX arXiv:2501.05068

Code (1)

hanshounsu/d3rm 공식 구현 pytorch

Tasks

DenoisingImage SegmentationMusic TranscriptionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Neighborhood Attention Neighborhood Attention is a restricted self attention pattern in which each token's receptive field is limited to its nearest neighboring pixels. It was proposed in [Neighborhood…
Focus 설명 없음

Similar Papers 제목 키워드 기반

D3PIA: A Discrete Denoising Diffusion Model for Piano Accompaniment Generation From Lead sheet

2026-02-03 · Eunjin Choi, Hounsu Kim, Hayeon Bang, Taegyun Kwon 외 arxiv

Generating piano accompaniments in the symbolic music domain is a challenging task that requires producing a complete piece of piano music from given melody and chord constraints, such as those provided by a lead sheet. …

Unsupervised Transcription of Piano Music

2014-12-01 · NeurIPS 2014 12 · Taylor Berg-Kirkpatrick, Jacob Andreas, Dan Klein

We present a new probabilistic model for transcribing piano music from audio to a symbolic form. Our model reflects the process by which discrete musical events give rise to acoustic signals that are then superimposed to…

Nonlinear Denoising, Linear Demixing

2021-09-22 · NeurIPS Workshop ICBINB 2021 12 · Rainer Kelz, Gerhard Widmer

We cast the combinatorial problem of polyphonic piano transcription as a two stage process. A nonlinear denoising stage maps spectrogram representations of arbitrary piano music with unknown timbral characteristics onto …

Denoising

PianoCoRe: Combined and Refined Piano MIDI Dataset

2026-05-07 · Ilya Borovik arxiv

Symbolic music datasets with matched scores and performances are essential for many music information retrieval (MIR) tasks. Yet, existing resources often cover a narrow range of composers, lack performance variety, omit…

Information Retrieval

PANDORA: Diffusion Policy Learning for Dexterous Robotic Piano Playing

2025-03-17 · Yanjia Huang, Renjie Li, Zhengzhong Tu

We present PANDORA, a novel diffusion-based policy learning framework designed specifically for dexterous robotic piano performance. Our approach employs a conditional U-Net architecture enhanced with FiLM-based global c…

DenoisingLanguage ModelingLanguage ModellingLarge Language Model