paper-with-me

홈 › Papers

Statistical Learning and Estimation of Piano Fingering

2019-04-23 · Eita Nakamura, Yasuyuki Saito, Kazuyoshi Yoshii

Automatic estimation of piano fingering is important for understanding the computational process of music performance and applicable to performance assistance and education systems. While a natural way to formulate the quality of fingerings is to construct models of the constraints/costs of performance, it is generally difficult to find appropriate parameter values for these models. Here we study an alternative data-driven approach based on statistical modeling in which the appropriateness of a given fingering is described by probabilities. Specifically, we construct two types of hidden Markov models (HMMs) and their higher-order extensions. We also study deep neural network (DNN)-based methods for comparison. Using a newly released dataset of fingering annotations, we conduct systematic evaluations of these models as well as a representative constraint-based method. We find that the methods based on high-order HMMs outperform the other methods in terms of estimation accuracies. We also quantitatively study individual difference of fingering and propose evaluation measures that can be used with multiple ground truth data. We conclude that the HMM-based methods are currently state of the art and generate acceptable fingerings in most parts and that they have certain limitations such as ignorance of phrase boundaries and interdependence of the two hands.

📄 PDF Abstract BibTeX arXiv:1904.10237

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

PianoVAM: A Multimodal Piano Performance Dataset

2025-09-10 · Yonghyun Kim, Junhyung Park, Joonhyung Bae, Kirak Kim 외 arxiv

The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introduces PianoVAM, a comprehensive piano perf…

Information RetrievalHand Pose Estimation

At Your Fingertips: Automatic Piano Fingering Detection

2019-09-25 · Amit Moryossef, Yanai Elazar, Yoav Goldberg

Automatic Piano Fingering is a hard task which computers can learn using data. As data collection is hard and expensive, we propose to automate this process by automatically extracting fingerings from public videos and M…

Generative Adversarial Network

At Your Fingertips: Extracting Piano Fingering Instructions from Videos

2023-03-07 · Amit Moryossef, Yanai Elazar, Yoav Goldberg

Piano fingering -- knowing which finger to use to play each note in a musical piece, is a hard and important skill to master when learning to play the piano. While some sheet music is available with expert-annotated fing…

Tipiano: Cascaded Piano Hand Motion Synthesis via Fingertip Priors

2026-04-06 · Joonhyung Bae, Kirak Kim, Hyeyoon Cho, Sein Lee 외 arxiv

Synthesizing realistic piano hand motions requires both precision and naturalness. Physics-based methods achieve precision but produce stiff motions; data-driven models learn natural dynamics but struggle with positional…

Motion Synthesis

Two Web Toolkits for Multimodal Piano Performance Dataset Acquisition and Fingering Annotation

2025-09-18 · Junhyung Park, Yonghyun Kim, Joonhyung Bae, Kirak Kim 외 arxiv

Piano performance is a multimodal activity that intrinsically combines physical actions with the acoustic rendition. Despite growing research interest in analyzing the multimodal nature of piano performance, the laboriou…