paper-with-me

홈 › Papers

If Turing played piano with an artificial partner

2024-02-09 · Dobromir Dotov, Dante Camarena, Zack Harris, Joanna Spyra, Pietro Gagliano, Laurel Trainor

Music is an inherently social activity that allows people to share experiences and feel connected with one another. There has been little progress in designing artificial partners exhibiting a similar social experience as playing with another person. Neural network architectures that implement generative models, such as large language models, are suited for producing musical scores. Playing music socially, however, involves more than playing a score; it must complement the other musicians' ideas and keep time correctly. We addressed the question of whether a convincing social experience is made possible by a generative model trained to produce musical scores, not necessarily optimized for synchronization and continuation. The network, a variational autoencoder trained on a large corpus of digital scores, was adapted for a timed call-and-response task with a human partner. Participants played piano with a human or artificial partner-in various configurations-and rated the performance quality and first-person experience of self-other integration. Overall, the artificial partners held promise but were rated lower than human partners. The artificial partner with simplest design and highest similarity parameter was not rated differently from the human partners on some measures, suggesting that interactive rather than generative sophistication is important in enabling social AI.

📄 PDF Abstract BibTeX arXiv:2402.08690

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

At Your Fingertips: Extracting Piano Fingering Instructions from Videos

2023-03-07 · Amit Moryossef, Yanai Elazar, Yoav Goldberg

Piano fingering -- knowing which finger to use to play each note in a musical piece, is a hard and important skill to master when learning to play the piano. While some sheet music is available with expert-annotated fing…

PianoMotion10M: Dataset and Benchmark for Hand Motion Generation in Piano Performance

2024-06-13 · Qijun Gan, Song Wang, Shengtao Wu, Jianke Zhu

Recently, artificial intelligence techniques for education have been received increasing attentions, while it still remains an open problem to design the effective music instrument instructing systems. Although key press…

Motion GenerationPosition

Piano Timbre Development Analysis using Machine Learning

2021-12-06 · Niko Plath, Rolf Bader

A data set of recorded single played tones of a concert grand piano is investigated using Machine Learning (ML) on psychoacoustic timbre features. The examined instrument has been recorded at two stages: firstly right af…

BIG-bench Machine LearningClusteringInformation RetrievalMusic Information Retrieval

PianoVAM: A Multimodal Piano Performance Dataset

2025-09-10 · Yonghyun Kim, Junhyung Park, Joonhyung Bae, Kirak Kim 외 arxiv

The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introduces PianoVAM, a comprehensive piano perf…

Information RetrievalHand Pose Estimation

Profy: Interpretable Visualization of Expertise-Dependent Motor Skills Toward Supporting Piano Practice

2026-06-09 · Kazuki Kawamura, Fujiki Nakamura, Hayato Nishioka, Momoko Shioki 외 arxiv

The quality of piano performance depends on nuanced timing, articulation, and dynamic control, but practice feedback is often summary-based and hard to act on. We introduce Profy, a weakly supervised system that learns f…