PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text
While piano music has become a significant area of study in Music Information Retrieval (MIR), there is a notable lack of datasets for piano solo music with text labels. To address this gap, we present PIAST (PIano dataset with Audio, Symbolic, and Text), a piano music dataset. Utilizing a piano-specific taxonomy of semantic tags, we collected 9,673 tracks from YouTube and added human annotations for 2,023 tracks by music experts, resulting in two subsets: PIAST-YT and PIAST-AT. Both include audio, text, tag annotations, and transcribed MIDI utilizing state-of-the-art piano transcription and beat tracking models. Among many possible tasks with the multi-modal dataset, we conduct music tagging and retrieval using both audio and MIDI data and report baseline performances to demonstrate its potential as a valuable resource for MIR research.
Code (1)
Tasks
Information RetrievalMusic Information RetrievalMusic TaggingRetrievalTAGSimilar Papers 제목 키워드 기반
A Transformer-Based Visual Piano Transcription Algorithm
Automatic music transcription (AMT) for musical performances is a long standing problem in the field of Music Information Retrieval (MIR). Visual piano transcription (VPT) is a multimodal subproblem of AMT which focuses …
Information RetrievalMusic Information RetrievalMusic TranscriptionRetrievalGiantMIDI-Piano: A large-scale MIDI dataset for classical piano music
Symbolic music datasets are important for music information retrieval and musical analysis. However, there is a lack of large-scale symbolic datasets for classical piano music. In this article, we create a GiantMIDI-Pian…
Information RetrievalMusic Information RetrievalRetrievalPianoVAM: A Multimodal Piano Performance Dataset
The multimodal nature of music performance has driven increasing interest in data beyond the audio domain within the music information retrieval (MIR) community. This paper introduces PianoVAM, a comprehensive piano perf…
Information RetrievalHand Pose EstimationLearning Music Style for Piano Arrangement Through Cross-Modal Bootstrapping
What is music style? Though often described using text labels such as "swing," "classical," or "emotional," the real style remains implicit and hidden in concrete music examples. In this paper, we introduce a cross-modal…
Contrastive LearningMusic GenerationStyle TransferLearning To Generate Piano Music With Sustain Pedals
Recent years have witnessed a growing interest in research related to the detection of piano pedals from audio signals in the music information retrieval community. However, to our best knowledge, recent generative model…
DecoderInformation RetrievalMusic Information RetrievalRetrieval