Learning Frame Similarity using Siamese networks for Audio-to-Score Alignment
Audio-to-score alignment aims at generating an accurate mapping between a performance audio and the score of a given piece. Standard alignment methods are based on Dynamic Time Warping (DTW) and employ handcrafted features, which cannot be adapted to different acoustic conditions. We propose a method to overcome this limitation using learned frame similarity for audio-to-score alignment. We focus on offline audio-to-score alignment of piano music. Experiments on music data from different acoustic conditions demonstrate that our method achieves higher alignment accuracy than a standard DTW-based method that uses handcrafted features, and generates robust alignments whilst being adaptable to different domains at the same time.
Code (0)
등록된 구현이 없습니다.
Tasks
Dynamic Time WarpingSimilar Papers 제목 키워드 기반
Content-based Representations of audio using Siamese neural networks
In this paper, we focus on the problem of content-based retrieval for audio, which aims to retrieve all semantically similar audio recordings for a given audio clip query. This problem is similar to the problem of query …
RetrievalAQAScore: Evaluating Semantic Alignment in Text-to-Audio Generation via Audio Question Answering
Although text-to-audio generation has made remarkable progress in realism and diversity, the development of evaluation metrics has not kept pace. Widely-adopted approaches, typically based on embedding similarity like CL…
Question AnsweringAudio GenerationText GenerationPhoneme Similarity Matrices to Improve Long Audio Alignment for Automatic Subtitling
Long audio alignment systems for Spanish and English are presented, within an automatic subtitling application. Language-specific phone decoders automatically recognize audio contents at phoneme level. At the same time, …
DecoderLanguage ModellingExplainable Image Similarity: Integrating Siamese Networks and Grad-CAM
With the proliferation of image-based applications in various domains, the need for accurate and interpretable image similarity measures has become increasingly critical. Existing image similarity models often lack trans…
counterfactualDecision MakingSMARAGD: Learning SMatch for Accurate and Rapid Approximate Graph Distance
The similarity of graph structures, such as Meaning Representations (MRs), is often assessed via structural matching algorithms, such as Smatch (Cai and Knight, 2013). However, Smatch involves a combinatorial problem tha…
ClusteringData AugmentationGraph ClusteringGraph Matching+4