GAN-based Content-Conditioned Generation of Handwritten Musical Symbols
The field of Optical Music Recognition (OMR) is currently hindered by the scarcity of real annotated data, particularly when dealing with handwritten historical musical scores. In similar fields, such as Handwritten Text Recognition, it was proven that synthetic examples produced with image generation techniques could help to train better-performing recognition architectures. This study explores the generation of realistic, handwritten-looking scores by implementing a music symbol-level Generative Adversarial Network (GAN) and assembling its output into a full score using the Smashcima engraving software. We have systematically evaluated the visual fidelity of these generated samples, concluding that the generated symbols exhibit a high degree of realism, marking significant progress in synthetic score generation.
Code (0)
등록된 구현이 없습니다.
Tasks
Handwritten Text RecognitionImage GenerationSimilar Papers 제목 키워드 기반
Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generation
Symbolic Music, akin to language, can be encoded in discrete symbols. Recent research has extended the application of large language models (LLMs) such as GPT-4 and Llama2 to the symbolic music domain including understan…
JAMMIN-GPT: Text-based Improvisation using LLMs in Ableton Live
We introduce a system that allows users of Ableton Live to create MIDI-clips by naming them with musical descriptions. Users can compose by typing the desired musical content directly in Ableton's clip view, which is the…
DescriptiveIn Search of a Dataset for Handwritten Optical Music Recognition: Introducing MUSCIMA++
Optical Music Recognition (OMR) has long been without an adequate dataset and ground truth for evaluating OMR systems, which has been a major problem for establishing a state of the art in the field. Furthermore, machine…
One-shot Compositional Data Generation for Low Resource Handwritten Text Recognition
Low resource Handwritten Text Recognition (HTR) is a hard problem due to the scarce annotated data and the very limited linguistic information (dictionaries and language models). For example, in the case of historical ci…
Handwritten Text RecognitionHTRGANwriting: Content-Conditioned Generation of Styled Handwritten Word Images
Although current image generation methods have reached impressive quality levels, they are still unable to produce plausible yet diverse images of handwritten words. On the contrary, when writing by hand, a great variabi…
Handwritten Word GenerationImage Generation