paper-with-me

Papers

Learning to Traverse Latent Spaces for Musical Score Inpainting

2019-07-02 · Ashis Pati, Alexander Lerch, Gaëtan Hadjeres

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score inpainting is proposed. The designed model takes both past and future musical context into account and is capable of suggesting ways to connect them in a musically meaningful manner. To achieve this, we leverage the representational power of the latent space of a Variational Auto-Encoder and train a Recurrent Neural Network which learns to traverse this latent space conditioned on the past and future musical contexts. Consequently, the designed model is capable of generating several measures of music to connect two musical excerpts. The capabilities and performance of the model are showcased by comparison with competitive baselines using several objective and subjective evaluation methods. The results show that the model generates meaningful inpaintings and can be used in interactive music creation applications. Overall, the method demonstrates the merit of learning complex trajectories in the latent spaces of deep generative models.

📄 PDF Abstract BibTeX arXiv:1907.01164

Code (1)

ashispati/InpaintNet 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting

2024-07-01 · Scott H. Hawley

Recent years have witnessed significant progress in generative models for music, featuring diverse architectures that balance output quality, diversity, speed, and user control. This study explores a user-friendly graphi…

DiversityMusic Generation

GACELA -- A generative adversarial context encoder for long audio inpainting

2020-05-11 · Andres Marafioti, Piotr Majdak, Nicki Holighaus, Nathanaël Perraudin

We introduce GACELA, a generative adversarial network (GAN) designed to restore missing musical audio data with a duration ranging between hundreds of milliseconds to a few seconds, i.e., to perform long-gap audio inpain…

Audio GenerationAudio inpaintingGenerative Adversarial Network

Towards End-to-End Audio-Sheet-Music Retrieval

2016-12-15 · Matthias Dorfer, Andreas Arzt, Gerhard Widmer

This paper demonstrates the feasibility of learning to retrieve short snippets of sheet music (images) when given a short query excerpt of music (audio) -- and vice versa --, without any symbolic representation of music …

Retrieval

Operational Latent Spaces

2024-06-04 · Scott H. Hawley, Austin R. Tackett

We investigate the construction of latent spaces through self-supervised learning to support semantically meaningful operations. Analogous to operational amplifiers, these "operational latent spaces" (OpLaS) not only dem…

ClusteringMetric LearningSelf-Supervised Learning

Vibe Spaces for Creatively Connecting and Expressing Visual Concepts

2025-12-16 · Huzheng Yang, Katherine Xu, Andrew Lu, Michael D. Grossberg 외 arxiv

Creating new visual concepts often requires connecting distinct ideas through their most relevant shared attributes -- their vibe. We introduce Vibe Blending, a novel task for generating coherent and meaningful hybrids t…