Mamba-Diffusion Model with Learnable Wavelet for Controllable Symbolic Music Generation
The recent surge in the popularity of diffusion models for image synthesis has attracted new attention to their potential for generation tasks in other domains. However, their applications to symbolic music generation remain largely under-explored because symbolic music is typically represented as sequences of discrete events and standard diffusion models are not well-suited for discrete data. We represent symbolic music as image-like pianorolls, facilitating the use of diffusion models for the generation of symbolic music. Moreover, this study introduces a novel diffusion model that incorporates our proposed Transformer-Mamba block and learnable wavelet transform. Classifier-free guidance is utilised to generate symbolic music with target chords. Our evaluation shows that our method achieves compelling results in terms of music quality and controllability, outperforming the strong baseline in pianoroll generation. Our code is available at https://github.com/jinchengzhanggg/proffusion.
Code (1)
Tasks
Image GenerationMambaMusic GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SALIENT: Frequency-Aware Paired Diffusion for Controllable Long-Tail CT Detection
Detection of rare lesions in whole-body CT is fundamentally limited by extreme class imbalance and low target-to-volume ratios, producing precision collapse despite high AUROC. Synthetic augmentation with diffusion model…
Wavelet-based Mamba with Fourier Adjustment for Low-light Image Enhancement
Frequency information (e.g., Discrete Wavelet Transform and Fast Fourier Transform) has been widely applied to solve the issue of Low-Light Image Enhancement (LLIE). However, existing frequency-based models primarily ope…
DecoderImage EnhancementLow-Light Image EnhancementMambaDiMSUM: Diffusion Mamba -- A Scalable and Unified Spatial-Frequency Method for Image Generation
We introduce a novel state-space architecture for diffusion models, effectively harnessing spatial and frequency information to enhance the inductive bias towards local features in input images for image generation tasks…
Image GenerationInductive BiasMambaState Space ModelsWMamba: Wavelet-based Mamba for Face Forgery Detection
With the rapid advancement of deepfake generation technologies, the demand for robust and accurate face forgery detection algorithms has become increasingly critical. Recent studies have demonstrated that wavelet analysi…
Face SwappingMambaSYMPLEX: Controllable Symbolic Music Generation using Simplex Diffusion with Vocabulary Priors
We present a new approach for fast and controllable generation of symbolic music based on the simplex diffusion, which is essentially a diffusion process operating on probabilities rather than the signal space. This obje…
Music Generation