paper-with-me

Papers

Jukebox: A Generative Model for Music

2020-04-30 · Preprint 2020 4 · Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, Ilya Sutskever

We introduce Jukebox, a model that generates music with singing in the raw audio domain. We tackle the long context of raw audio using a multi-scale VQ-VAE to compress it to discrete codes, and modeling those using autoregressive Transformers. We show that the combined model at scale can generate high-fidelity and diverse songs with coherence up to multiple minutes. We can condition on artist and genre to steer the musical and vocal style, and on unaligned lyrics to make the singing more controllable. We are releasing thousands of non cherry-picked samples at https://jukebox.openai.com, along with model weights and code at https://github.com/openai/jukebox

📄 PDF Abstract BibTeX arXiv:2005.00341

Code (12)

openai/jukebox 공식 구현 pytorch
Broccaloo/Jukebox_mod pytorch
Deskaunedsei1983/jukebox-openai pytorch
dortenenboim314/cyclic-jukebox pytorch
elsalmi/qiskit
inzva/music-generation
kcrosley-leisurelabs/jukebox-reduce-log pytorch
picopicodragon/jukebox pytorch
picopicodragon/jukebox_plain pytorch
safakkbilici/Synthetic-Music-Generation-with-Deep-Neural-Networks
tdunity/fixedjukebox pytorch
wzaielamri/unmix pytorch

Tasks

model

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Dilated Convolution 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Residual Connection 설명 없음
Jukebox 설명 없음
VQ-VAE VQ-VAE is a type of variational autoencoder that uses vector quantisation to obtain a discrete latent representation. It differs from…

Similar Papers 제목 키워드 기반

A Novel Audio Representation for Music Genre Identification in MIR

2024-04-01 · Navin Kamuni, Mayank Jindal, Arpita Soni, Sukender Reddy Mallreddy 외

For Music Information Retrieval downstream tasks, the most common audio representation is time-frequency-based, such as Mel spectrograms. In order to identify musical genres, this study explores the possibilities of a ne…

Information RetrievalMusic Information RetrievalQuantizationRetrieval

Codified audio language modeling learns useful representations for music information retrieval

2021-07-12 · Rodrigo Castellon, Chris Donahue, Percy Liang

We demonstrate that language models pre-trained on codified (discretely-encoded) music audio learn representations that are useful for downstream MIR tasks. Specifically, we explore representations from Jukebox (Dhariwal…

Emotion RecognitionGenre classificationInformation RetrievalKey Detection+7

Unsupervised Source Separation By Steering Pretrained Music Models

2021-10-25 · Ethan Manilow, Patrick O'Reilly, Prem Seetharaman, Bryan Pardo

We showcase an unsupervised method that repurposes deep models trained for music generation and music tagging for audio source separation, without any retraining. An audio generation model is conditioned on an input mixt…

Audio GenerationAudio Source SeparationMusic GenerationMusic Tagging+1

Transfer Learning with Jukebox for Music Source Separation

2021-11-28 · W. Zai El Amri, O. Tautz, H. Ritter, A. Melnik

In this work, we demonstrate how a publicly available, pre-trained Jukebox model can be adapted for the problem of audio source separation from a single mixed audio channel. Our neural network architecture, which is usin…

Audio Source SeparationMusic Source SeparationTransfer Learning

Melody transcription via generative pre-training

2022-12-04 · Chris Donahue, John Thickstun, Percy Liang

Despite the central role that melody plays in music perception, it remains an open challenge in music information retrieval to reliably detect the notes of the melody present in an arbitrary music recording. A key challe…

Chord RecognitionInformation RetrievalMusic Information RetrievalRetrieval