paper-with-me

홈 › Papers

The NES Music Database: A multi-instrumental dataset with expressive performance attributes

2018-06-12 · Chris Donahue, Huanru Henry Mao, Julian McAuley

Existing research on music generation focuses on composition, but often ignores the expressive performance characteristics required for plausible renditions of resultant pieces. In this paper, we introduce the Nintendo Entertainment System Music Database (NES-MDB), a large corpus allowing for separate examination of the tasks of composition and performance. NES-MDB contains thousands of multi-instrumental songs composed for playback by the compositionally-constrained NES audio synthesizer. For each song, the dataset contains a musical score for four instrument voices as well as expressive attributes for the dynamics and timbre of each voice. Unlike datasets comprised of General MIDI files, NES-MDB includes all of the information needed to render exact acoustic performances of the original compositions. Alongside the dataset, we provide a tool that renders generated compositions as NES-style audio by emulating the device's audio processor. Additionally, we establish baselines for the tasks of composition, which consists of learning the semantics of composing for the NES synthesizer, and performance, which involves finding a mapping between a composition and realistic expressive attributes.

📄 PDF Abstract BibTeX arXiv:1806.04278

Code (2)

chrisdonahue/nesmdb 공식 구현
xgarcia238/8bit-VAE pytorch

Tasks

Music Generation

Similar Papers 제목 키워드 기반

From Sound to Sight: Towards AI-authored Music Videos

2025-08-20 · Leo Vitasovic, Stella Graßhof, Agnes Mercedes Kloft, Ville V. Lehtola 외 arxiv

Conventional music visualisation systems rely on handcrafted ad hoc transformations of shapes and colours that offer only limited expressiveness. We propose two novel pipelines for automatically generating music videos f…

ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning

2024-09-19 · Daewoong Kim, Hao-Wen Dong, Dasaem Jeong

Modeling the natural contour of fundamental frequency (F0) plays a critical role in music audio synthesis. However, transcribing and managing multiple F0 contours in polyphonic music is challenging, and explicit F0 conto…

Audio Synthesis

Multi-Instrumentalist Net: Unsupervised Generation of Music from Body Movements

2020-12-07 · Kun Su, Xiulong Liu, Eli Shlizerman

We propose a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting. Learning to generate multi-instrumental music from videos without…

DisentanglementMusic Generation

YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotations

2022-11-14 · Eunjin Choi, Yoonjin Chung, Seolhee Lee, JongIk Jeon 외

Existing multi-instrumental datasets tend to be biased toward pop and classical music. In addition, they generally lack high-level annotations such as emotion tags. In this paper, we propose YM2413-MDB, an 80s FM video g…

Emotion RecognitionMusic Generation

From MIDI to Rich Tablatures: an Automatic Generative System incorporating Lead Guitarists' Fingering and Stylistic choices

2024-07-12 · Pierluigi Bontempi, Daniele Manerba, Alexandre D'Hooge, Sergio Canazza

Although the automatic identification of the optimal fingering for the performance of melodies on fretted string instruments has already been addressed (at least partially) in the literature, the specific case regarding …

Attribute