Brain2Music: Reconstructing Music from Human Brain Activity
The process of reconstructing experiences from human brain activity offers a unique lens into how the brain interprets and represents the world. In this paper, we introduce a method for reconstructing music from brain activity, captured using functional magnetic resonance imaging (fMRI). Our approach uses either music retrieval or the MusicLM music generation model conditioned on embeddings derived from fMRI data. The generated music resembles the musical stimuli that human subjects experienced, with respect to semantic properties like genre, instrumentation, and mood. We investigate the relationship between different components of MusicLM and brain activity through a voxel-wise encoding modeling analysis. Furthermore, we discuss which brain regions represent information derived from purely textual descriptions of music stimuli. We provide supplementary material including examples of the reconstructed music at https://google-research.github.io/seanet/brain2music
Code (0)
등록된 구현이 없습니다.
Tasks
Music GenerationRetrievalSimilar Papers 제목 키워드 기반
R&B -- Rhythm and Brain: Cross-subject Decoding of Music from Human Brain Activity
Music is a universal phenomenon that profoundly influences human experiences across cultures. This study investigates whether music can be decoded from human brain activity measured with functional MRI (fMRI) during its …
RetrievalRhythmEEG2Mel: Reconstructing Sound from Brain Responses to Music
Information retrieval from brain responses to auditory and visual stimuli has shown success through classification of song names and image classes presented to participants while recording EEG signals. Information retrie…
EEGElectroencephalogram (EEG)Information RetrievalRetrievalTowards the bio-personalization of music recommendation systems: A single-sensor EEG biomarker of subjective music preference
Recent advances in biosensors technology and mobile electroencephalographic (EEG) interfaces have opened new application fields for cognitive monitoring. A computable biomarker for the assessment of spontaneous aesthetic…
Brain Computer InterfaceEEGElectroencephalogram (EEG)Music Recommendation+1Music to My Ears: Neural modularity and flexibility differ in response to real-world music stimuli
Music listening involves many simultaneous neural operations, including auditory processing, working memory, temporal sequencing, pitch tracking, anticipation, reward, and emotion, and thus, a full investigation of music…
Energy-based features and bi-LSTM neural network for EEG-based music and voice classification
The human brain receives stimuli in multiple ways; among them, audio constitutes an important source of relevant stimuli for the brain regarding communication, amusement, warning, etc. In this context, the aim of this ma…
Binary ClassificationClassificationEEGMulti-class Classification