MR4MR: Mixed Reality for Melody Reincarnation
There is a long history of an effort made to explore musical elements with the entities and spaces around us, such as musique concr\`ete and ambient music. In the context of computer music and digital art, interactive experiences that concentrate on the surrounding objects and physical spaces have also been designed. In recent years, with the development and popularization of devices, an increasing number of works have been designed in Extended Reality to create such musical experiences. In this paper, we describe MR4MR, a sound installation work that allows users to experience melodies produced from interactions with their surrounding space in the context of Mixed Reality (MR). Using HoloLens, an MR head-mounted display, users can bump virtual objects that emit sound against real objects in their surroundings. Then, by continuously creating a melody following the sound made by the object and re-generating randomly and gradually changing melody using music generation machine learning models, users can feel their ambient melody "reincarnating".
Code (0)
등록된 구현이 없습니다.
Tasks
Mixed RealityMusic GenerationSimilar Papers 제목 키워드 기반
Selective Reincarnation: Offline-to-Online Multi-Agent Reinforcement Learning
'Reincarnation' in reinforcement learning has been proposed as a formalisation of reusing prior computation from past experiments when training an agent in an environment. In this paper, we present a brief foray into the…
Multi-agent Reinforcement Learningreinforcement-learningReinforcement LearningMulti-layer Visualization for Medical Mixed Reality
Medical Mixed Reality helps surgeons to contextualize intraoperative data with video of the surgical scene. Nonetheless, the surgical scene and anatomical target are often occluded by surgical instruments and surgeon han…
Mixed RealityMixed Reality Interface for Digital Twin of Plant Factory
An easier and intuitive interface architecture is necessary for digital twin of plant factory. I suggest an immersive and interactive mixed reality interface for digital twin models of smart farming, for remote work rath…
Mixed RealityDesigning Conversations with the Dead: How People Engage with Generative Ghosts
We examine how people experience two choices in the design of generative ghosts, AI systems that are trained on data of the dead: representation, where an AI speaks about a deceased person in the third person, and reinca…
Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together
Spatial computing -- the ability of devices to be aware of their surroundings and to represent this digitally -- offers novel capabilities in human-robot interaction. In particular, the combination of spatial computing a…
Mixed Reality