paper-with-me

홈 › Papers

Stringesthesia: Dynamically Shifting Musical Agency Between Audience and Performer Based on Trust in an Interactive and Improvised Performance

2023-09-11 · Torin Hopkins, Emily Doherty, Netta Ofer, Suibi Che Chuan Weng, Peter Gyrory, Chad Tobin, Leanne Hirshfield, Ellen Yi-Luen Do

This paper introduces Stringesthesia, an interactive and improvised performance paradigm. Stringesthesia uses real-time neuroimaging to connect performers and audiences, enabling direct access to the performers mental state and determining audience participation during the performance. Functional near-infrared spectroscopy, or fNIRS, a noninvasive neuroimaging tool, was used to assess metabolic activity of brain areas collectively associated with a metric we call trust. A visualization representing the real-time measurement of the performers level of trust was projected behind the performer and used to dynamically restrict or promote audience participation. Throughout the paper we discuss prior work that heavily influenced our design, conceptual and methodological issues with using fNIRS technology, system architecture, and feedback from the audience and performer.

📄 PDF Abstract BibTeX arXiv:2309.05786

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

FAVOR+ 설명 없음
Performer Performer is a Transformer architecture which can estimate regular…

Similar Papers 제목 키워드 기반

Revival: Collaborative Artistic Creation through Human-AI Interactions in Musical Creativity

2025-01-19 · Keon Ju M. Lee, Philippe Pasquier, Jun Yuri

Revival is an innovative live audiovisual performance and music improvisation by our artist collective K-Phi-A, blending human and AI musicianship to create electronic music with audio-reactive visuals. The performance f…

Teaching AI to Feel: A Collaborative, Full-Body Exploration of Emotive Communication

2025-09-26 · Esen K. Tütüncü, Lissette Lemus, Kris Pilcher, Holger Sprengel 외 arxiv

Commonaiverse is an interactive installation exploring human emotions through full-body motion tracking and real-time AI feedback. Participants engage in three phases: Teaching, Exploration and the Cosmos Phase, collabor…

Emotion Classification

Reimagining Dance: Real-time Music Co-creation between Dancers and AI

2025-06-13 · Olga Vechtomova, Jeff Bos

Dance performance traditionally follows a unidirectional relationship where movement responds to music. While AI has advanced in various creative domains, its application in dance has primarily focused on generating chor…

Multi-Player Bandits -- a Musical Chairs Approach

2015-12-09 · Jonathan Rosenski, Ohad Shamir, Liran Szlak

We consider a variant of the stochastic multi-armed bandit problem, where multiple players simultaneously choose from the same set of arms and may collide, receiving no reward. This setting has been motivated by problems…

Helping Music Co-Creation Agents 'Listen' Well: Hierarchical Self-Supervised World Models for Understanding and Generation

2026-08-05 · Scott H. Hawley hf

Collaborative music agents need internal representations rich enough to support both understanding and generation, yet flexible enough for a workflow where the human retains agency. We present a hierarchical self-supervi…