Conference · Audio Mostly 2023
Stringesthesia: Dynamically Shifting Musical Agency Between Audience and Performer Based on Trust in an Interactive and Improvised Performance
Audio Mostly (AM ’23), Edinburgh, UK, pp. 9–16, 2023.
Abstract
This paper introduces Stringesthesia, an interactive and improvised performance paradigm. Stringesthesia uses real-time neuroimaging to connect performers and audiences, enabling direct access to the performer’s mental state and determining audience participation during the performance. Functional near-infrared spectroscopy (fNIRS), a noninvasive neuroimaging tool, was used to assess metabolic activity of brain areas collectively associated with a metric we call “trust”. A visualization representing the real-time measurement of the performer’s level of trust was projected behind the performer and used to dynamically restrict or promote audience participation: e.g., as the performer’s trust in the audience grew, more participatory stations for playing drums and selecting the performer’s chords were activated. Throughout the paper we discuss prior work that heavily influenced our design, conceptual and methodological issues with using fNIRS technology, and our system architecture. We then describe feedback from the audience and performer in a performance setting with a solo guitar player.
Cite
Torin Hopkins, Emily Doherty, Netta Ofer, Suibi Che-Chuan Weng, Peter Gyory, Chad Tobin, Leanne Hirshfield, Ellen Yi-Luen Do. 2023. Stringesthesia: Dynamically Shifting Musical Agency Between Audience and Performer Based on Trust in an Interactive and Improvised Performance. Audio Mostly (AM ’23), 9–16. https://doi.org/10.1145/3616195.3616209
@inproceedings{hopkins2023stringesthesia,
title = {{Stringesthesia: Dynamically Shifting Musical Agency Between Audience and Performer Based on Trust in an Interactive and Improvised Performance}},
author = {Hopkins, Torin and Doherty, Emily and Ofer, Netta and Weng, Suibi Che-Chuan and Gyory, Peter and Tobin, Chad and Hirshfield, Leanne and Do, Ellen Yi-Luen},
booktitle = {Audio Mostly (AM ’23)},
pages = {9--16},
year = {2023},
doi = {10.1145/3616195.3616209}
}