AR Drum Circle: Real-Time Collaborative Drumming in AR

Hopkins, Torin; Weng, Suibi Che-Chuan; Vanukuru, Rishi; Wenzel, Emma A.; Banić, Amy; Gross, Mark D.; Do, Ellen Yi-Luen

doi:10.3389/frvir.2022.847284

Figure from “AR Drum Circle: Real-Time Collaborative Drumming in AR”

Abstract

AR Drum Circle is an augmented reality (AR) platform we developed to facilitate a collaborative remote drumming experience. We explore the effects of virtual avatars that are rendered in a player’s view to provide the joy and sensation of co-present music creation. AR Drum Circle uses a head mounted AR display, providing players with visual effects to assist drummers in coordinating musical ideas while simultaneously using a latency-optimized remote collaboration service (JackTrip). AR Drum Circle helps overcome barriers in music collaboration introduced when using remote collaboration tools on their own, which typically do not support real-time video, lack spatial information, and volume control between players, all of which are important for in-person drum circles and music collaboration. This paper presents the results of several investigations: (1) analysis of an in-depth, free-form response survey of drumming communication provided by a small group of expert drummers, (2) observations and analysis of 20 videos of live drum circles, (3) a case study using the AR Drum Circle application in pairs of remotely located participants, and (4) a collaborative drumming case study using a popular networked conferencing application (Zoom). Findings suggest that substantial communicative information including facial expressions, hand-tracking, and eye-contact is lost when using AR alone. Findings also indicate that the AR Drum Circle application can make players less self-conscious and more willing to participate while playing drums improvisationally with others.

augmented reality
remote collaboration
network latency
drum circle
user studies

Cite

Torin Hopkins, Suibi Che-Chuan Weng, Rishi Vanukuru, Emma A. Wenzel, Amy Banić, Mark D. Gross, Ellen Yi-Luen Do. 2022. AR Drum Circle: Real-Time Collaborative Drumming in AR. Frontiers in Virtual Reality, 847284. https://doi.org/10.3389/frvir.2022.847284

@article{hopkins2022drum,
  title = {{AR Drum Circle: Real-Time Collaborative Drumming in AR}},
  author = {Hopkins, Torin and Weng, Suibi Che-Chuan and Vanukuru, Rishi and Wenzel, Emma A. and Banić, Amy and Gross, Mark D. and Do, Ellen Yi-Luen},
  journal = {Frontiers in Virtual Reality},
  volume = {3},
  pages = {847284},
  year = {2022},
  doi = {10.3389/frvir.2022.847284}
}

Project: AR Drum Circle All publications