How Late is Too Late? Effects of Network Latency on Audio-Visual Perception During AR Remote Musical Collaboration

Abstract

Networked Musical Collaboration requires near-instantaneous network transmission for successful real-time collaboration. We studied the way changes in network latency affect participants’ auditory and visual perception in latency detection, as well as latency tolerance in AR. Twenty-four participants were asked to play a hand drum with a prerecorded remote musician rendered as an avatar in AR at different levels of audio-visual latency. We analyzed the subjective responses of the participants from each session. Results suggest a minimum noticeable delay value between 160 milliseconds (ms) and 320 ms, as well as no upper limit to audio-visual delay tolerance.

• augmented reality
• network latency
• networked music
• perception

Cite

Torin Hopkins, Suibi Che-Chuan Weng, Rishi Vanukuru, Emma Wenzel, Amy Banić, Ellen Yi-Luen Do. 2022. How Late is Too Late? Effects of Network Latency on Audio-Visual Perception During AR Remote Musical Collaboration. IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 686–687. https://doi.org/10.1109/VRW55335.2022.00194

@inproceedings{hopkins2022late,
  title = {{How Late is Too Late? Effects of Network Latency on Audio-Visual Perception During AR Remote Musical Collaboration}},
  author = {Hopkins, Torin and Weng, Suibi Che-Chuan and Vanukuru, Rishi and Wenzel, Emma and Banić, Amy and Do, Ellen Yi-Luen},
  booktitle = {IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)},
  pages = {686--687},
  year = {2022},
  doi = {10.1109/VRW55335.2022.00194}
}

Project: AR Drum CircleProject: How Late Is Too Late?All publications