Exploring Multiple-Display Interaction for Live XR Performance
Authors: 
Ke-Fan Lin, Yu-Chih Chou, Yu-Hsiang Weng, Yvone Tsai Chen, Tse-Yu Pan, Ping-Hsuan HanAuthors Info & Claims
Ke-Fan Lin, Yu-Chih Chou, Yu-Hsiang Weng, Yvone Tsai Chen, Tse-Yu Pan, Ping-Hsuan HanAuthors Info & ClaimsArticle No.: 18, Pages 1 - 2
Abstract
Although VR concerts offer a unique experience for audience to watch a performance, people still tend to participate in a live performance physically for the co-presence and shared experience are difficult to perceive in VR. To address this issue, we propose Actualities, a live XR performance system that integrates onsite and online concerts to create a seamless experience across multiple displays. Our system utilizes various sensors to detect signals from musical instruments and onsite audiences, digitalizing onsite performance elements into a virtual world. We project the visuals onto screens and live-stream the content for audiences to watch through various devices, and we also designed several interactive elements for the audience to interact with the public display. To evaluate our system, we conducted exploratory research to help us refine our system and improve the cross-reality experience.
References
[1]
Alejandro Beacco, Ramon Oliva, Carlos Cabreira, Jaime Gallego, and Mel Slater. 2021. Disturbance and plausibility in a virtual rock concert: A pilot study. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 538–545.
[2]
Ryota Horie, Minami Wada, and Eri Watanabe. 2018. Participation in a virtual reality concert via brainwave and heartbeat. In Advances in Affective and Pleasurable Design: Proceedings of the AHFE 2017 International Conference on Affective and Pleasurable Design, July 17–21, 2017, The Westin Bonaventure Hotel, Los Angeles, California, USA 8. Springer, 276–284.
[3]
Takashi Kasuya, Manabu Tsukada, Yu Komohara, Shigeki Takasaka, Takuhiro Mizuno, Yoshitaka Nomura, Yuta Ueda, and Hiroshi Esaki. 2019. LiVRation: Remote VR live platform with interactive 3D audio-visual service. In 2019 IEEE Games, Entertainment, Media Conference (GEM). IEEE, 1–7.
[4]
Luca Turchet, Rob Hamilton, and Anil Çamci. 2021. Music in extended realities. IEEE Access 9 (2021), 15810–15832.
[5]
Hiromu Yakura and Masataka Goto. 2020. Enhancing participation experience in vr live concerts by improving motions of virtual audience avatars. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 555–565.
[6]
Shuo Yan, Xuning Yan, and Xukun Shen. 2020. Exploring social interactions for live performance in virtual reality. In SIGGRAPH Asia 2020 Posters. 1–2.
Index Terms
- Exploring Multiple-Display Interaction for Live XR Performance
Recommendations
Actualities: Seamless Live Performance with the Physical and Virtual Audiences in Multiverse
SIGGRAPH '23: ACM SIGGRAPH 2023 Immersive PavilionDuring the pandemic, the popularity of VR concerts increased, providing the audience with a novel experience of watching performances where performers and online attendees typically exist in different spaces and times. However, as the pandemic ...
Exploring Social Interactions for Live Performance in Virtual Reality
SA '20: SIGGRAPH Asia 2020 PostersSocial interaction is important when audience are participating in a live performance. With strong immersion and high degree of freedom (DoF), virtual reality (VR) is often used to present performance events, such as virtual concert. A live performance ...
Interactive and live performance design with children
IDC '14: Proceedings of the 2014 conference on Interaction design and childrenPerformative Experience Design (PED) is an extension of experience design focusing on the unique timebound encounter between performers and spectators. Technology is purposefully designed to enhance the experience between audience and performers. PED ...
Comments
Information & Contributors
Information
Published In
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 23 July 2023
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Conference
SIGGRAPH '23
Sponsor:
SIGGRAPH '23: Special Interest Group on Computer Graphics and Interactive Techniques Conference
August 6 - 10, 2023
CA, Los Angeles, USA
Acceptance Rates
Overall Acceptance Rate 1,822 of 8,601 submissions, 21%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 214Total Downloads
- Downloads (Last 12 months)97
- Downloads (Last 6 weeks)5
Reflects downloads up to 27 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format