skip to main content
10.1145/3665463.3678838acmconferencesArticle/Chapter ViewAbstractPublication Pageschi-playConference Proceedingsconference-collections
demonstration

Duet: VR Pair Dancing with Partner Movement Manipulation

Published: 14 October 2024 Publication History

Abstract

Dancing provides a powerful way for one to feel connected with others. Virtual Reality (VR) holds the promise of enabling shared dancing experiences over a distance, but major challenges remain. First, the average VR user is limited to moving in a small real-world space; techniques that allow movement in a larger-than-real virtual space all have their limitations. Second, the lack of force feedback, combined with the latency of networking, movement tracking, graphics rendering, and human visuomotor control, makes it difficult to mimic physical interaction such as holding hands—one typically cannot react fast enough to one’s dance partner’s movements to maintain connection. Third, reliable full-body movement tracking remains beyond reach for affordable consumer VR devices such as Meta Quest. Here, we present a two-player VR contemporary dance game/experience that provides a new solution to these problems. Our solution combines 1) a novel partner movement manipulation approach where each player only needs a small physical space to move, but their perception of their partner’s movement is manipulated to allow the choreography to utilize a large virtual space, 2) a latency-tolerant visual metaphor for connection, in the form of an elastic string connecting the players, and 3) abstract avatar design that only requires tracking the movement of the hands and head and also increases the plausibility of the movement manipulation.

Supplemental Material

MP4 File - Supplemental Video
A video showcasing Duet and explaining how it uses partner movement manipulation.

References

[1]
Hironori Akiduki, Suetaka Nishiike, Hiroshi Watanabe, Katsunori Matsuoka, Takeshi Kubo, and Noriaki Takeda. 2003. Visual-vestibular conflict induced by virtual reality in humans. Neuroscience letters 340, 3 (2003), 197–200.
[2]
Costas Boletsis and Dimitra Chasanidou. 2022. A typology of virtual reality locomotion techniques. Multimodal Technologies and Interaction 6, 9 (2022), 72.
[3]
Chenyang Cai, Jian He, and Tianren Luo. 2023. Using Redirection to Create a Swimming Experience in VR for the Sitting Position. In Companion Proceedings of the 28th International Conference on Intelligent User Interfaces. 68–71.
[4]
Daniel L Eaves, Gavin Breslin, Paul Van Schaik, Emma Robinson, and Iain R Spears. 2011. The short-term effects of real-time virtual reality feedback on motor learning in dance. Presence: Teleoperators and Virtual Environments 20, 1 (2011), 62–77.
[5]
Inan Evin, Toni Pesola, Maximus D Kaos, Tuukka M Takala, and Perttu Hämäläinen. 2020. 3pp-r: Enabling natural movement in 3rd person virtual reality. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 438–449.
[6]
Alberto Gallace and Matteo Girondini. 2022. Social touch in virtual reality. Current Opinion in Behavioral Sciences 43 (2022), 249–254.
[7]
Antti Granqvist, Tapio Takala, Jari Takatalo, and Perttu Hämäläinen. 2018. Exaggeration of avatar flexibility in virtual reality. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play. 201–209.
[8]
Johanna Hoysniemi. 2006. International survey on the Dance Dance Revolution game. Computers in Entertainment (CIE) 4, 2 (2006), 8–es.
[9]
Christos Ioannou, Patrick Archard, Eamonn O’neill, and Christof Lutteroth. 2019. Virtual performance augmentation in an immersive jump & run exergame. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–15.
[10]
Yu Jiang, Zhipeng Li, Mufei He, David Lindlbauer, and Yukang Yan. 2023. Handavatar: Embodying non-humanoid virtual avatars through hands. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.
[11]
Iris Kico and Fotis Liarokapis. 2019. Comparison of trajectories and quaternions of folk dance movements using dynamic time warping. In 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games). IEEE, 1–4.
[12]
Iris Kico, David Zelníček, and Fotis Liarokapis. 2020. Assessing the Learning of Folk Dance Movements Using Immersive Virtual Reality. In 2020 24th International Conference Information Visualisation (IV). 587–592. https://doi.org/10.1109/IV51561.2020.00100
[13]
Salva Kirakosian, Emmanuel Maravelakis, and Katerina Mania. 2019. Immersive Simulation and Training of Person-to-3D Character Dance in Real-Time. In 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games). IEEE, 1–4.
[14]
Reetu Kontio, Markus Laattala, Robin Welsch, and Perttu Hämäläinen. 2023. “I Feel My Abs”: Exploring Non-standing VR Locomotion. Proceedings of the ACM on Human-Computer Interaction 7, CHI PLAY (2023), 1282–1307.
[15]
Andrey Krekhov, Sebastian Cmentowski, and Jens Krüger. 2018. Vr animals: Surreal body ownership in virtual reality games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts. 503–511.
[16]
Markus Laattala, Roosa Piitulainen, Nadia M Ady, Monica Tamariz, and Perttu Hämäläinen. 2024. WAVE: Anticipatory Movement Visualization for VR Dancing. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–9.
[17]
Beatriz Mello, Robin Welsch, Marissa Christien Verbokkem, Pascal Knierim, and Martin Johannes Dechant. 2024. Navigating the Virtual Gaze: Social Anxiety’s Role in VR Proxemics. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–15.
[18]
Miguel A Otaduy, Allison Okamura, and Sriram Subramanian. 2016. Haptic technologies for direct touch in virtual reality. In ACM SIGGRAPH 2016 Courses. 1–123.
[19]
Jérôme Perret and Emmanuel Vander Poorten. 2018. Touching virtual reality: a review of haptic gloves. In ACTUATOR 2018; 16th International Conference on New Actuators. VDE, 1–5.
[20]
Roosa Piitulainen, Perttu Hämäläinen, and Elisa D Mekler. 2022. Vibing Together: Dance Experiences in Social Virtual Reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 188, 18 pages. https://doi.org/10.1145/3491102.3501828
[21]
Jose Luis Ponton, Reza Keshavarz, Alejandro Beacco, and Nuria Pelechano. 2024. Stretch your reach: Studying Self-Avatar and Controller Misalignment in Virtual Reality Interaction. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–15.
[22]
Sharif Razzaque. 2005. Redirected walking. The University of North Carolina at Chapel Hill.
[23]
Bernhard E Riecke, David Clement, Ashu Adhikari, Denise Quesnel, Daniel Zielasko, and Markus von der Heyde. 2022. Hyperjumping in virtual vancouver: Combating motion sickness by merging teleporting and continuous vr locomotion in an embodied hands-free vr flying paradigm. In ACM SIGGRAPH 2022 Immersive Pavilion. 1–2.
[24]
Simon Senecal, Niels A Nijdam, Andreas Aristidou, and Nadia Magnenat-Thalmann. 2020. Salsa dance learning evaluation and motion analysis in gamified virtual reality environment. Multimedia Tools and Applications 79, 33 (2020), 24621–24643.
[25]
Yoko Usui, Katsumi Sato, Shinichi Watabe, and Erina Yanagida. 2019. VR Teaching Materials for Dance Practice. In 2019 8th International Congress on Advanced Applied Informatics (IIAI-AAI). IEEE, 178–183.
[26]
Karthikeya Puttur Venkatraj, Wo Meijer, Monica Perusquia-Hernandez, Gijs Huisman, and Abdallah El Ali. 2024. ShareYourReality: Investigating Haptic Feedback and Agency in Virtual Avatar Co-embodiment. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–15.
[27]
Yanghui Xu and Yi Li. 2019. Design and Research of VR System in Latin Dance Teaching. In 2019 International Conference on Advanced Education, Service and Management, Vol. 3. The Academy of Engineering and Education, 59–62.
[28]
VRChat. 2017. VRChat. https://hello.vrchat.com/.
[29]
Beat Games. 2019. Beat Saber. https://store.steampowered.com/app/620980/Beat_Saber/.
[30]
Konami. 1998. Dance Dance Revolution. Arcade.
[31]
Game Oven. 2014. Bounden. Game [iOS, Android].
[32]
Harmonix Music Systems. 2010. Dance Central.
[33]
Harmonix Music Systems. 2019. Dance Central VR. Microsoft Windows, Meta Quest 2.
[34]
Thatgamecompany, Inc.2012. Journey. Game [PlayStation 3, PlayStation 4, Windows, iOS]. Sony Computer Entertainment, Annapurna Interactive.
[35]
Ubisoft. 2009. Just Dance.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI PLAY Companion '24: Companion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play
October 2024
500 pages
ISBN:9798400706929
DOI:10.1145/3665463
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 October 2024

Check for updates

Author Tags

  1. Dance
  2. Movement Manipulation
  3. VR
  4. Virtual Reality

Qualifiers

  • Demonstration
  • Research
  • Refereed limited

Funding Sources

  • European Union?s Horizon 2020 research and innovation programme

Conference

CHI PLAY '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 421 of 1,386 submissions, 30%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 137
    Total Downloads
  • Downloads (Last 12 months)137
  • Downloads (Last 6 weeks)32
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media