skip to main content
10.1145/3355355.3361894acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
abstract

HyperDrum: Interactive Synchronous Drumming in Virtual Reality using Everyday Objects

Published: 17 November 2019 Publication History

Abstract

Hyperscanning is a method to detect if brain wave synchronicity exists between two or more individuals, which is usually due to behavioral or social interactions. It is usually limited to neuroscience studies and very rarely used as an interaction or visual feedback mechanic. In this work, we propose HyperDrum, which is about leveraging this cognitive synchronization to create a collaborative music production experience with immersive visualization in virtual reality. We let the participants wear electroencephalography (EEG) head-mounted displays to create music together using a physical drum. As the melody becomes in synced, we perform hyperscanning to evaluate the degree of synchronicity. The produced music and visualization reflects the synchronicity level while at the same time trains the participants to create music together, enriching the experience and performance. HyperDrum’s main goal is twofold; to blend cognitive neuroscience with creativity in VR, and to encourage connectivity between humans using both art and science.

Supplementary Material

p15-hajika-supplement-1 (hyperdrum-floorplan.pdf)
HyperDrum floor plan
p15-hajika-supplement-2 (hyperdrummovie.mov)
video

References

[1]
Thomas D Duane and Thomas Behrendt. 1965. Extrasensory electroencephalographic induction between identical twins. Science 150, 3694 (1965), 367.
[2]
Makoto Kumon, ITO Yoshihiro, Toru Nakashima, Tomoko Shimoda, and Mitsuaki Ishitobi. 2007. Sound source classification using support vector machine. IFAC Proceedings Volumes 40, 13 (2007), 465–470.
[3]
P Read Montague, Gregory S Berns, Jonathan D Cohen, Samuel M McClure, Giuseppe Pagnoni, Mukesh Dhamala, Michael C Wiest, Igor Karpov, Richard D King, Nathan Apple, 2002. Hyperscanning: simultaneous fMRI during linked social interactions.
[4]
Patricia Vanzella, Joana Bisol Balardin, Rogério Akira Furucho, Guilherme Augusto Zimeo Morais, Thenille Braun Janzen, Daniela Sammler, and Joao Ricardo Sato. 2019. fNIRS Responses in Professional Violinists While Playing Duets: Evidence for Distinct Leader and Follower Roles at the Brain Level. Frontiers in psychology 10 (2019), 164.
[5]
Kyongsik Yun, Katsumi Watanabe, and Shinsuke Shimojo. 2012. Interpersonal body and neural synchronization as a marker of implicit social interaction. Scientific reports 2(2012), 959.

Cited By

View all
  • (2024)SynCocreate: Fostering Interpersonal Connectedness via Brainwave-Driven Co-creation in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648650(1-5)Online publication date: 11-May-2024
  • (2024)Research Trends in Virtual Reality Music Concert Technology: A Systematic Literature ReviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337206930:5(2195-2205)Online publication date: 4-Mar-2024
  • (2022)Transcendental Avatar: Experiencing Bioresponsive Avatar of the Self for Improved CognitionSIGGRAPH Asia 2022 XR10.1145/3550472.3558417(1-2)Online publication date: 24-Nov-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SA '19: SIGGRAPH Asia 2019 XR
November 2019
47 pages
ISBN:9781450369473
DOI:10.1145/3355355
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2019

Check for updates

Author Tags

  1. electroencephalography
  2. hyperscanning
  3. music
  4. virtual reality

Qualifiers

  • Abstract
  • Research
  • Refereed limited

Funding Sources

Conference

SA '19
Sponsor:
SA '19: SIGGRAPH Asia 2019
November 17 - 20, 2019
QLD, Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)47
  • Downloads (Last 6 weeks)3
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)SynCocreate: Fostering Interpersonal Connectedness via Brainwave-Driven Co-creation in Virtual RealityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3648650(1-5)Online publication date: 11-May-2024
  • (2024)Research Trends in Virtual Reality Music Concert Technology: A Systematic Literature ReviewIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337206930:5(2195-2205)Online publication date: 4-Mar-2024
  • (2022)Transcendental Avatar: Experiencing Bioresponsive Avatar of the Self for Improved CognitionSIGGRAPH Asia 2022 XR10.1145/3550472.3558417(1-2)Online publication date: 24-Nov-2022
  • (2022)Transcendental Avatar: Experiencing Bioresponsive Avatar of the Self for Improved CognitionSIGGRAPH Asia 2022 Posters10.1145/3550082.3564210(1-2)Online publication date: 6-Dec-2022
  • (2022)Flow with the Beat! Human-Centered Design of Virtual Environments for Musical Creativity Support in VRProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3532799(428-442)Online publication date: 20-Jun-2022
  • (2020)NeuralDrum: Perceiving Brain Synchronicity in XR DrummingSIGGRAPH Asia 2020 Technical Communications10.1145/3410700.3425434(1-4)Online publication date: 1-Dec-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media