Keiichi Zempo
ABSTRACT
This study demonstrates a portable, low-noise system that utilizes electrical muscle stimulation (EMS) to present a body-sensory acoustic experience similar to that experienced during live concerts. Twenty-four participants wore head-mounted displays (HMDs), headphones, and the proposed system and experienced a live concert in a virtual reality (VR) space to evaluate the system. We found that the system was not inferior to a system with loudspeakers and subwoofers, where ambient noise concerns precision in rhythm and harmony. These results could be explained by the user perceiving the EMS experience as a single signal when the EMS stimulation is presented in conjunction with visual and acoustic stimuli (e.g., the kicking of a bass drum, the bass sound generated from the kicking, and the acoustic sensation caused by the bass sound). The proposed method offers a novel EMS-based body-sensory acoustic experience, and the results of this study may lead to an improved experience not only for live concerts in VR space but also for everyday music listening.
- Birgitta Berglund, Thomas Lindvall, 1995. Community noise.Google Scholar
- Fabien Danieau, Anatole Lécuyer, Philippe Guillotel, Julien Fleureau, Nicolas Mollet, and Marc Christie. 2012. Enhancing audiovisual experience with haptic feedback: a survey on HAV. IEEE transactions on haptics 6, 2 (2012), 193–205.Google Scholar
- Matthias Hoppe, Pascal Knierim, Thomas Kosch, Markus Funk, Lauren Futami, Stefan Schneegass, Niels Henze, Albrecht Schmidt, and Tonja Machulla. 2018. VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters. In Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia (Cairo, Egypt) (MUM 2018). Association for Computing Machinery, New York, NY, USA, 7–18. https://doi.org/10.1145/3282894.3282898Google ScholarDigital Library
- Yukari Konishi, Nobuhisa Hanamitsu, Benjamin Outram, Kouta Minamizawa, Tetsuya Mizuguchi, and Ayahiko Sato. 2016. Synesthesia Suit: The Full Body Immersive Experience. In ACM SIGGRAPH 2016 VR Village(Anaheim, California) (SIGGRAPH ’16). Association for Computing Machinery, New York, NY, USA, Article 20, 1 pages. https://doi.org/10.1145/2929490.2932629Google ScholarDigital Library
- H Geoffrey Leventhall 2004. Low frequency noise and annoyance. Noise and Health 6, 23 (2004), 59.Google Scholar
- Mauricio Orozco, Juan Silva, Abdulmotaleb El Saddik, and Emil Petriu. 2012. The role of haptics in games. Haptics rendering and applications(2012), 217–234.Google Scholar
- Max Pfeiffer and Wolfgang Stuerzlinger. 2015. 3D Virtual Hand Selection with EMS and Vibration Feedback. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI EA ’15). Association for Computing Machinery, New York, NY, USA, 1361–1366. https://doi.org/10.1145/2702613.2732763Google ScholarDigital Library
- Miles Priebe, Esther Foo, and Brad Holschuh. 2020. Shape Memory Alloy Haptic Compression Garment for Media Augmentation in Virtual Reality Environment. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20 Adjunct). Association for Computing Machinery, New York, NY, USA, 34–36. https://doi.org/10.1145/3379350.3416177Google ScholarDigital Library
- Dangxiao WANG, Yuan GUO, Shiyi LIU, Yuru ZHANG, Weiliang XU, and Jing XIAO. 2019. Haptic display for virtual reality: progress and challenges. Virtual Reality & Intelligent Hardware 1, 2 (2019), 136–162. https://doi.org/10.3724/SP.J.2096-5796.2019.0008Google ScholarCross Ref
- Qinglong Wang, Xiangshi Ren, and Xiaoying Sun. 2017. Enhancing Pen-Based Interaction Using Electrovibration and Vibration Haptic Feedback. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3746–3750. https://doi.org/10.1145/3025453.3025555Google ScholarDigital Library
- Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment. Virtual Reality 21, 1 (2017), 19–29.Google ScholarDigital Library
- Yusuke Yamazaki, Hironori Mitake, Ryuto Oda, Hsueh-Han Wu, Shoichi Hasegawa, Minatsu Takekoshi, Yuji Tsukamoto, and Testuaki Baba. 2017. Hapbeat: single DOF wide range wearable haptic display. In ACM SIGGRAPH 2017 Emerging Technologies. 1–2.Google ScholarDigital Library
- André Zenner and Antonio Krüger. 2019. Drag:On: A Virtual Reality Controller Providing Haptic Feedback Based on Drag and Weight Shift. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300441Google ScholarDigital Library
Index Terms
- Silent subwoofer system using myoelectric stimulation to presents the acoustic deep bass experiences
Recommendations
Automatic chord recognition based on probabilistic integration of acoustic features, bass sounds, and chord transition
IEA/AIE'12: Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligenceWe have developed a method that identifies musical chords in polyphonic musical signals. As musical chords mainly represent the harmony of music and are related to other musical elements such as melody and rhythm, we should be able to recognize chords ...
Beat my bass, pluck my drum
DIS Companion '14: Proceedings of the 2014 companion publication on Designing interactive systemsBeating a bass, plucking a drum -- new systems of instruments make it possible. In this paper we describe recent research into networked musical instruments for group improvisation; instruments that reciprocally influence each other's behaviour, making, ...
Instrument-Centered Music Transcription of Solo Bass Guitar Recordings
This paper deals with the automatic transcription of solo bass guitar recordings with an additional estimation of playing techniques and fretboard positions used by the musician. Our goal is to first develop a system for a robust estimation of the note ...
Comments