Abstract
This paper focuses on emotional effects of storytelling-based hand gesture interaction in a VR (Virtual Reality) environment. Unlike using depth cameras like Kinect sensor, a wearable band is proposed to detect users’ hand gestures to create a virtual reality film. The VR film is created using a storytelling-based hand gesture recognition system and focuses on the users’ emotional effects. For the design, the hand gestures suitable for the story in the film are derived from research on users and are applied to the VR film titled ‘Not Alone’. In order to recognize the hand gestures of the user, the data collected from the wearable band is analyzed to classify movements of the hand through machine learning, which helps to solve problems of the existing hand gestures. This study proposes hand gesture interaction that is most suitable for users with two free hands in the head mounted display HMD (Head Mounted Display) based VR environment and tries to maximize users’ emotional responses in narrative-based film content by developing storytelling-based hand gesture interaction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Villaroman, N., Rowe, D., Swan, B.: Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor. In: Proceedings of the 2011 Conference on Information Technology Education, pp. 227–232. ACM (2011)
Baudel, T., Beaudouin-Lafon, M.: Charade: remote control of objects using free-hand gestures. Commun. ACM 36(7), 28–35 (1993)
Rekimoto, J.: Gesturewrist and gesturepad: unobtrusive wearable interaction devices. In: Proceedings of the Fifth International Symposium on Wearable Computers, 2001, pp. 21–27. IEEE (2001)
Kang, J.: Affective multimodal story-based interaction design for VR cinema. In: Chung, W., Shin, C.S. (eds.) Advances in Affective and Pleasurable Design. Advances in Intelligent Systems and Computing, pp. 593–604. Springer, Cham (2017)
Norman, D.A.: The Design of Everyday Things, pp. 46–48. Doubleday, New York City (1990)
Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Syst. J. 39(3–4), 915–931 (2000)
Acknowledgments
This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2015-0-00363) supervised by the IITP (Institute for Information & communications Technology Promotion).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Kang, J., Lim, J. (2018). Storytelling-Based Hand Gesture Interaction in a Virtual Reality Environment. In: Ahram, T., Falcão, C. (eds) Advances in Human Factors in Wearable Technologies and Game Design. AHFE 2017. Advances in Intelligent Systems and Computing, vol 608. Springer, Cham. https://doi.org/10.1007/978-3-319-60639-2_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-60639-2_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60638-5
Online ISBN: 978-3-319-60639-2
eBook Packages: EngineeringEngineering (R0)