Abstract
Haptic interaction is a fundamental approach to our perception surrounding people; at this stage, haptic interaction is mainly used in virtual reality (VR) and remote medical procedures (teleoperation). The traditional large volume, complex operation seriously affects the function of immersive. This paper develops a multi-modal sensing interactive glove system for teleoperation and VR/AR. The device is small in size and convenient to wear; we integrate temperature sensing and tactile sensing into our glove system and deliver real-time and accurate environmental signals to the wearer through the acquisition and processing of information and program-controlled regulation to better realize the fusion of virtual and real. This paper first introduces the structure and working principle of the system and analyzes its performance. Then a sensory experiment based on human hand skin was designed, and volunteers were selected to experience it.
This paper is supported by the National Key Research and Development Program of China (2021YFF0600203); the Zhejiang Provincial Natural Science Foundation (LY20F020019, LQ19F020012, LQ20F020001); the Zhejiang Basic Public Welfare Research Project (LGF19E050005); the Major Scientific Research Project of the Zhejiang Laboratory (2019MC0AD01, 2022MG0AC04).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, D., Guo, Y., Liu, S., Zhang, Y., Xiao, J.: Haptic display for virtual reality: progress and challenges. Virtual Real. Intell. Hardware 1(2), 136–162 (2019)
Niedenthal, S., P Lundén, Ehrndal, M., Olofsson, J.: A handheld olfactory display for smell-enabled VR games. In: IEEE International Symposium on Olfaction and Electronic Nose, pp. 1–4 (2019)
Narumi, T., Kajinami, T., Nishizaka, S., Tanikawa, T., Hirose, M.: Pseudo-gustatory display system based on cross-modal integration of vision, olfaction and gustation. In: 2011 IEEE Virtual Reality Conference (VR), pp. 127–130 (2011)
Cheng-jun, D., Ping, D., Ming-lu, Z., Yan-fang, Z.: Design of mobile robot teleoperation system based on virtual reality. In: 2009 IEEE International Conference on Automation and Logistics, pp. 2024–2029 (2009)
Verna, D.: Virtual reality and tele-operation: a common framework. In: World Multiconference on Systemics, Cybernetics and Informatics (SCI 2001) v.3: Emergent Computing and Virtual Engineering, pp. 499–504 (2001)
Tamura, Y., Fujiwara, S., Umetani, T., Nakamura, H.: Bracelet-shaped thermal display for representing numerical data. J. Electron. Mater. 40(5), 823–829 (2011)
Ho, H. N., Jones, L. A.: Thermal model for hand-object interactions. Haptic interfaces for virtual environment and teleoperator systems, pp. 461–467(2006)
Simon, G., Giulio, R., Laura, S. C., Tristan, V., Olaf, B., Hannes, B.: Encoded and crossmodal thermal stimulation through a fingertip-sized haptic display. Front. Robot. AI 2(25) (2015)
Kato, F., Inoue, Y., Tachi, S.: Haptic display glove capable of force/vibration/temperature. In: 2019 IEEE International Symposium on Measurement and Control in Robotics (ISMCR), D2–2 (2019)
Tachi, S., Mlnamlzawa, K., Furukawa, M., Fernando, C.L.: Haptic media construction and utilization of human-harmonized “tangible” information environment. In: International Conference on Artificial Reality & Telexistence, pp. 145–150 (2013)
Gabardi, M., Leonardis, D., Solazzi, M., Frisoli, A.: Development of a miniaturized thermal module designed for integration in a wearable haptic device. In: 2018 IEEE Haptics Symposium (HAPTICS), pp. 100–105 (2018)
Murakami, T., Person, T., Fernando, C.L., Minamizawa, K.: Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics. In: ACM SIGGRAPH 2017 Emerging Technologies, pp. 1–2 (2017)
Watanabe, T., Fukui, S.: A method for controlling tactile sensation of surface roughness using ultrasonic vibration. In: Proceedings of 1995 IEEE International Conference on Robotics and Automation, pp. 1134–1139 (1995)
Elhajj, I., et al.: Haptic information in internet-based teleoperation. Trans. Mechatron. IEEE/ASME 6(3), 295–304 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yao, X. et al. (2023). Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR. In: Wang, D., et al. Haptic Interaction. AsiaHaptics 2022. Lecture Notes in Computer Science, vol 14063. Springer, Cham. https://doi.org/10.1007/978-3-031-46839-1_15
Download citation
DOI: https://doi.org/10.1007/978-3-031-46839-1_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-46838-4
Online ISBN: 978-3-031-46839-1
eBook Packages: Computer ScienceComputer Science (R0)