Abstract
The VR technology is undergoing a series of evolution, including not only the higher video quality but also more fluent human-computer interaction operations. Current solution mainly use camera-based or specified equipment-based hand gesture recognition, where the former suffers from low accuracy and limited interaction capacity while the latter suffers from expensive cost. In this paper, we propose Ultragloves, which is a high accurate finger-level and low cost gesture interaction system for VR and smartphones. Specifically, it is enabled by the gloves implanting multiple microphones with which the ultrasonic signal are played. In the VR or mobile devices, the hand gestures are rebuilt with the recorded FMCW-signal and the hand motion model. Furthermore, to improve the accuracy and calculation speed, we propose a parallel processing algorithm for the signals, which could greatly accelerate our solution to real time manner even in COTS smartphones. The real implementation based experiments shows that, Ultragloves could capture the gestures in the accuracy of 2 cm while the parallel algorithm could accelerate the solution with about 3 times.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, H., Li, F., Wang, Y.: EchoTrack: acoustic device-free hand tracking on smart phones. In: Proceedings of IEEE INFOCOM, pp. 1–9. IEEE (2017)
Chen, Y., Wei, G., Liu, J., Yong, C.: Fine-grained ultrasound range finding for mobile devices: sensing way beyond the 24 khz limit of built-in microphones. In: Computer Communications Workshops (2017)
Leap: Leapmotion (2019). https://www.leapmotion.com/
Ling, K., Dai, H., Liu, Y., Liu, A.X.: Ultragesture: fine-grained gesture sensing and recognition. In: Proceedings of IEEE SECON. IEEE (2018)
Nandakumar, R., Iyer, V., Tan, D., Gollakota, S.: FingerIO: using active sonar for fine-grained finger tracking. In: Proceedings of the ACM CHI, pp. 1515–1525. ACM (2016)
Sun, K., Wang, W., X. Liu, A., Dai, H.: Depth aware finger tapping on virtual displays, pp. 283–295, June 2018. https://doi.org/10.1145/3210240.3210315
Discuz! Techology: Synertial (2019). http://www.disonde.com/
Venkatnarayan, R.H., Page, G., Shahzad, M.: Multi-user gesture recognition using WiFi. In: Proceedings of ACM Mobisys, pp. 401–413. ACM (2018)
Wang, W., Liu, A.X., Sun, K.: Device-free gesture tracking using acoustic signals. In: Proceedings of ACM Mobicom, pp. 82–94. ACM (2016)
Yu, N., Wang, W., Liu, A.X., Kong, L.: QGesture: quantifying gesture distance and direction with WiFi signals. Proc. ACM Ubicomp 2(1), 51 (2018)
Yun, S., Chen, Y.C., Zheng, H., Qiu, L., Mao, W.: Strata: fine-grained acoustic-based device-free tracking. In: Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services, pp. 15–28. ACM (2017)
Zhang, C., et al.: Soundtrak: continuous 3D tracking of a finger using active acoustics. Proc. ACM Ubicomp 1(2), 30 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, S., Zhao, Y., Liu, C. (2020). Ultragloves: Lowcost Finger-Level Interaction System for VR-Applications Based on Ultrasonic Movement Tracking. In: Wen, S., Zomaya, A., Yang, L.T. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2019. Lecture Notes in Computer Science(), vol 11945. Springer, Cham. https://doi.org/10.1007/978-3-030-38961-1_41
Download citation
DOI: https://doi.org/10.1007/978-3-030-38961-1_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-38960-4
Online ISBN: 978-3-030-38961-1
eBook Packages: Computer ScienceComputer Science (R0)