Abstract
We researched gesture interfaces for people with motor dysfunction who cannot use normal interface switches. For this purpose, we have developed nine gesture recognition modules. One of them is the tongue recognition module that detects whether the tongue is in or out for the switch interface. In the process of collecting data on various types of mouth and tongue gestures and user’s demands, we discovered three useful types of mouth-related gestures: mouth open/close, tongue in/out, and movement around the lips. These gestures are also useful when performed simultaneously. We conducted several experiments using data of people with motor dysfunction and inspected the conditions for real use. Furthermore, we conducted a basic experiment with healthy people to recognize three gestures simultaneously.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yoda, I., Itoh, K., Nakayama, T.: Collection and classification of gestures from people with severe motor dysfunction for developing modular gesture interface. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9176, pp. 58–68. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20681-3_6
Yoda, I., Ito, K., Nakayama, T.: Long-term evaluation of a modular gesture interface at home for persons with severe motor dysfunction. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2016. LNCS, vol. 9738, pp. 102–114. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40244-4_11
Yoda, I., Itoh, K., Nakayama, T.: Modular gesture interface for people with severe motor dysfunction: foot recognition. In: Proceedings of AAATE 2017, (Harnessing the Power of Technology to Improve Lives), pp. 725–732. IOS Press (2017)
Yoda, I., Ozawa, Y., Nishida, D., Mizuno, K., Itoh, K., Nakayama, T.: Gesture-based control for people persons with severe motor dysfunction by AAGI. In: IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech 2020), pp. 63–64 (2020)
Yoda, I., Nakayama, T., Itoh, K., Nishida, D., Mizuno, K.: Application of gesture interface to transcription for people with motor dysfunction. In: Miesenberger, K., Manduchi, R., Covarrubias Rodriguez, M., Peňáz, P. (eds.) ICCHP 2020. LNCS, vol. 12377, pp. 343–347. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58805-2_40
Gesture Interface Homepage. http://gesture-interface.jp/en/. Accessed 3 Apr 2022
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Yoda, I., Itoh, K., Nakayama, T. (2022). Extended Mouth/Tongue Gesture Recognition Module for People with Severe Motor Dysfunction. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penáz, P. (eds) Computers Helping People with Special Needs. ICCHP-AAATE 2022. Lecture Notes in Computer Science, vol 13341. Springer, Cham. https://doi.org/10.1007/978-3-031-08648-9_42
Download citation
DOI: https://doi.org/10.1007/978-3-031-08648-9_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-08647-2
Online ISBN: 978-3-031-08648-9
eBook Packages: Computer ScienceComputer Science (R0)