Chaithanya Kumar Mummadi
Kristof Van Laerhoven
ABSTRACT
Data gloves have numerous applications, including enabling novel human-computer interaction and automated recognition of large sets of gestures, such as those used for sign language. For most of these applications, it is important to build mobile and self-contained applications that run without the need for frequent communication with additional services on a back-end server. We present in this paper a data glove prototype, based on multiple small Inertial Measurement Units (IMUs), with a glove-embedded classifier for the french sign language. In an extensive set of experiments with 57 participants, our system was tested by repeatedly fingerspelling the French Sign Language (LSF) alphabet. Results show that our system is capable of detecting the LSF alphabet with a mean accuracy score of 92% and an F1 score of 91%, with all detections performed on the glove within 63 milliseconds.
- Helene Brashear, Thad Starner, Paul Lukowicz, and Holger Junker. 2003. Using multiple sensors for mobile sign language recognition. In ISWC 2003. IEEE Press. Google Scholar
Digital Library
- Maria E Cabrera, Juan Manuel Bogado, Leonardo Fermin, Raul Acuna, and Dimitar Ralev. 2012. Glove-based gesture recognition system. In Proc. of Intl. Conf. on climbing and walking robots and the support technologies for mobile machines. 747--753.Google ScholarCross Ref
- Pengfei Gui, Liqiong Tang, and Subhas Mukhopadhyay. 2015. MEMS based IMU for tilting measurement: Comparison of complementary and kalman filter based data fusion. In ICIEA 2015. IEEE, 2004--2009.Google ScholarCross Ref
- Christopher-Eyk Hrabia, Katrin Wolf, and Mathias Wilhelm. 2013. Whole hand modeling using 8 wearable sensors: biomechanics for hand pose prediction. In Proceedings of the 4th Augmented Human International Conference. ACM, 21--28. Google ScholarDigital Library
- Yu Huang, Dorothy Monekosso, Hui Wang, and Juan Carlos Augusto. 2011. A concept grounding approach for glove-based gesture recognition. In Intelligent Environments (IE), 2011 7th International Conference on. IEEE, 358--361. Google ScholarDigital Library
- Eunseok Jeong, Jaehong Lee, and DaeEun Kim. 2011. Finger-gesture recognition glove using velostat (ICCAS 2011). In Control, Automation and Systems (ICCAS), 2011 11th International Conference on. IEEE, 206--210.Google Scholar
- Wu Jiangqin, Gao Wen, Song Yibo, Liu Wei, and Pang Bo. 1998. A simple sign language recognition system based on data glove. In Signal Processing Proceedings, 1998. ICSP'98. 1998 Fourth International Conference on, Vol. 2. IEEE, 1257--1260.Google ScholarCross Ref
- Kunal Kadam, Rucha Ganu, Ankita Bhosekar, and SD Joshi. 2012. American Sign Language Interpreter. In Technology for Education (T4E), 2012 IEEE Fourth International Conference on. IEEE, 157--159. Google ScholarDigital Library
- Yousuf Khambaty, Rolando Quintana, Mehdi Shadaram, Sana Nehal, Muneeb Ali Virk, Waqar Ahmed, and Ghayas Ahmedani. 2008. Cost effective portable system for sign language gesture recognition. In System of Systems Engineering, 2008. SoSE'08. IEEE International Conference on. IEEE, 1--6.Google ScholarCross Ref
- Jonghwa Kim, Johannes Wagner, Matthias Rehm, and Elisabeth André. 2008. Bi-channel sensor fusion for automatic sign language recognition. In Automatic Face & Gesture Recognition, 2008. FG'08. 8th IEEE International Conference on. IEEE, 1--6.Google ScholarCross Ref
- T Kuroda, Y Tabata, A Goto, H Ikuta, M Murakami, and others. 2004. Consumer price data-glove for sign language recognition. In Proc. of 5th Intl Conf. Disability, Virtual Reality Assoc. Tech., Oxford, UK. 253--258.Google Scholar
- Cemil Oz and Ming C Leu. 2007. Linguistic properties based on American Sign Language isolated word recognition with artificial neural networks using a sensory glove and motion tracker. Neurocomputing 70, 16 (2007), 2891--2901. Google ScholarDigital Library
- Y. Park, J. Lee, and J. Bae. 2014. Development of a finger motion measurement system using linear potentiometers. In IEEE/ASME Intl. Conf. on Advanced Intelligent Mechatronics. 125--130.Google Scholar
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830. Google ScholarDigital Library
- John Kangchun Perng, Brian D. Fisher, Seth Hollar, and Kristofer S. J. Pister. 1999. Acceleration Sensing Glove (ASG). In Proc. of Third International Symposium on Wearable Computers (ISWC 1999). 178--180. Google ScholarDigital Library
- David J Sturman and David Zeltzer. 1994. A survey of glove-based input. Computer Graphics and Applications, IEEE 14, 1 (1994), 30--39. Google ScholarDigital Library
- Netchanok Tanyawiwat and Surapa Thiemjarus. 2012. Design of an assistive communication glove using combined sensory channels. In Wearable and Implantable Body Sensor Networks (BSN), 2012 Ninth International Conference on. IEEE, 34--39. Google ScholarDigital Library
- Noor Tubaiz, Tamer Shanableh, and Khaled Assaleh. 2015. Glove-based continuous Arabic sign language recognition in user-dependent mode. Human-Machine Systems, IEEE Transactions on 45, 4 (2015), 526--533.Google Scholar
- Satjakarn et al. Vutinuntakasame. 2011. An assistive body sensor network glove for speech-and hearing-impaired disabilities. In Body Sensor Networks (BSN), 2011 International Conference on. IEEE, 7--12. Google ScholarDigital Library
- Thomas G. Zimmerman, Jaron Lanier, Chuck Blanchard, Steve Bryson, and Young Harvill. 1987. A Hand Gesture Interface Device. In Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87). ACM, New York, NY, USA, 189--192. Google ScholarDigital Library
Index Terms
- Real-time Embedded Recognition of Sign Language Alphabet Fingerspelling in an IMU-Based Glove
Recommendations
Visualization of Grasping Operations based on Hand Kinematics measured through Data Glove
AIR '17: Proceedings of the 2017 3rd International Conference on Advances in RoboticsAlthough a number of prosthetic hands have been reported, anthropomorphic control is still a challenge. Precise determination of human hand kinematics will certainly enhance the control for prosthetic hands. One of the ways to push the research forward ...
Recognition of sign language with an inertial sensor-based data glove
Recent Innovations on Biomedical EngineeringCommunication between people with normal hearing and hearing impairment is difficult. Recently, a variety of studies on sign language recognition have presented benefits from the development of information technology. This study presents a sign language ...
A glove-based gesture recognition system for Vietnamese sign language
2015 15th International Conference on Control, Automation and Systems (ICCAS)In this paper, we address a development of a glove-based gesture recognition system for Vietnamese sign language. A sensor glove is attached ten flex sensors and one accelerometer. Here, flex sensors are used for sensing the curvature of fingers and the ...
Comments