Abstract
Challenges from the uncontrolled environments are the main difficulties in making hand gesture recognition methods robust in real-world scenarios. In this paper, we propose a real-time and purely vision-based method for hand gesture recognition in uncontrolled environments. A novel tracking method is introduced to track multiple hand candidates from the first frame. The movement directions of all hand candidates are extracted as trajectory features. A modified HCRF model is used to classify gestures. The proposed method can survive challenges including: gesturing hand out of the scene, pause during gestures, complex background, skin-coloured regions moving in background, performers wearing short sleeve and face overlapping with hand. The method has been tested on Palm Graffiti Digits database and Warwick Hand Gesture database. Experimental results show that the proposed method can perform well in uncontrolled environments.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bao, J., Song, A., Guo, Y., Tang, H.: Dynamic Hand Gesture Recognition Based on SURF Tracking. In: International Conference on Electric Information and Control Engineering, ICEICE (2011)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: SURF: Speeded-Up Robust Features. Computer Vision and Image Understanding (CVIU) 110(3), 346–359 (2008)
Elmezain, M., Al-Hamadi, A., Michaelis, B.: A Robust Method for Hand Gesture Segmentation and Recognition Using Forward Spotting Scheme in Conditional Random Fields. In: International Conference on Pattern Recognition, ICPR, pp. 3850–3853 (2010)
Alon, J., Athitsos, V., Yuan, Q., Sclaroff, S.: A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 1685–1699 (September 2009)
Correa, M., Ruiz-del-Solar, J., Verschae, R., Lee-Ferng, J., Castillo, N.: Real-Time Hand Gesture Recognition for Human Robot Interaction. In: Baltes, J., Lagoudakis, M.G., Naruse, T., Ghidary, S.S. (eds.) RoboCup 2009. LNCS, vol. 5949, pp. 46–57. Springer, Heidelberg (2010)
Malgireddy, M.R., Nwogu, I., Ghosh, S., Govindaraju, V.: A Shared Parameter Model for Gesture and Sub-gesture Analysis. In: Aggarwal, J.K., Barneva, R.P., Brimkov, V.E., Koroutchev, K.N., Korutcheva, E.R. (eds.) IWCIA 2011. LNCS, vol. 6636, pp. 483–493. Springer, Heidelberg (2011)
Quattoni, A., Wang, S., Morency, L.P., Collins, M., Darrell, T.: Hidden-state Conditional Random Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 1848–1852 (October 2007)
Viola, P., Jones, M.J.: Robust Real-Time Face Detection. International Journal of Computer Vision 57, 137–154 (2004)
Jones, M.J., Rehg, J.M.: Statistical Color Models with Application to Skin Detection. International Journal of Computer Vision 46(1), 81–96 (2002)
Liu, D.C., Nocedal, J.: On the Limited Memory BFGS Method for Large Scale Optimization. Mathematical Programming 45(1-3), 503–528 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yao, Y., Li, CT. (2013). Real-Time Hand Gesture Recognition for Uncontrolled Environments Using Adaptive SURF Tracking and Hidden Conditional Random Fields. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2013. Lecture Notes in Computer Science, vol 8034. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41939-3_53
Download citation
DOI: https://doi.org/10.1007/978-3-642-41939-3_53
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41938-6
Online ISBN: 978-3-642-41939-3
eBook Packages: Computer ScienceComputer Science (R0)