Abstract
This paper presents a system for hand posture recognition that works with colour video streams under varying light conditions for human-machine interaction in vision-based interface tasks. No initialization of the system is required and no user dependence is involved. With this aim, we first model on-line each user’s skin colour from the skin cue imaging of his/her face detected by means of Viola and Jones detector. Afterwards, a second order isomorphism approach performs tracking on skin colour blob based detected hand. Also, we propose this approach as a mechanism to estimate hand transition states. Finally, evidences about hand postures are recognized by shape matching, which is carried out through a holistic similarity measure focused on the Hausdorff distance. The paper includes experimental evaluations of the recognition system for 16 different hand postures in different video streams. The results show that the system can be suitable for real-time interfaces using general purpose hardware.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Turk, M.: Computer Vision in the Interface. Communications of the ACM 47(1), 61–67 (2004)
Pentland, A.P.: Perceptual Intelligence. Communications of the ACM 43(3), 35–44 (2000)
Gavrila, D.M.: The Visual Analysis of Human Movement: A Survey. In: Computer Vision and Image Understanding, vol. 73(1), pp. 82–89. Academic Press, London (1999)
Triesch, J., von der Malsburg, C.: A system for Person-Independent Hand Posture Recognition against Complex Bacgrounds. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(12), 1449–1453 (2001)
Bretzner, L., Laptev, I., Lindeberg, T.: Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering. In: 5th IEEE International Conference on Automatic Face and Gesture Recognition, Washington, DC, USA, May 21-22, 2002, pp. 423–428 (2002)
Wu, Y., Huang, T.S.: View-independent Recognition of Hand Postures. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Head Island, SC, vol. 2, pp. 88–94 (June 2000)
Elgammal, A., Shet, V., Yacoob, Y., Davis, L.S.: Gesture Recognition using a Probabilistic Framework for Pose Matching. In: 7th International Conference on Control, Automation, Robotics and Vision, ICARCV 2002, Singapore (2002)
Viola, P., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition (2001)
Wren, C., Azarrbayejani, A., Darrell, T., Pentland, A.: Pfinder. ”Real-Time Tracking of the Human Body”. IEEE Trans. on Pattern Analysis and Machine Intelligence 19(7) (1997)
Schneiderman, H., Kanade, T.: A statistical method for 3d object detection applied to faces and cars. In: IEEE Conference on Computer Vision and Pattern Recognition (2000)
Edelman, S.: Representation and Recognition in Vision. MIT Press, Cambridge (1999)
Guerra, C., Hernndez, M., Domnguez, A., Hernndez, D.: A New Approach to the Template Update Problem. In: Marques, J.S., Pérez de la Blanca, N., Pina, P. (eds.) IbPRIA 2005. LNCS, vol. 3522, pp. 217–224. Springer, Heidelberg (2005)
Rucklidge, W.: Efficient Visual Recognition Using the Hausdorff Distance. LNCS, vol. 1173. Springer, Heidelberg (1996)
Paglieroni, D.W.: Distance Transforms: properties and machine vision applications. GVGIP:Graphical Models and Image Processing 54(1), 56–74 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sánchez-Nielsen, E., Antón-Canalís, L., Guerra-Artal, C. (2006). An Autonomous and User-Independent Hand Posture Recognition System for Vision-Based Interface Tasks. In: Marín, R., Onaindía, E., Bugarín, A., Santos, J. (eds) Current Topics in Artificial Intelligence. CAEPIA 2005. Lecture Notes in Computer Science(), vol 4177. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11881216_13
Download citation
DOI: https://doi.org/10.1007/11881216_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45914-9
Online ISBN: 978-3-540-45915-6
eBook Packages: Computer ScienceComputer Science (R0)