Abstract
We present in this paper a system named PoG. Its role is to recognise and interpret natural pointing gestures in the context of a multimodal interaction. The user’s hand gestures are tracked by a camera located above a building plan. The user points to a room on the plan with his index finger while using speech to ask for some information from the system. The PoG system is composed of an extraction process, which computes visual primitives, a recognition process, providing the name of the gesture, and a localisation process, which computes the coordinates of the index tip.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Braffort, A., Gherbi, R.: Video-Tracking and Recognition of Pointing Gestures using Hidden Markov Models. In Proceeding of IEEE Inter. Conf. on Intelligent Engineering Systems, Vienna, Austria, September, 1998.
M. Assan, M., Grobel, K.: Video-Based Sign Language Recognition Using Hidden Markov Models. In Gesture and Sign Language in Human-Computer Interaction, I. Wachsmuth & M. Fröhlich (Eds.), Lecture Notes in Artificial Intelligence # 1371, Springer-Verlag, 1998.
Nölker, C., Ritter, H.: Detection of Fingertips in Human Hand Movement Sequences. In Gesture and Sign Language in Human-Computer Interaction. I. Wachsmuth & M. Fröhlich (Eds.), Lecture Notes in Artificial Intelligence # 1371, Springer-Verlag, 1998.
Latoschik, M. E., I. Wachsmuth, I.: Exploiting Distant Pointing Gestures for Objects Selection in a Virtual Environment. In Gesture and Sign Language in Human-Computer Interaction, I. Wachsmuth & M. Fröhlich (Eds.), Lecture Notes in Artificial Intelligence # 1371, Springer-Verlag, 1998.
Kahn, R. E., Swain, M. J.: Understanding people pointing: The Perseus system. In Proceedings of the International Symposium on Computer Vision, November 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gherbi, R., Braffort, A. (1999). Interpretation of Pointing Gestures: The PoG System. In: Braffort, A., Gherbi, R., Gibet, S., Teil, D., Richardson, J. (eds) Gesture-Based Communication in Human-Computer Interaction. GW 1999. Lecture Notes in Computer Science(), vol 1739. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46616-9_14
Download citation
DOI: https://doi.org/10.1007/3-540-46616-9_14
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66935-7
Online ISBN: 978-3-540-46616-1
eBook Packages: Springer Book Archive