ABSTRACT
In recent years, we have observed a strong market penetration of new human-computer interaction techniques based on touch interfaces and gestural analysis. When using gestures, unlike touch interfaces, no physical contact with the user is allowed. We must therefore seek natural and intuitive gestures that are easy to detect and interpret in order to improve user experience. In this paper, we propose a new flexible approach to navigate a multimedia kiosk based on hand movement tracking and gesture recognition. We present a review of the state of the art on the use of gestures in interactive applications, followed by implementation details about our 3D environment and our gesture recognition approach. A use case scenario for our system is discussed along with results obtained from user experiments. Finally, we detail the limitations of this system and possible improvements.
- Bohak, C., and Marolt, M. 2013. Kinect web kiosk framework. In Human Factors in Computing and Informatics, A. Holzinger, M. Ziefle, M. Hitz, and M. Debevc, Eds., vol. 7946 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 785--790.Google Scholar
- Cabral, M. C., Morimoto, C. H., and Zuffo, M. K. 2005. On the usability of gesture interfaces in virtual reality environments. In Proceedings of the 2005 Latin American Conference on Human-computer Interaction, ACM, New York, NY, USA, CLIHC '05, 100--108. Google ScholarDigital Library
- Courier, N., Letessier, J., Maisonnasse, J., and Borkowski, S. 2009. Un kiosque interactif pour espaces publics. In Proceedings of the 21st International Conference on Association Francophone D'Interaction Homme-Machine, ACM, New York, NY, USA, IHM '09, 347--350. Google ScholarDigital Library
- Lenman, S., Bretzner, L., Thuresson, B., Lenman, S., Bretzner, L., and Thuresson, B. 2002. Computer vision based hand gesture interfaces for human-computer interaction. Tech. Rep. TR TRITA-NA-D0209, Center for User Oriented IT Design (CID).Google Scholar
- Li, Y, Groenegress, C., Strauss, W., and Fleischmann, M. 2004. Gesture frame a screen navigation system for interactive multimedia kiosks. In Gesture-Based Communication in Human-Computer Interaction, A. Camurri and G. Volpe, Eds., vol. 2915 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 380--385.Google Scholar
- Nielsen, M., Strring, M., Moeslund, T., and Granum, E. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for hci. In Gesture-Based Communication in Human-Computer Interaction, A. Camurri and G. Volpe, Eds., vol. 2915 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 409--420.Google Scholar
- Norman, D. A., and Nielsen, J. 2010. Gestural interfaces: A step backward in usability. Interactions Journal Vol. 17, No. 5 (Sept.), 46--49. Google ScholarDigital Library
- Norman, D. A. 2010. Natural user interfaces are not natural. Interactions Journal Vol. 17, No. 3 (May), 6--10. Google ScholarDigital Library
- O'Hagan, R., and Zelinsky, A. 2000. Visual gesture interfaces for virtual environments. In First Australasian User Interface Conference (AUIC), 73--80. Google ScholarDigital Library
- Tashev, I. 2013. Kinect development kit: A toolkit for gesture- and speech-based human-machine interaction {best of the web}. Signal Processing Magazine, IEEE 30, 5 (Sept), 129--131.Google Scholar
- Vatavu, R.-D., and Pentiuc, S.-G. 2008. Multi-level representation of gesture as command for human computer interaction. Computing and Informatics 27, 837--851.Google Scholar
Index Terms
- Gesture interface for an interactive kiosk
Recommendations
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human InteractionThe natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Leap motion gesture based interface for learning environment by using leap motion
HCIK '15: Proceedings of HCI KoreaNUI(Natural User Interface) which means a natural user manipulation environment uses body as an input device by using a sensor, without using an input device such as a mouse or a keyboard. For these reasons, it has a feature that can be used easily as ...
Enabling Finger-Gesture Interaction with Kinect
VINCI '15: Proceedings of the 8th International Symposium on Visual Information Communication and InteractionA large number of tracking and gesture recognition algorithms and technologies have been developed in the field of human-computer interactions thanks to the introduction of cameras with depth sensors such as Microsoft's Kinect. Most of the techniques ...
Comments