Junhao Shi
ABSTRACT
We present a vision-based gesture interaction technique that is capable of tracking both hands in real-time. By only recovering features calculated from images, large amount of computation for 3D reconstructing and features tracking in 3D voxel grid is avoided. Thus, our system becomes an ideal tool for bimanual 3D gesture interaction, which needs neither markers nor gloves. Experimental results show that our method can complete the same pipeline with much less computational resource compared to existing ones. What's more, the application interface shows the effectiveness and intuitiveness of our bimanual tracking method.
- Benko, H., Ishak, E. W. and Feiner, S. 2005. Cross-dimensional gestural interaction techniques for hybrid immersive environments, Proceedings of IEEE Virtual Reality, 209--216. Google Scholar
Digital Library
- Sturman, D. J. and Zeltzer, D. 1994. A survey of glove-based input. IEEE Computer Graphics and Applications, 14, 1 (Jan. 1994.), 30--39. Google ScholarDigital Library
- Kessler, G. D., Hodges, L. F. and Walker, N. 1995. Evaluation of the CyberGlove as a whole-hand input device. ACM Transactions on Computer-Human Interaction, 2, 4 (Dec. 1995.), 263--283. Google ScholarDigital Library
- Pavlović, V. I., Sharma, R. and Huang, T. S. 1997. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 7 (Jul. 1997), 677--695. Google ScholarDigital Library
- Wu, Y. and Huang, T. S. 2001. Hand modeling, analysis, and recognition. IEEE Signal Processing Magazine, 18, 3 (May 2001), 51--60.Google Scholar
- Schlattmann, M., Kahlesz, F., Sarlette, R. and Klein, R. 2007. Markerless 4 gestures 6 DOF real-time visual tracking of the human hand with automatic initialization. Computer Graphics Forum, 26, 3 (Sep. 2007), 467--476.Google ScholarCross Ref
- Malik, S. and Laszlo, J. 2004. Visual touchpad: a two-handed gestural input device. Proceedings of the 6th international conference on Multimodal interfaces, 289--296. Google ScholarDigital Library
- Argyros, A. A. and Lourakis, M. I. A. 2006. Vision-Based interpretation of hand gestures for remote control of a computer mouse. Computer Vision in Human-Computer Interaction, 40--51. Google ScholarDigital Library
- Wang, R. Y. and Popović, J. 2009. Real-time hand-tracking with a color glove. ACM Transaction on Graphics, 28, 3 (Aug, 2009), 1--8. Google ScholarDigital Library
- Stenger, B., Torr, P. H. S. and Cipolla, R. 2006. Model-based hand tracking using a hierarchical bayesian filter. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 9 (Sep. 2006), 1372--1384. Google ScholarDigital Library
- Liu, N., Lovell, B. C., Kootsookos, P. J. and Davis, R. I. A. 2004. Model structure selection and training algorithms for a HMM gesture recognition system. International Workshop in Frontiers of Handwriting Recognition, 100--105. Google ScholarDigital Library
- Stenger., B. D. R. 2006. Template-based hand pose recognition using multiple cues. Asian Conference on Computer Vision, II, 551--560. Google ScholarDigital Library
- Sato, Y., Saito, M. and Koik, H. 2001. Real-time input of 3D pose and gestures of a user's hand and its applications for HCI. Proceedings of IEEE Virtual Reality, 79--86. Google ScholarDigital Library
- Conseil, S., Bourennane S. and Martin, L. 2005. Three dimensional fingertip tracking in stereovision. International Conference on Advanced Concepts for Intelligent Vision Systems, 9--16. Google ScholarDigital Library
- Schlattman, M. and Klein R. 2007. Simultaneous 4 gestures 6 DOF real-time two-hand tracking without any markers. Proceedings of the 2007 ACM symposium on Virtual reality software and technology, 39--42. Google ScholarDigital Library
- Pan, Z., Li, Y., Zhang, M., Sun, C., Guo, K., Tang, X. and Zhou, St. 2010. A real-time multi-cue hand tracking algorithm based on computer vision. IEEE Virtual Reality 2010 Conference, 219--222. Google ScholarDigital Library
- Intel Corporation. Open Source Computer Vision Library Reference Manual v 2.2, December 2010.Google Scholar
- Lee, T. and Höllerer, T. 2007. Handy AR: markerless inspection of augmented reality objects using fingertip tracking. IEEE International Symposium on Wearable Computers, 83--90. Google ScholarDigital Library
- J.-Y. Bouguet, Camera Calibration Toolbox for Matlab®, Standard Version, 2005, http://www.vision.caltech.edu/bouguetj/calib_doc/.Google Scholar
Index Terms
- A real-time bimanual 3D interaction method based on bare-hand tracking
Recommendations
A Real Time Vision-Based Hand Gesture Interaction
AMS '10: Proceedings of the 2010 Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer SimulationMoving beyond mouse and keyboard, the evolution of human-computer interaction (HCI) has been an interest research in recent years which witnessed the development from text-based like using a keyboard to graphic user interface (GUI) based on a mouse, ...
Multi-finger gestural interaction with 3D volumetric displays
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersVolumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Multi-finger gestural interaction with 3D volumetric displays
Volumetric displays provide interesting opportunities and challenges for 3D interaction and visualization, particularly when used in a highly interactive manner. We explore this area through the design and implementation of techniques for interactive ...
Comments