Abstract
Robust hand tracking is highly demanded for many real-world applications relevant to human machine interface. However, current methods achieve no satisfactory robustness in real environments. In this paper a novel hand tracking method was proposed integrating online Hough Forest and Flocks-of-Features tracking. Skin color was integrated in the Hough Forest framework to gain more robustness against drastic hand appearance and pose changes, especially against partial occlusions. Also a novel multi-cue Flocks-of-Features tracking algorithm based on computer graphics was integrated in to enhance the framework’s robustness against distractors and background clutter. Additionally, recovery from tracking failure was addressed. Lots of experiments were carried out to evaluate our method, also to compare it with CAMShift, Hough Forest tracker, and the original Flocks-of-Features Tracker, and showed the effectiveness of our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: Vision-based hand pose estimation: A review. Computer Vision and Image Understanding 108, 52–73 (2007)
Rehg, J., Kanade, T.: Digiteyes: Vision-based hand tracking for human-computer interaction. In: Proceedings of the Workshop on Motion of Non-Rigid and Articulated Bodies, pp. 16–22 (1994)
Stenger, B., Thayananthan, A., Torr, P.H.S., Cipolla, R.: Model-based hand tracking using a hierarchical bayesian filter. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 1372–1384 (2006)
Bradski, G.R.: Real-time face and object tracking as a component of a perceptual user interface. In: IEEE Workshop on Applications of Computer Vision, pp. 214–219 (1998)
Isard, M., Blake, A.: CONDENSATION - conditional density propagation for visual tracking. International Journal of Computer Vision 29, 5–28 (1998)
Donoser, M., Bischof, H.: Real time appearance based hand tracking. In: Proceedings of the International Conference on Pattern Recognition, pp. 1–4 (2008)
Tomasi, C., Petrov, S., Sastry, A.: 3D tracking = classification + interpolation. In: Proceedings of the International Conference on Computer Vision, vol. 2, pp. 1441–1448 (2003)
Ong, E.J., Bowden, R.: A boosted classifier tree for hand shape detection. In: Proceedings of International Conference on Automatic Face and Gesture Recognition, pp. 889–894 (2004)
Avidan, S.: Ensemble tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 261–271 (2007)
Leibe, B., Leonardis, A., Schiele, B.: Combined object categorization and segmentation with an implicit shape model. In: Proceedings of ECCV Workshop on Statistical Learning in Computer Vision, pp. 17–32 (May 2004)
Gall, J., Lempitsky, V.: Class-specific hough forests for object detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1022–1029 (2009)
Godec, M., Roth, P.M., Bischof, H.: Hough-based tracking of non-rigid objects. In: International Conference on Computer Vision, pp. 81–88 (2011)
Grossberg, S.: Competitive learning: From interactive activation to adaptive resonance. Cognitive Science 11, 23–63 (1987)
Kolsch, M., Turk, M.: Fast 2D hand tracking with flocks of features and Multi-Cue integration. In: IEEE Conference on Computer Vision and Pattern Recognition Workshop, pp. 1–8 (2005)
Reynolds, C.W.: Flocks, herds and schools: A distributed behavioral model. SIGGRAPH Comput. Graph. 21, 25–34 (1987)
Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23, 309–314 (2006)
Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the 1981 DARPA Image Understanding Workshop, pp. 121–130 (1981)
Santner, J., Leistner, C., Saffari, A., Pock, T., Bischof, H.: Prost parallel robust online simple tracking. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 720–730 (2010)
Kalal, Z., Matas, J., Mikolajczyk, K.: P-n learning: Bootstrapping binary classifiers by structural constraints. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 49–56 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, H., Cui, W., Ding, R. (2012). Robust Hand Tracking with Hough Forest and Multi-cue Flocks of Features. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2012. Lecture Notes in Computer Science, vol 7432. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33191-6_45
Download citation
DOI: https://doi.org/10.1007/978-3-642-33191-6_45
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33190-9
Online ISBN: 978-3-642-33191-6
eBook Packages: Computer ScienceComputer Science (R0)