Abstract
This paper proposes a novel real-time facial feature points tracking method. A 3D geometric face model is used to give a robust tracking which includes offline information that the movement constraints of facial feature points in 3D space. The iterative frame-to-frame tracking method with Gabor wavelet is used to give a high accuracy which is robust to homogeneous illumination changing and affine deformation of the face image. The former tracking method based offline information and the latter tracking method based on online information are integrated with the bundle adjustment method. We compare our method with three other typical methods. The experimental results show that it can be used for robust, real-time and wide-angle facial feature tracking.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jin, C., Bu, J.-J., Chen, H., et al.: Human face detection and feature tracking in a bottom-up way. Journal of Zhejiang University (Engineering Science) 42(5), 794–799 (2008)
Cootes, T., Walker, K., Taylor, C.: View-based active appearance models. In: Proceedings of Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, French, pp. 227–232 (2000)
Chen, S.Y., Zhang, J., Guan, Q., Liu, S.: Detection and amendment of shape distortions based on moment invariants for active shape models. IET Image Processing 5(3), 273–285 (2011)
Hou, X., Li, S., Zhan, G.H., et al.: Direct appearance models. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR 2001), Hawaii, pp. 828–833 (2001)
Feris, R.S., Cesar Jr., R.M.: Tracking Facial Features Using Gabor Wavelet Networks. In: Proceedings of XIII Brazilian Symposium on Computer Graphics and Image Processing, Gramado, pp. 22–27 (2000)
Li, Y., Lai, J.-H., Yuen, P.-C.: Multi-Template ASM and Its Application in Facial Feature Points Detection. Journal of Computer Research and Development 41(1), 133–140 (2007)
Duan, H., Cheng, Y.-M., Wang, Y.-X., et al.: Tracking Facial Feature Points Using Kanade-Lucas-Tomasi Approach. Journal of Computer-Aided Design & Computer Graphics 16(3), 279–283 (2004)
Yan, J.-G., Pan, L.-D.: Tracking Facial Feature with Gabor Wavelet. Computer Applications 24(7), 50–51 (2004)
Wiskott, L., Fellous, J.M., Kruger, N., et al.: Face Recognition by Elastic Bunch Graph Matching. IEEE Transaction on Pattern Analysis and Machine Intelligence 19(7), 775–779 (1997)
Vacchetti, L., Lepetit, V., Fua, P.: Stable real-time 3D tracking using online and offline information. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(10), 1385–1391 (2004)
Chen, S.Y., Wang, Z.J.: Acceleration Strategies in Generalized Belief Propagation. IEEE Transactions on Industrial Informatics 8(1), 41–48 (2012)
Chen, S., Zhang, J.H., Li, Y.F., Zhang, J.W.: A Hierarchical Model Incorporating Segmented Regions and Pixel Descriptors for Video Background Subtraction. IEEE Transactions on Industrial Informatics 8(1), 118–127 (2012)
Viola, P., Jones, M.: Rapid Object Detection Using a Boosted Cascade of Simple Features. In: Proceedings of 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition( CVPR 2001), Hawaii, pp. 511–518 (2001)
Dementhon, D.F., Davis, L.S.: Model-Based Object Pose in 25 Lines of Code. International Journal of Computer Vision 15(1-2), 123–141 (1995)
Vacchetti, L., Lepetit, V., Fua, P.: Fusing Online and Offline Information for Stable 3D Tracking in Real-time. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR 2003), Wisconsin, vol. 2, pp. 241–248 (2003)
Cross Correlation [EB/OL], http://en.wikipedia.org/wiki/Cross-correlation#Normalized_cross-correlation (May 31, 2009)
Triggs, B., McLauchlan, P., Hartley, R., et al.: Bundle Adjustment-A Modern Synthesis. In: Proceedings of International Workshop on Vision Algorithms (ICCV 1999), pp. 298–372 (1999)
Chen, S.: Kalman Filter for Robot Vision: a Survey. IEEE Transactions on Industrial Electronics 59(11), 4409–4420 (2012)
Chen, S.Y., Tong, H., Cattani, C.: Markov models for image labeling. Mathematical Problems in Engineering 2012, AID 814356, 18pages (2012)
William, H.P., Brian, P.F., Saul, A.T., et al.: Numerical Recipes in C, 2nd edn. Cambridge University Press
Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual tracking and recognition using probabilistic appearance manifolds. Computer Vision and Image Understanding 99(3), 303–331 (2005)
Song, G., Ai, H.-Z., Xu, G.-Y.: Texture Constrained Facial Point Tracking. Journal of Software 15(11), 1607–1615 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, X., Zhang, Y., Chai, C. (2012). Combined Online and Offline Information for Tracking Facial Feature Points. In: Su, CY., Rakheja, S., Liu, H. (eds) Intelligent Robotics and Applications. ICIRA 2012. Lecture Notes in Computer Science(), vol 7506. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33509-9_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-33509-9_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33508-2
Online ISBN: 978-3-642-33509-9
eBook Packages: Computer ScienceComputer Science (R0)