Skip to main content

Robust Facial Landmark Detection for Intelligent Vehicle System

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 3723))

Abstract

This paper presents an integrated approach for robustly loca ting facial landmark for drivers. In the first step a cascade of probability learners is used to detect the face edge primitives from fine to coarse, so that faces with variant head poses can be located. The edge density descriptors and skin-tone color features are combined together as the basic features to examine the probability of an edge being a face primitive. A cascade of the probability learner is used. In each scale, only edges with sufficient large probabilities are kept and passed on to the next scale. The final output of the cascade gives the edge primitives that belong to faces, which determine the face location. In the second step, a facial landmark detection procedure is applied on the segmented face pixels. Facial landmark candidates are first detected by learning the posteriors in multiple resolutions. Then geometric constraint and the local appearance, modeled by SIFT descriptor, are used to find the set of facial landmarks with largest matching score. Experiments over high-resolution images (FERET database) as well as the real-world drivers’ data are used to evaluate the performance. A fairly good results can be obtained, which validates the proposed approach.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Hu, C., Feris, R.S., Turk, M.: Real-time View-Based Face Alignment Using Active Wavelet Networks. In: Proceedings of ICCV 2001 International Conference on Computer Vision, Workshop on Analysis and Modeling of Faces and Gestures, Nice, France (October 2003)

    Google Scholar 

  2. Braathen, B., Bartlett, M.S., Movellan, J.R.: 3-D Head Pose Estimation from Video by Stochastic Particle Filtering. In: Proceedings of the 8th Annual Joint Symposium on Neural Computation (2001)

    Google Scholar 

  3. Bourel, F., Chibelushi, C.C., Low, A.A.: Robust Facial Expression Recognition Using a State-Based Model of Spatially-Localised Facial Dynamics. In: Proceedings of the Fifth International Conference on Automatic Face and Gesture Recognition, Washington D.C., USA, May 20 - 21, pp. 106–111 (2002)

    Google Scholar 

  4. Liu, F., Lin, X., Li, S.Z., Shi, Y.: Multi-Modal Face Tracking Using Bayesian Network. In: Proceedings of IEEE International Workshop on Analysis and Modeling of Faces and Gestures, Nice, France (2003)

    Google Scholar 

  5. Xue, Z., Li, S.T., Teoh, E.K.: Bayesian shape model for facial feature extraction and recognition. Pattern Recognition 36(12), 2819–2833 (2003)

    Article  MATH  Google Scholar 

  6. Zhou, Y., Gu, L., Zhang, H.J.: Bayesian Tangent Shape Model: Estimating Shape and Pose Parameters via Bayesian Inference. In: Proceeding of The IEEE Conference on Computer Vision and pattern Recognition (CVPR 2003), Wisconsin, USA, June 16-22 (2003)

    Google Scholar 

  7. Wiskott, L., Fellous, J.-M., Kruger, N., von der Malsburg, C.: Face recognition by elastic bunch graph matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 775–779 (1997)

    Article  Google Scholar 

  8. Feris, R., Gemmell, J., Toyama, K., Krueger, V.: Facial Feature Detection Using A Hierarchical Wavelet Face Database. Microsoft Research Technical Report MSR-TR-2002-05 (January 2002)

    Google Scholar 

  9. Cristinacce, D., Cootes, T.F.: Facial Feature Detection using ADABOOST with Shape Constraints. In: Proceedings of the British Machine Vision Conference (BMVC 2003), vol.1, pp. 231–240 (2003)

    Google Scholar 

  10. Viola, P., Jones, M.: Robust Real-time Object Detection. In: Proceedings of the Second International Workshop on Statistical and Computational Theories of Vision - Modeling, Learning and Sampling. Jointed with ICCV 2001 (2001)

    Google Scholar 

  11. Schneiderman, H.: Learning a Restricted Bayesian Network for Object Detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2004)

    Google Scholar 

  12. Wu, J., Trivedi, M.M.: A Binary Tree for Probability Learning in Eye Detection. In: Proceedings of the IEEE Workshop on Face Recognition Grand Challenge Experiments (FRGC 2005), in conjunction with CVPR 2005, San Diego, CA, June 21 (2005)

    Google Scholar 

  13. Carmichael, O., Hebert, M.: Shape-Based Recognition of Wiry Objects. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(12), 1537–1552 (2004)

    Article  Google Scholar 

  14. Wu, H., Chen, Q., Yachida, M.: Face detection from color images using a fuzzy pattern matching method. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(6), 557–563 (1999)

    Article  Google Scholar 

  15. Froba, B., Kublbeck, C.: Robust face detection at video frame rate based on edge orientation features. In: Proceedings of the 5th International Conference on Automatic Face and Gesture Recognition, pp. 327–332 (May 2002)

    Google Scholar 

  16. Friedman, J.H., Hastie, T., Tibshirani, R.: Additive Logistic Regression: a Statistical View of Boosting. Annals of Statistics 28, 337–407

    Google Scholar 

  17. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  18. Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET Evaluation Methodology for Face Recognition Algorithms. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 1090–1104 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wu, J., Trivedi, M.M. (2005). Robust Facial Landmark Detection for Intelligent Vehicle System. In: Zhao, W., Gong, S., Tang, X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564386_17

Download citation

  • DOI: https://doi.org/10.1007/11564386_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-29229-6

  • Online ISBN: 978-3-540-32074-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics