Skip to main content

Combined Head Localization and Head Pose Estimation for Video–Based Advanced Driver Assistance Systems

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6835))

Abstract

This work presents a novel approach for pedestrian head localization and head pose estimation in single images. The presented method addresses an environment of low resolution gray–value images taken from a moving camera with large variations in illumination and object appearance. The proposed algorithms are based on normalized detection confidence values of separate, pose associated classifiers. Those classifiers are trained using a modified one vs. all framework that tolerates outliers appearing in continuous head pose classes. Experiments on a large set of real world data show very good head localization and head pose estimation results even on the smallest considered head size of 7x7 pixels. These results can be obtained in a probabilistic form, which make them of a great value for pedestrian path prediction and risk assessment systems within video-based driver assistance systems or many other applications.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ba, S.O., Odobez, J.-M.: A probabilistic framework for joint head tracking and pose estimation. ICPR 4, 264–267 (2004)

    Google Scholar 

  2. Bäuml, M., Bernardin, K., Fischer, M., Ekenel, H.K.: Multi-pose face recognition for person retrieval in camera networks. AVSS 7 (2010)

    Google Scholar 

  3. Benfold, B., Reid, I.: Guiding visual surveillance by tracking human attention. In: BMVC, vol. 20 (2009)

    Google Scholar 

  4. Canton-Ferrer, C., Casas, J.R., Pardàs, M.: Head orientation estimation using particle filtering in multiview scenarios. In: Stiefelhagen, R., Bowers, R., Fiscus, J.G. (eds.) RT 2007 and CLEAR 2007. LNCS, vol. 4625, pp. 317–327. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  5. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR, pp. 886–893 (2005)

    Google Scholar 

  6. Enzweiler, M., Gavrila, D.M.: Integrated pedestrian classification and orientation estimation. In: CVPR, pp. 982–989 (2010)

    Google Scholar 

  7. Fröba, B., Ernst, A.: Face detection with the modified census transform. In: IEEE FG, vol. 6 (2004)

    Google Scholar 

  8. Gandhi, T., Trivedi, M.M.: Image based estimation of pedestrian orientation for improving path prediction. In: Intelligent Vehicles Symposium, pp. 506–511 (2008)

    Google Scholar 

  9. Hirata, J., Morimoto, M., Fujii, K.: Estimating face direction from low resolution images. In: World Automation Congress, WAC 2008, pp. 1–6 (2008)

    Google Scholar 

  10. Jones, M.J., Viola, P.: Fast multi-view face detection. In: CVPR (2003)

    Google Scholar 

  11. Leibe, B., Seemann, E., Schiele, B.: Pedestrian detection in crowded scenes. In: CVPR, pp. 878–885 (2005)

    Google Scholar 

  12. Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: International Conference on Image Processing, pp. 900–903 (2002)

    Google Scholar 

  13. Murphy-Chutorian, E., Trivedi, M.M.: Head pose estimation in computer vision: A survey. IEEE TPAMI 31, 607–626 (2009)

    Article  Google Scholar 

  14. Niese, R., Al-Hamadi, A., Michaelis, B.: A stereo and color-based method for face pose estimation and facial feature extraction. ICPR 1, 299–302 (2006)

    Google Scholar 

  15. Orozco, J., Gong, S., Xiang, T.: Head pose classification in crowded scenes. In: BMVC (2009)

    Google Scholar 

  16. Robertson, N.M., Reid, I.D.: Estimating gaze direction from low-resolution faces in video. In: Proc. IEEE European Conference on Computer Vision, vol. 9 (2006)

    Google Scholar 

  17. Roy, A., Marcel, S.: Haar local binary pattern feature for fast illumination invariant face detection. In: BMVC (2009)

    Google Scholar 

  18. Shimizu, H., Poggio, T.: Direction estimation of pedestrian from multiple still images. In: Intelligent Vehicles Symposium, pp. 596–600 (2004)

    Google Scholar 

  19. Vatahska, T., Bennewitz, M., Behnke, S.: Feature-based head pose estimation from images. In: 7th IEEE-RAS International Conference on Humanoid Robots 2007, pp. 330–335 (December 2007)

    Google Scholar 

  20. Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: CVPR, pp. 511–518 (2001)

    Google Scholar 

  21. Zhang, Z., Hu, Y., Liu, M., Huang, T.: Head pose estimation in seminar room using multi view face detectors. In: Proceedings of the 1st International Evaluation Conference on Classification of Events, Activities and Relationships, pp. 299–304 (2007)

    Google Scholar 

  22. Zheng, J., Ramírez, G.A., Fuentes, O.: Face detection in low-resolution color images. In: Campilho, A., Kamel, M. (eds.) ICIAR 2010. LNCS, vol. 6111, pp. 454–463. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Schulz, A., Damer, N., Fischer, M., Stiefelhagen, R. (2011). Combined Head Localization and Head Pose Estimation for Video–Based Advanced Driver Assistance Systems. In: Mester, R., Felsberg, M. (eds) Pattern Recognition. DAGM 2011. Lecture Notes in Computer Science, vol 6835. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23123-0_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23123-0_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23122-3

  • Online ISBN: 978-3-642-23123-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics