Skip to main content
SpringerLink
Log in

Pedestrian Pose Estimation Using Stereo Perception

  • Conference paper
  • First Online:
Robot 2015: Second Iberian Robotics Conference

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 417))

Abstract

This paper presents an algorithm to perform pedestrian pose estimation using a stereo vision system in the Advanced Driver Assistance Systems (ADAS) context. The proposed approach isolates the pedestrian point cloud and extracts the pedestrian pose using a visibility based pedestrian 3D model. The model accurately predicts possible self occlusions and uses them as an integrated part of the detection. The algorithm creates multiple pose hypotheses that are scored and sorted using a scheme reminiscent of the Monte Carlo techniques. The technique performs a hierarchical search of the body pose from the head position to the lower limbs. In the context of road safety, it is important that the algorithm is able to perceive the pedestrian pose as quickly as possible to potentially avoid dangerous situations, the pedestrian pose will allow to better predict the pedestrian intentions. To this end, a single pedestrian model is used to detect all pertinent poses and the algorithm is able to extract the pedestrian pose based on a single stereo depth point cloud and minimal orientation information. The algorithm was tested against data captured with an industry standard motion capture system. Accurate results were obtained, the algorithm is able to correctly estimate the pedestrian pose with acceptable accuracy. The use of stereo setup allows the algorithm to be used in many varied contexts ranging from the proposed ADAS context to surveillance or even human-computer interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Schmidt, S., Färber, B.: Pedestrians at the kerb recognising the action intentions of humans. Transportation Research Part F: Traffic Psychology and Behaviour 12(4), 300–310 (2009)

    Article  Google Scholar 

  2. Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R.: Real-time human pose recognition in parts from single depth images. Commun. ACM 56(1), 116–124 (2013)

    Article  Google Scholar 

  3. Poppe, R.: Vision-based human motion analysis: An overview. Computer Vision and Image Understanding 108(1–2), 4–18 (2007)

    Article  Google Scholar 

  4. Geronimo, D., Lopez, A., Sappa, A., Graf, T.: Survey of pedestrian detection for advanced driver assistance systems. IEEE Trans. Pattern Anal. Machine Intell. 32(7), 1239–1258 (2010)

    Article  Google Scholar 

  5. Andriluka, M., Roth, S., Schiele, B.: Pictorial structures revisited: people detection and articulated pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), pp. 1014–1021 (2009)

    Google Scholar 

  6. Andriluka, M., Roth, S., Schiele, B.: Monocular 3D pose estimation and tracking by detection. In: IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), pp. 623–630 (2010)

    Google Scholar 

  7. Agarwal, A., Triggs, B.: Recovering 3D human pose from monocular images. IEEE Trans. Pattern Anal. Machine Intell. 28(1), 44–58 (2006)

    Article  Google Scholar 

  8. Hofmann, M., Gavrila, D.M.: Multi-view 3D human pose estimation in complex environment. International Journal of Computer Vision 96(1), 103–124 (2012)

    Article  MathSciNet  Google Scholar 

  9. Plagemann, C., Ganapathi, V., Koller, D., Thrun, S.: Real-time identification and localization of body parts from depth images. In: IEEE International Conference on Robotics and Automation, (ICRA), pp. 3108–3113 (2010)

    Google Scholar 

  10. Urtasun, R., Fua, P.: 3D human body tracking using deterministic temporal motion models. In: Pajdla, T., Matas, J.G. (eds.) Computer Vision, (ECCV). LNCS, vol. 3023, pp. 92–106. Springer, Heidelberg (2004)

    Google Scholar 

  11. Yang, H.D., Lee, S.W.: Reconstruction of 3D human body pose from stereo image sequences based on top-down learning. Pattern Recognition 40(11), 3120–3131 (2007)

    Article  MATH  Google Scholar 

  12. Ziegler, J., Nickel, K., Stiefelhagen, R.: Tracking of the articulated upper body on multi-view stereo image sequences. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (CVPR), vol. 1, pp. 774–781 (2006)

    Google Scholar 

  13. Muhlbauer, Q., Kuhnlenz, K., Buss, M.: A model-based algorithm to estimate body poses using stereo vision. In: IEEE International Symposium on Robot and Human Interactive Communication, (RO-MAN), pp. 285–290 (2008)

    Google Scholar 

  14. Pellegrini, S., Iocchi, L.: Human posture tracking and classification through stereo vision and 3D model matching. J. Image Video Process. 2008, 7:1–7:12, January 2008

    Google Scholar 

  15. Keller, C.G., Hermes, C., Gavrila, D.M.: Will the pedestrian cross? probabilistic path prediction based on learned motion features. In: Mester, R., Felsberg, M. (eds.) Pattern Recognition. LNCS, vol. 6835, pp. 386–395. Springer, Heidelberg (2011)

    Google Scholar 

  16. Kohler, S., Goldhammer, M., Bauer, S., Doll, K., Brunsmann, U., Dietmayer, K.: Early detection of the pedestrian’s intention to cross the street. In: IEEE Conference on Intelligent Transportation Systems, ITSC, pp. 1759–1764 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical Engineering, University of Aveiro, Aveiro, Portugal

    Jorge Almeida & Vitor Santos

  2. IEETA, University of Aveiro, Aveiro, Portugal

    Vitor Santos

Authors
  1. Jorge Almeida
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vitor Santos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jorge Almeida .

Editor information

Editors and Affiliations

  1. Info Syst Dept;Campus de Azurém, University of Minho, Guimarães, Portugal

    Luís Paulo Reis

  2. Electrical and Computer Engineering Dept, University of Porto, Porto, Portugal

    António Paulo Moreira

  3. Instituto Superior Tecnico - Torre Norte, University of Lisboa, Lisboa, Portugal

    Pedro U. Lima

  4. Engineering Dept., E. Ada Byron, Univ of Zaragoza, Computer & Systems, Zaragoza, Spain

    Luis Montano

  5. Automatic Control and Systems Eng. Dept., University of Malaga, Superior Technical, Málaga, Spain

    Victor Muñoz-Martinez

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Almeida, J., Santos, V. (2016). Pedestrian Pose Estimation Using Stereo Perception. In: Reis, L., Moreira, A., Lima, P., Montano, L., Muñoz-Martinez, V. (eds) Robot 2015: Second Iberian Robotics Conference. Advances in Intelligent Systems and Computing, vol 417. Springer, Cham. https://doi.org/10.1007/978-3-319-27146-0_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27146-0_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27145-3

  • Online ISBN: 978-3-319-27146-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation