Skip to main content
SpringerLink
Log in

Development of Multi-person Pose Estimation Method Based on PAFs

  • Conference paper
  • First Online:
Cognitive Systems and Signal Processing (ICCSIP 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1006))

Included in the following conference series:

  • 1215 Accesses

Abstract

Human keypoints are effective human pose descriptions. Human behavior can be recognized by the motion of keypoints of human bodies. In this paper, we propose a method, which is based on a PAFs approach, for human keypoints detection. The proposed method makes improvements in two aspects: (1) It perfects the joint points matching algorithm by re-matching. (2) It uses multi-branch PAFs to correct the keypoint connections, thus improving the wrong connection problem of upper and lower limbs for multi-person keypoint detection. The improved PAFs method, whose mAP reaches 53.6% on HKD dataset, improved the score of the original method by 2%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cao, Z., Simon, T., et al.: Realtime multi-person 2D pose estimation using part affinity fields. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1302–1310 (2017)

    Google Scholar 

  2. Han, J., Shao, L., Xu, D., et al.: Enhanced computer vision with microsoft kinect sensor: a review. IEEE Trans. Cybern. 43(5), 1318–1334 (2013)

    Article  Google Scholar 

  3. Wu, J., Zheng, H., Zhao, B., Li, Y., et al.: AI Challenger: A Large-scale Dataset for Going Deeper in Image Understanding. arXiv:1711.06475 (2017)

  4. Toshev, A., Szegedy, C.: DeepPose: human pose estimation via deep neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1653–1660 (2014)

    Google Scholar 

  5. Sapp, B., Taskar, B.: MODEC: multimodal decomposable models for human pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3674–3681 (2013)

    Google Scholar 

  6. Fang, H.S., Xie, S., Tai, Y.W., et al.: RMPE: Regional Multi-person Pose Estimation. arXiv:1612.00137 (2016)

  7. Newell, A., Yang, K., Deng, J.: Stacked hourglass networks for human pose estimation. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9912, pp. 483–499. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46484-8_29

    Chapter  Google Scholar 

  8. He, K., Gkioxari, G., Dollar, P., Girshick, R.: Mask R-CNN. IEEE Trans. Pattern Anal. Mach. Intell. (2017)

    Google Scholar 

  9. Iqbal, U., Gall, J.: Multi-person pose estimation with local joint-to-person associations. In: Hua, G., Jégou, H. (eds.) ECCV 2016. LNCS, vol. 9914, pp. 627–642. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48881-3_44

    Chapter  Google Scholar 

  10. Pishchulin, L., Insafutdinov, E., Tang, S., et al.: DeepCut: joint subset partition and labeling for multi person pose estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4929–4937 (2016)

    Google Scholar 

  11. Newell, A., Huang, Z., Deng, J.: Associative embedding: end-to-end learning for joint detection and grouping. In: Advances in Neural Information Processing Systems, pp. 2274–2284 (2017)

    Google Scholar 

  12. Wei, S.E., Ramakrishna, V., Kanade, T., Sheikh, Y.: Convolutional pose machines. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4724–4732 (2016)

    Google Scholar 

  13. Lin, T.-Y., et al.: Microsoft COCO: common objects in context. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8693, pp. 740–755. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10602-1_48

    Chapter  Google Scholar 

  14. Insafutdinov, E., Pishchulin, L., Andres, B., Andriluka, M., Schiele, B.: DeeperCut: a deeper, stronger, and faster multi-person pose estimation model. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9910, pp. 34–50. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46466-4_3

    Chapter  Google Scholar 

  15. Insafutdinov, E., Andriluka, M., Pishchulin, L., et al.: Arttrack: articulated multi-person tracking in the wild. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 4327 (2017)

    Google Scholar 

  16. Papandreou, G., Zhu, T., Kanazawa, N., Toshev, A., et al.: Towards accurate multiperson pose estimation in the wild. arXiv:1701.01779, 8 (2017)

  17. Wang, B., et al.: Development of operation estimation method based on tracking records captured by kinect. In: Sun, F., Liu, H., Hu, D. (eds.) ICCSIP 2016. CCIS, vol. 710, pp. 136–143. Springer, Singapore (2017). https://doi.org/10.1007/978-981-10-5230-9_15

    Chapter  Google Scholar 

Download references

Acknowledgment

Research supported by NVIDIA Corporation with the donation of the Quadro P5000 GPU, National High-Tech Research and Development Plan under Grant 2015AA042306 and Beijing Little Wheel research project.

This work was supported partly by the Innovation Leading Action of Suzhou-Tsinghua (No. 016SZ0219).

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Xi’an University of Science and Technology, Xi’an, China

    Menghan Guo & Ye Gao

  2. State Key Laboratory of Intelligent Technology and Systems, Tsinghua University, Beijing, 100084, China

    Bin Wang & Fuchun Sun

  3. Beijing Little Wheel Co., Beijing, 100084, China

    Bin Wang

Authors
  1. Menghan Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ye Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fuchun Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Wang .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Technology, Tsinghua University, Beijing, China

    Fuchun Sun

  2. Department of Computer Science and Technology, Tsinghua University, Beijing, China

    Huaping Liu

  3. College of Mechatronics and Automation, National University of Defense Technology, Changsha, Hunan, China

    Dewen Hu

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Guo, M., Gao, Y., Wang, B., Sun, F. (2019). Development of Multi-person Pose Estimation Method Based on PAFs. In: Sun, F., Liu, H., Hu, D. (eds) Cognitive Systems and Signal Processing. ICCSIP 2018. Communications in Computer and Information Science, vol 1006. Springer, Singapore. https://doi.org/10.1007/978-981-13-7986-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-7986-4_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-7985-7

  • Online ISBN: 978-981-13-7986-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation