Skip to main content

A Modified Pyramid Scale Network for Crowd Counting

  • Conference paper
  • First Online:
Advances in Computing and Data Sciences (ICACDS 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1613))

Included in the following conference series:

  • 492 Accesses

Abstract

Crowd counting is a complex and strenuous task in the field of computer vision due to illumination, complex background, occlusions, scale variations, non-uniform distribution etc. There are many methods to count the crowd and the multicolumn architecture has been adopted widely to overcome those challenges. But the two major issues with multicolumn methods are feature similarity and scale limitation. To address these issues, pyramid scale network (PSNet) was proposed to deal these issues. In this paper, we propose a modified pyramid scale network (MPSNet) to obtain more detailed features to deal with scale variation. In this work, we have used four modified pyramid scale modules (MPSM) which extracts multiscale features by integrating message passing and attention mechanism in multicolumn architecture. The experiments and performance of the proposed method is compared on the benchmark ShanghaiTech dataset and UCF_CC_50 dataset in terms of mean absolute error (MAE) and root mean square error (RMSE).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sindagi, V.A., Patel, V.M.: CNN-based cascaded multi-task learning of high-level prior and density estimation for crowd counting. In: 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6. IEEE

    Google Scholar 

  2. Sindagi, V.A., Patel, V.M.: A survey of recent advances in cnn-based single image crowd counting and density estimation. Pattern Recogn. Lett. 107, 3–16 (2018)

    Article  Google Scholar 

  3. Zhang, Y., Zhou, D., Chen, S., Gao, S., Ma, Y.: Single-image crowd counting via multi-column convolutional neural network. In: 2016 Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 589–597 (2016)

    Google Scholar 

  4. Zhang, A., et al.: Relational attention network for crowd counting. In: 2019 Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6788–6797 (2019)

    Google Scholar 

  5. Cao, X., Wang, Z., Zhao, Y., Su, F.: Scale aggregation network for accurate and efficient crowd counting. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision – ECCV 2018. LNCS, vol. 11209, pp. 757–773. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01228-1_45

    Chapter  Google Scholar 

  6. Liu, L., Wang, H., Li, G., Ouyang, W., Lin, L.: Crowd counting using deep recurrent spatial-aware network. arXiv preprint arXiv:1807.00601 (2018)

  7. Li, Y., Zhang, X., Chen, D.: CSRNet: dilated convolutional neural networks for understanding the highly congested scenes. In: Proceedings of the IEEE Conference 2018 on Computer Vision and Pattern Recognition, pp. 1091–1100 (2018)

    Google Scholar 

  8. Cheng, J., Chen, Z., Zhang, X., Li, Y., Jing, X.: Exploit the potential of Multi-column architecture for Crowd Counting. arXiv preprint arXiv:2007.05779 (2020)

  9. Idrees, H., Saleemi, I., Seibert, C., Shah, M.: Multi-source multi-scale counting in extremely dense crowd images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2547–2554 (2013)

    Google Scholar 

  10. Ilyas, N., Shahzad, A., Kim, K.: Convolutional-neural network-based image crowd counting: review, categorization, analysis, and performance evaluation. Sensors 20(1), 43 (2020)

    Article  Google Scholar 

  11. Walach, E., Wolf, L.: Learning to count with CNN boosting. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. LNCS, vol. 9906, pp. 660–676. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_41

    Chapter  Google Scholar 

  12. Fu, M., Xu, P., Li, X., Liu, Q., Ye, M., Zhu, C.: Fast crowd density estimation with convolutional neural networks. Eng. Appl. Artif. Intell. 43, 81–88 (2015)

    Article  Google Scholar 

  13. Shang, C., Ai, H., Bai, B.: End-to-end crowd counting via joint learning local and global count. In: IEEE International Conference on Image Processing (ICIP), pp. 1215–1219. IEEE (2016)

    Google Scholar 

  14. Sheng, B., Shen, C., Lin, G., Li, J., Yang, W., Sun, C.: Crowd counting via weighted VLAD on a dense attribute feature map. IEEE Trans. Circuits Syst. Video Technol. 28(8), 1788–1797 (2016)

    Article  Google Scholar 

  15. Simonyan, K., Zisserman, A: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  16. Sindagi, V.A., Patel, V.M.: Generating high-quality crowd density maps using contextual pyramid CNNs. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1861–1870 (2017)

    Google Scholar 

  17. Zhao, Z., Li, H., Zhao, R., Wang, X.: Crossing-line crowd counting with two-phase deep neural networks. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. LNCS, vol. 9912, pp. 712–726. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46484-8_43

    Chapter  Google Scholar 

  18. Zhang, L., Shi, M., Chen, Q.: Crowd counting via scale-adaptive convolutional neural network. In: IEEE Winter Conference on Applications of Computer Vision (WACV), IEEE, pp. 1113–1121 (2018)

    Google Scholar 

  19. Chen, X., Bin, Y., Sang, N., Gao, C.: Scale pyramid network for crowd counting. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1941–1950. IEEE (2019)

    Google Scholar 

  20. Hossain, M., Hosseinzadeh, M., Chanda, O., Wang, Y.: Crowd counting using scale-aware attention networks. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1280–1288. IEEE (2019)

    Google Scholar 

  21. Babu Sam, D., Surya, S., Venkatesh Babu, R.: Switching convolutional neural network for crowd counting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5744–5752 (2017)

    Google Scholar 

  22. Sam, D.B., Babu, R.V.: Top-down feedback for crowd counting convolutional neural network. In: Thirty-Second AAAI Conference on Artificial Intelligence, 27 April 2018

    Google Scholar 

  23. Guo, D., Li, K., Zha, Z.J., Wang, M.: Dadnet: dilated-attention-deformable convnet for crowd counting. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 1823–1832, 15 October 2019

    Google Scholar 

  24. OñoroRubio, D., LópezSastre, R.J.: Towards perspective-free object counting with deep learning. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. LNCS, vol. 9911, pp. 615–629. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46478-7_38

    Chapter  Google Scholar 

  25. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097–1105 (2012)

    Google Scholar 

  26. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980, 22 Dec 2014

  27. Oh, M.H., Olsen, P., Ramamurthy, K.N.: Crowd counting with decomposed uncertainty. In: AAAI (2020)

    Google Scholar 

  28. Ranjan, V., Le, H., Hoai, M.: Iterative crowd counting. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision – ECCV 2018. LNCS, vol. 11211, pp. 278–293. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_17

    Chapter  Google Scholar 

  29. Gao, J., Wang, Q., Li, X.: PCC net: perspective crowd counting via spatial convolutional network. IEEE Trans. Circuits Syst. Video Technol. 30(10), 3486–3498 (2019)

    Article  Google Scholar 

  30. Liu, W., Salzmann, M., Fua, P.: Context-aware crowd counting. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5099–5108 (2019)

    Google Scholar 

  31. Cenggoro, T.W., Aslamiah, A.H., Yunanto, A.: Feature pyramid networks for crowd counting. Proc. Comput. Sci. 1(157), 175–182 (2019)

    Article  Google Scholar 

  32. Wang, Q., Gao, J., Lin, W., Yuan, Y.: Learning from synthetic data for crowd counting in the wild. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2019)

    Google Scholar 

  33. Zhai, W., et al.: Da 2 net: a dual attention aware network for robust crowd counting. Multimed. Syst. 1–14 (2022)

    Google Scholar 

  34. Khan, S.D., Salih, Y., Zafar, B., Noorwali, A.: A deep-fusion network for crowd counting in high-density crowded scenes. Int. J. Comput. Intell. Syst. 14(1), 1–12 (2021)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rajiv Singh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tyagi, B., Nigam, S., Singh, R. (2022). A Modified Pyramid Scale Network for Crowd Counting. In: Singh, M., Tyagi, V., Gupta, P.K., Flusser, J., Ören, T. (eds) Advances in Computing and Data Sciences. ICACDS 2022. Communications in Computer and Information Science, vol 1613. Springer, Cham. https://doi.org/10.1007/978-3-031-12638-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-12638-3_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-12637-6

  • Online ISBN: 978-3-031-12638-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics