Skip to main content
SpringerLink
Log in

Crowd counting using statistical features based on curvelet frame change detection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Automatic counting for moving crowds in digital images is an important application in computer artificial intelligence, especially for safety and management purposes. This paper presents a new method to estimate the size of a crowd. The new algorithm depends on sequential frame differences to estimate the crowd size in a scene. However, relying only on these simple differences adds more constraints for extracting sufficient crowd descriptors. A curvelet transform is employed to achieve that goal. Every two sequential frames are transformed into multi-resolution and multi-direction formats, and then the frame differences are detected at every subband in the curvelet domain. Statistical features out of each subband are then calculated, and the collected features from all subbands are considered as a descriptor vector for the crowd in the scene. Finally, a neural network is manipulated to map the descriptor vectors into predicted counts. The experimental results show that the proposed curvelet statistical features are more robust and provide crowd counting with higher accuracy than previous approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Albiol A, Silla MJ, Albiol A, Mossi JM (2009) In Video analysis using corner motion statistics, IEEE International Workshop on Performance Evaluation of Tracking and Surveillance pp 31–38

  2. Ali S, Nishino K, Manocha D, Shah M (eds) (2013) Modeling, simulation and visual analysis of crowds: a multidisciplinary perspective. In: Modeling, simulation and visual analysis of crowds. Springer, New York, pp 1–19

  3. Arivazhagan S, Ganesan L, Kumar TS (2006) In Texture classification using curvelet statistical and co-occurrence features, 18th International Conference on Pattern Recognition, ICPR 2006, IEEE: pp 938–941

  4. Candès EJ, Donoho DL (1999) Ridgelets: a key to higher-dimensional intermittency? Philos Trans R Soc A Math Phys Eng Sci 357:2495–2509

    Article  MathSciNet  MATH  Google Scholar 

  5. Candes EJ (2000) Ridgelets and their derivatives: representation of images with edges. In: Schumaker LL (ed) Saint-Malo Proceedings. Vanderbilt University Press, Nashville, TN

  6. Candes EJ, Donoho DL (2000) Curvelets: A surprisingly effective nonadaptive representation for objects with edges. In: Schumaker LL (ed) Saint-Malo Proceedings. Vanderbilt University Press, Nashville, TN

  7. Candès EJ, Guo F (2002) New multiscale transforms, minimum total variation synthesis: applications to edge-preserving image reconstruction. Signal Process 82:1519–1543

    Article  MATH  Google Scholar 

  8. Candes E, Demanet L, Donoho D, Ying L (2006) Fast discrete curvelet transforms. Multiscale Model Simul 5:861–899

    Article  MathSciNet  MATH  Google Scholar 

  9. Chan A, Vasconcelos N (2009) People counting data for pets 2009 dataset. University of California, San Diego March 18, 2014

    Google Scholar 

  10. Chan AB, Liang ZS, Vasconcelos N (2008) In Privacy preserving crowd monitoring: Counting people without people models or tracking, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, IEEE: pp 1–7

  11. Chen J (2013) Crowd counting based on difference images. Electronics and. Electr Eng 19:83–87

    Google Scholar 

  12. Conte D, Foggia P, Percannella G, Tufano F, Vento M (2010) In Counting moving people in videos by salient points detection, 20th International Conference on Pattern Recognition (ICPR), IEEE: pp 1743–1746

  13. Cord A, Bach F, Jeulin D (2010) Texture classification by statistical learning from morphological image processing: application to metallic surfaces. J Microsc 239:159–166

    MathSciNet  Google Scholar 

  14. Davies AC, Yin JH, Velastin SA (1995) Crowd monitoring using image processing. Electron Commun Eng J 7:37–47

    Article  Google Scholar 

  15. Donoho DL (2000) Orthonormal ridgelets and linear singularities. SIAM J Math Anal 31:1062–1099

    Article  MathSciNet  MATH  Google Scholar 

  16. Hafeez Allah A, Bakar A, Orfali W (2014) In Curvelet transform sub-difference image for crowd estimation, 2014 I.E. International Conference on Control System, Computing and Engineering (ICCSCE), IEEE: pp 502–506

  17. Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern:610–621

  18. Hashemzadeh M, Pan G, Yao M (2013) Counting moving people in crowds using motion statistics of feature-points. Multimedia Tools and Applications 1–35

  19. Jianwei M, Plonka G (2010) The curvelet transform. IEEE Signal Process Mag 27:118–133

    Article  Google Scholar 

  20. Kingsbury N (1999) Image processing with complex wavelets. Philos Trans R Soc A Math Phys Eng Sci 357:2543–2560

    Article  MATH  Google Scholar 

  21. Kingsbury N (2001) Complex wavelets for shift invariant analysis and filtering of signals. Appl Comput Harmon Anal 10:234–253

    Article  MathSciNet  MATH  Google Scholar 

  22. Kong D, Gray D, Tao H (2006) In A viewpoint invariant approach for crowd counting, 18th International Conference on Pattern Recognition, ICPR 2006, IEEE: pp 1187–1190

  23. Lee Rodgers J, Nicewander WA (1988) Thirteen ways to look at the correlation coefficient. Am Stat 42:59–66

    Article  Google Scholar 

  24. Loy CC, Chen K, Gong S, Xiang T (2013) Crowd counting and profiling: Methodology and evaluation. In Modeling, simulation and visual analysis of crowds, Springer pp 347–382

  25. Ma W, Huang L, Liu C (2008) In Advanced local binary pattern descriptors for crowd estimation, Pacific-Asia Workshop on Computational Intelligence and Industrial Application, PACIIA’08, IEEE: pp 958–962

  26. Marana A, Velastin S, Costa L, Lotufo R (1997) In Estimation of crowd density using image processing, IEE Colloquium on Image Processing for Security Applications (Digest No.: 1997/074), IET: pp 11/11–11/18

  27. Masoud O, Papanikolopoulos NP (2001) A novel method for tracking and counting pedestrians in real-time using a single camera. IEEE Trans Veh Technol 50:1267–1278

    Article  Google Scholar 

  28. Meyer Y, Salinger DH (1995) Wavelets and operators, vol 1. Cambridge university press, Cambridge

    Google Scholar 

  29. Muthuramalingam S, Karthikeyan N, Geetha S, Sindhu SSS (2015) Stego anomaly detection in images exploiting the curvelet higher order statistics using evolutionary support vector machine. Multimedia Tools and Applications 1–35

  30. Paragios N, Ramesh V (2001) In A mrf-based approach for real-time subway monitoring, Proceedings of the 2001 I.E. Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, IEEE: vol. 1031 pp I-1034–I-1040

  31. PETS (2009) Eleventh IEEE international workshop on performance evaluation of tracking and surveillance. Dataset available from: http://www.cvg.rdg.ac.uk/PETS2009/data.html

  32. Po DD, Do MN (2006) Directional multiscale modeling of images using the contourlet transform. IEEE Trans Image Process 15:1610–1620

    Article  MathSciNet  Google Scholar 

  33. Ryan D, Denman S, Fookes C, Sridharan S (2009) In Crowd counting using multiple local features, Digital Image Computing: Techniques and Applications, DICTA’09., IEEE: pp 81–88

  34. Ryan D, Denman S, Sridharan S, Fookes C (2015) An evaluation of crowd counting methods, features and regression models. Comput Vis Image Underst 130:1–17

    Article  Google Scholar 

  35. Shamshiri A, Kehavarz A, Mansouri Y (2013) In Ocean wind direction estimation from sar images using contoulet analysis, IEEE International Symposium on Geoscience and Remote Sensing Symposium (IGARSS), IEEE: pp 1610–1613

  36. Starck J-L, Murtagh F, Fadili JM (2010) Sparse image and signal processing: wavelets, curvelets, morphological diversity. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  37. Wakin MB, Romberg JK, Choi H; Baraniuk RG (2003) In Geometric methods for wavelet-based image compression, Optical Science and Technology, SPIE’s 48th Annual Meeting, International Society for Optics and Photonics: pp 507–520

  38. Xiaohua L, Lansun S, Huanqin L (2006) Estimation of crowd density based on wavelet and support vector machine. Trans Inst Meas Control 28:299–308

    Article  Google Scholar 

  39. Yang H, Su H, Zheng S, Wei S, Fan Y (2011) In The large-scale crowd density estimation based on sparse spatiotemporal local binary pattern, IEEE International Conference on Multimedia and Expo (ICME), IEEE: pp 1–6

  40. Yang H, Cao Y, Su H, Fan Y, Zheng S (2012) The large-scale crowd analysis based on sparse spatial-temporal local binary pattern. Multimedia Tools and Applications 73:41–60

    Article  Google Scholar 

  41. Zhu Y, Liang R, Wang H (2014) Counting crowd flow based on feature points. Neurocomputing 133:377–384

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Computer Engineering, Universiti Teknologi Malaysia, Johor Bahru, Johor, Malaysia

    Adel Hafeezallah & Syed Abu-Bakar

  2. Department of Electrical Engineering, Taibah University, Madinah, Saudi Arabia

    Adel Hafeezallah

Authors
  1. Adel Hafeezallah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Syed Abu-Bakar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adel Hafeezallah.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hafeezallah, A., Abu-Bakar, S. Crowd counting using statistical features based on curvelet frame change detection. Multimed Tools Appl 76, 15777–15799 (2017). https://doi.org/10.1007/s11042-016-3869-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3869-1

Keywords

Search

Navigation