Abstract
In public places, crowd size may be an indicator of congestion, delay, instability, or of abnormal events, such as a fight, riot or emergency. Crowd related information can also provide important business intelligence such as the distribution of people throughout spaces, throughput rates, and local densities. A major drawback of many crowd counting approaches is their reliance on large numbers of holistic features, training data requirements of hundreds or thousands of frames per camera, and that each camera must be trained separately. This makes deployment in large multi-camera environments such as shopping centres very costly and difficult. In this chapter, we present a novel scene-invariant crowd counting algorithm that uses local features to monitor crowd size. The use of local features allows the proposed algorithm to calculate local occupancy statistics, scale to conditions which are unseen in the training data, and be trained on significantly less data. Scene invariance is achieved through the use of camera calibration, allowing the system to be trained on one or more viewpoints and then deployed on any number of new cameras for testing without further training. A pre-trained system could then be used as a turn-key solution for crowd counting across a wide range of environments, eliminating many of the costly barriers to deployment which currently exist.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ninth ieee international workshop on performance evaluation of tracking and surveillance (2006), http://www.cvg.rdg.ac.uk/PETS2006/
Eleventh ieee international workshop on performance evaluation of tracking and surveillance (2009), http://www.cvg.rdg.ac.uk/PETS2009/
Abdel-Aziz, Y., Karara, H.: Direct linear transformation from comparator coordinates into object space coordinates in close-range photogrammetry. In: Proceedings of the Symposium on Close-Range Photogrammetry, pp. 1–18 (1971)
Bose, B., Grimson, E.: Ground plane rectification by tracking moving objects. In: IEEE International Workshop on Visual Surveillance and PETS (2004)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)
Celik, H., Hanjalic, A., Hendriks, E.: Towards a robust solution to people counting. In: 2006 IEEE International Conference on Image Processing, pp. 2401–2404 (2006)
Chan, A., Liang, Z.S., Vasconcelos, N.: Privacy preserving crowd monitoring: Counting people without people models or tracking. In: IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2008, pp. 1–7 (2008)
Chan, A., Vasconcelos, N.: Modeling, clustering, and segmenting video with mixtures of dynamic textures. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(5), 909–926 (2008)
Chan, A.B., Morrow, M., Vasconcelos, N.: Analysis of crowded scenes using holistic properties. In: Performance Evaluation of Tracking and Surveillance Workshop at CVPR 2009, Miami, Florida, pp. 101–108 (2009)
Cho, S.Y., Chow, T., Leung, C.T.: A neural-based crowd estimation by hybrid global learning algorithm. IEEE Transactions on Systems, Man, and Cybernetics, Part B 29(4), 535–541 (1999)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893 (2005)
Davies, A., Yin, J.H., Velastin, S.: Crowd monitoring using image processing. Electronics & Communication Engineering Journal 7(1), 37–47 (1995)
Denman, S.: Improved detection and tracking of objects in surveillance video. Ph.D. thesis, Queensland University of Technology (2009), http://eprints.qut.edu.au/29328/
Denman, S., Chandran, V., Sridharan, S.: An adaptive optical flow technique for person tracking systems. Pattern Recognition Letters 28(10), 1232–1239 (2007)
Denman, S., Fookes, C., Sridharan, S.: Improved simultaneous computation of motion detection and optical flow for object tracking. In: Digital Image Computing: Techniques and Applications, DICTA 2009, pp. 175–182 (2009)
Haralick, R.: Statistical and structural approaches to texture. Proceedings of the IEEE 67(5), 786–804 (1979)
Hou, Y.L., Pang, G.: People counting and human detection in a challenging situation. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 41(1), 24–33 (2011)
Kilambi, P., Masoud, O., Papanikolopoulos, N.: Crowd analysis at mass transit sites. In: Intelligent Transportation Systems Conference, ITSC 2006, pp. 753–758. IEEE (2006)
Kilambi, P., Ribnick, E., Joshi, A.J., Masoud, O., Papanikolopoulos, N.: Estimating pedestrian counts in groups. Computer Vision and Image Understanding 110(1), 43–59 (2008)
Kong, D., Gray, D., Tao, H.: A viewpoint invariant approach for crowd counting. In: 18th International Conference on Pattern Recognition, ICPR 2006, vol. 3, pp. 1187–1190 (2006)
Krahnstoever, N., Mendonca, P.R.S.: Bayesian autocalibration for surveillance. In: Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV), pp. 1858–1865. IEEE Computer Society, Washington, DC (2005)
Lempitsky, V., Zisserman, A.: Learning to count objects in images. In: Advances in Neural Information Processing Systems, NIPS (2010)
Lin, S.F., Chen, J.Y., Chao, H.X.: Estimation of number of people in crowded scenes using perspective transformation. IEEE Transactions on Systems, Man and Cybernetics, Part A 31(6), 645–654 (2001)
Lv, F., Zhao, T., Nevatia, R.: Self-calibration of a camera from video of a walking human. In: Proceedings of the 16 th International Conference on Pattern Recognition (ICPR 2002), vol. 1, p. 10562. IEEE Computer Society, Washington, DC, USA (2002)
Ma, R., Li, L., Huang, W., Tian, Q.: On pixel count based crowd density estimation for visual surveillance. In: 2004 IEEE Conference on Cybernetics and Intelligent Systems, vol. 1, pp. 170–173 (2004)
Marana, A.N., Cavenaghi, M.A., Ulson, R.S., Drumond, F.L.: Real-Time Crowd Density Estimation Using Images. In: Bebis, G., Boyle, R., Koracin, D., Parvin, B. (eds.) ISVC 2005. LNCS, vol. 3804, pp. 355–362. Springer, Heidelberg (2005)
Marana, A., Da Fontoura Costa, L., Lotufo, R., Velastin, S.: Estimating crowd density with minkowski fractal dimension. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1999. Proceedings, vol. 6, pp. 3521–3524 (1999)
Marana, A., Velastin, S., Costa, L., Lotufo, R.: Estimation of crowd density using image processing. In: IEE Colloquium on Image Processing for Security Applications (Digest No.: 1997/074), pp. 11/1–11/8 (1997)
Masoud, O., Papanikolopoulos, N.: A novel method for tracking and counting pedestrians in real-time using a single camera. IEEE Transactions on Vehicular Technology 50(5), 1267–1278 (2001)
Paragios, N., Ramesh, V.: A mrf-based approach for real-time subway monitoring. In: 2001 Conference on Computer Vision and Pattern Recognition (CVPR 2001), pp. 1034–1040 (2001)
Rabaud, V., Belongie, S.: Counting crowded moving objects. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 705–711 (2006)
Rahmalan, H., Nixon, M.S., Carter, J.N.: On crowd density estimation for surveillance. In: The Institution of Engineering and Technology Conference on Crime and Security 2006, pp. 540–545 (2006)
Rasmussen, C.E.: Gaussian Processes in Machine Learning. In: Bousquet, O., von Luxburg, U., Rätsch, G. (eds.) Machine Learning 2003. LNCS (LNAI), vol. 3176, pp. 63–71. Springer, Heidelberg (2004)
Rasmussen, C.E., Williams, C.K.I.: Gaussian processes for machine learning. MIT Press (2006)
Regazzoni, C., Tesei, A., Murino, V.: A real-time vision system for crowding monitoring. In: Proceedings of the IECON 1993, International Conference on Industrial Electronics, Control, and Instrumentation, vol. 3, pp. 1860–1864 (1993)
Ryan, D., Denman, S., Fookes, C., Sridharan, S.: Crowd counting using multiple local features. In: Digital Image Computing: Techniques and Applications. DICTA 2009, pp. 81–88 (2009)
Ryan, D., Denman, S., Fookes, C., Sridharan, S.: Crowd counting using group tracking and local features. In: 2010 Seventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 218–224 (2010)
Shi, C.J., Tomasi: Good features to track. In: 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Proceedings CVPR 1994, pp. 593–600 (1994)
Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, vol. 2(xxiii+637+663) (1999)
Tsai, R.: An efficient and accurate camera calibration technique for 3d machine vision. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR 1986), pp. 364–374 (1986)
Tuzel, O., Porikli, F., Meer, P.: Human detection via classification on riemannian manifolds. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8 (2007)
Wu, X., Liang, G., Lee, K.K., Xu, Y.: Crowd density estimation using texture analysis and learning. In: IEEE International Conference on Robotics and Biomimetics, ROBIO 2006, pp. 214–219 (2006)
Xiaohua, L., Lansun, S., Huanqin, L.: Estimation of Crowd Density Based on Wavelet and Support Vector Machine. Transactions of the Institute of Measurement and Control 28(3), 299–308 (2006)
Yang, T., Zhang, Y., Shao, D., Li, Y.: Clustering method for counting passengers getting in a bus with single camera. Optical Engingeering 49(3) (2010)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)
Zivkovic, Z.: Improved adaptive gaussian mixture model for background subtraction. In: 17th International Conference on Proceedings of the Pattern Recognition (ICPR 2004), vol. 2, pp. 28–31. IEEE Computer Society, Washington, DC, USA (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer Berlin Heidelberg
About this chapter
Cite this chapter
Ryan, D., Denman, S., Sridharan, S., Fookes, C. (2012). Scene Invariant Crowd Counting and Crowd Occupancy Analysis. In: Shan, C., Porikli, F., Xiang, T., Gong, S. (eds) Video Analytics for Business Intelligence. Studies in Computational Intelligence, vol 409. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28598-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-28598-1_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-28597-4
Online ISBN: 978-3-642-28598-1
eBook Packages: EngineeringEngineering (R0)