Skip to main content

Advertisement

SpringerLink
Log in

Audio–Video based People Counting and Security Framework for Traffic Crossings

  • Published:
The Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology Aims and scope Submit manuscript

Abstract

In this paper, we propose a traffic management system which uses both audio and video data at intersections to prevent traffic congestion. A novel scheme of counting and tracking crowd with a single overhead camera is proposed for the purpose of real-time traffic control at crossings as well as for adjusting the carrier frequency using the video data. The system recognizes people movement along various directions estimating the possibility of traffic congestion. To carry out the tracking procedure, various temporal and spatial features of the images are used to identify the people in the crowd in order to predict the position of the objects in the current frame. Several issues such as emergence of people, departure of people, occlusions, and de-occlusions are resolved through interactions between regions and objects. With the help of audio data at counting region, we identify children by their voice using pitch analysis. The database constitutes of voices of speakers of all ages and of both genders. The paper also includes automated accident detection at the traffic intersections through use of audio data at intersections. It can classify the sounds into “crash”, “power brake” and “normal traffic” sounds. The experimental results show the effectiveness of our framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. Segen, and S. Pingali, “A Camera-Based System for Tracking People in Real Time,” IEEE Proc. Int. Conf. Pattern Recognit., no. 3, 1996, pp. 63–67.

  2. C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, “Pfinder: Real-Time Tracking of the Human Body,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, July 1997, pp. 780–785.

    Article  Google Scholar 

  3. I. Haritaoglu, D. Harwood, and L. Davis, “W4-Real Time Detection and Tracking of People in 2.5D,” European Conf. Comput. Vision, Germany, 1998.

  4. R. Rosales, and S. Sclaroff, “3D Trajectory Recovery for Tracking Multiple Objects and Trajectory Guided Recognition of Actions,” IEEE Comput. Soc. Conf. CVPR, vol. 2, June 1999, pp. 23–25.

  5. T. Horprasert, D. Harwood, and L. Davis, “A Statistical Approach for Real-Time Robust Background Subtraction and Shadow Detection,” Proc. IEEE ICCV Frame-rate Workshop, 1999.

  6. C. Stauffer, and W.E.L. Grimson, “Learning Patterns of Activity Using Real-Time Tracking,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, Aug. 2000, pp. 747–757.

    Article  Google Scholar 

  7. K. Rohr, “Towards Model-Based Recognition of Human Movement in Image Sequences,” CVGIP: Image Understanding, vol. 59, no. 1, Jan. 1994.

  8. O. Masoud, and N.P. Papanikolopoulos, “A Novel Method for Tracking and Counting Pedestrians in Real-Time Using a Single Camera,” IEEE Trans. Veh. Technol., no. 50, 2001, pp. 1267–1278.

  9. M. Rossi, and A. Bozzoli, “Tracking and Counting Moving People,” IEEE Proc. Int. Conf. Image Process., no. 3, 1994, pp. 212–216.

  10. K. Terada, D. Yoshida, S. Oe, and J. Yamaguchi, “A Counting Method of the Number of Passing People Using a Stereo Camera,” IEEE Proc. Industrial Electronics Conf., no. 3, 1999, pp. 1318–1323.

  11. S.A. Niyogi and E.H. Adelson, “Analyzing and Recognizing Walking Figures in XYT,” IEEE Conf. Comput. Vision Pattern Recognit., July 1997, pp. 469–474.

  12. R. Cutler and L. Davis, “Real-Time Periodic Motion Detection, Analysis and Applications,” Proc. IEEE Conf. Comput. Pattern Recognit., Fort Collins, USA, 1999, pp. 326–331.

  13. R. Polana and R. Nelson, “Low Level Recognition of Human Motion,” IEEE Workshop on Motion of Non-Rigid and Articulated Objects, Austin, 1994, pp. 77–82.

  14. H.J. Payne, E.D. Helfenbein, and H.C. Knobel, “Development and Testing of Incident Detection Algorithms: Volume 2: Research Methodology and Detailed Results,” Report No. FHWA-RD-76-20, Washington, D.C., Federal Highway Administration, 1976.

  15. J.M. McDermott, “Incident Surveillance and Control on Chicago-Area Freeways,” Special Report 153: Better Use of Existing Transportation Facilities. TRB, National Research Council, Washington, D.C., 1975, pp. 123–140.

  16. D.A. Whitney and J.J. Pisano, “AutoAlert: Automated Acoustic Detection of Incidents,” TASC, Inc., Reading, Massachusetts, December 26, 1995.

    Google Scholar 

  17. K.W. Dickinson and C.L. Wan, “An Evaluation of Microwave Vehicle Detection at Traffic Signal Controlled Intersection,” Proc. Third Int. Conf. Road Traffic Control, 1990, pp. 153–157.

  18. N Otsu, “A Threshold Selection Method From Gray-Level Histograms,” IEEE Trans. Syst. Man Cybern., vol. 9, no. 1, 1979, pp. 62–66.

    Article  MathSciNet  Google Scholar 

  19. O.D. Trier and T. Taxt, “Evaluation of Binarization Methods for Document Images,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 3, Mar. 1995.

  20. W. Niblack, “An Introduction to Digital Image Processing,” Englewood Cliffs, N.J., Prentice Hall, 1986, pp. 115–116.

    Google Scholar 

  21. Y. Keller, A. Averbuch, and O. Miller, “Robust Phase Correlation,” ICPR no. 2, 2004, pp. 740–743.

  22. W. S. Hoge, D. Mitsouras, F. J. Rybicki, R. V. Mulkern, and C.F. Westin. “Registration of Multi-dimensional Image Data Via Sub-pixel Resolution Phase Correlation,” Proc. IEEE Intl. Conf. Image Process (ICIP-03), vol. II, Barcelona, Spain, Sep. 2003, pp. 707–710.

  23. T. Toivonen and J. Heikkila, “Efficient Method for Half-Pixel Block Motion Estimation Using Block Differentials,” International Workshop VLBV, Springer, Madrid, Spain, 2003.

    Google Scholar 

  24. L.R. Rabiner, M.J. Cheng, A.E. Rosenberg, and C.A. Mcgonegal, “A Comparative Performance Study of Several Pitch Detection Algorithms,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-24, no. 5, October 1976.

  25. Y Zhang, R. Hu, L.M. Bruce, N. Balraj and S. Yu, “Development of Real-Time Automated Accident Detection System at Intersections,” Annual Conference of the Transportation Research Board, Washington D.C., 2004.

  26. S.G. Mallat, “A Theory for Multiresolution Signal Decomposition: The Wavelet Representation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. II, no. 7, July 1989, pp. 674–693.

    Article  Google Scholar 

  27. K. Fukunaga, “Introduction to Statistical Pattern Recognition,” Academic, San Diego, California, 1990.

    MATH  Google Scholar 

  28. R. Duda, P. Hart, and D. Stork, “Pattern Classification”, Wiley, 2001.

Download references

Author information

Authors and Affiliations

  1. Department of Electronics and Computer Engineering, Indian Institute of Technology, Roorkee, India

    Ankush Mittal, Ankur Jain & Ganesh K. Agarwal

Authors
  1. Ankush Mittal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ankur Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ganesh K. Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ankush Mittal.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mittal, A., Jain, A. & Agarwal, G.K. Audio–Video based People Counting and Security Framework for Traffic Crossings. J VLSI Sign Process Syst Sign Im 49, 377–391 (2007). https://doi.org/10.1007/s11265-007-0089-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-007-0089-y

Keywords

Search

Navigation