Skip to main content

Modeling Crowd Flow for Video Analysis of Crowded Scenes

  • Chapter
  • First Online:
  • 2326 Accesses

Part of the book series: The International Series in Video Computing ((VICO,volume 11))

Abstract

In this chapter, we describe a comprehensive framework for modeling and exploiting the crowd flow to analyze videos of densely crowded scenes. Our key insight is to model the characteristic patterns of motion that arise within local space-time regions of the video and then to identify and encode the statistical and temporal variation of those motion patterns to characterize the latent, collective movements of the people in the scene. We show that this statistical crowd flow model can be used to achieve critical analysis tasks for surveillance videos of extremely crowded scenes such as unusual event detection and pedestrian tracking. These results demonstrate the effectiveness of crowd flow modeling in video analysis and point to its use in related fields including simulation and behavioral analysis of people in dense crowds.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Ali, S., Shah, M.: A Lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 1–6 (2007)

    Google Scholar 

  • Ali, S., Shah, M.: Floor fields for tracking in high density crowd scenes. In: Proceedings of European Conference on Computer Vision (2008)

    Google Scholar 

  • Andrade, E., Blunsden, S., Fisher, R.: Modelling crowd scenes for event detection. In: Proceedings of International Conference on Pattern Recognition, pp. 175–178 (2006)

    Google Scholar 

  • Andrade, E.L., Blunsden, S., Fisher, R.B.: Hidden markov models for optical flow analysis in crowds. In: Proceeding of International Conference on Pattern Recognition, pp. 460–463 (2006)

    Google Scholar 

  • Arulampalam, S.M., Maskell, S., Gordon, N.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50, 174–188 (2002)

    Article  Google Scholar 

  • Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, New York (2007)

    Google Scholar 

  • Choi, S.C., Wette, R.: Maximum likelihood estimation of the parameters of the gamma distribution and their bias. Technometrics 11(4), 683–690 (1969)

    Article  MATH  Google Scholar 

  • Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2005)

    Google Scholar 

  • Horn, B.K.P., Schunck, B.G.: Determining optical flow. Tech. rep., Cambridge, MA (1980)

    Google Scholar 

  • Hospedales, T., Gong, S., Xiang, T.: A Markov clustering topic model for mining behaviour in video. In: Proceedings of IEEE International Conference on Computer Vision (2009)

    Google Scholar 

  • Hu, M., Ali, S., Shah, M.: Detecting global motion patterns in complex videos. In: Proceedings of International Conference on Pattern Recognition (2008)

    Google Scholar 

  • Hu, M., Ali, S., Shah, M.: Learning motion patterns in crowded scenes using motion flow field. In: Proceedings of International Conference on Pattern Recognition, pp. 1–5 (2008)

    Google Scholar 

  • Isard, M., Blake, A.: CONDENSATION-conditional density propagation for visual tracking. Int. J. Comput. Vis. 29(1), 5–28 (1998)

    Article  Google Scholar 

  • Ke, Y., Sukthankar, R., Hebert, M.: Event detection in crowded videos. In: Proceedings of IEEE International Conference on Computer Vision, pp. 1–8 (2007)

    Google Scholar 

  • Kläser, A., Marszałek, M., Schmid, C.: A spatio-temporal descriptor based on 3D-Gradients. In: Proceedings of British Macine Vision Conference, pp. 995–1004 (2008)

    Google Scholar 

  • Laptev, I., Marszalek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2008)

    Google Scholar 

  • Leibe, B., Seemann, E., Schiele, B.: Pedestrian detection in crowded scenes. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, pp. 878–885 (2005)

    Google Scholar 

  • Mardia, A., El-Atoum, S.: Bayesian inference for the Von Mises-Fisher distribution miscellanea. Biometrika 63(1), 203–206 (1976)

    Article  MathSciNet  MATH  Google Scholar 

  • Mardia, K.V., Jupp, P.: Directional Statistics. Wiley, Chichester (1999)

    Book  Google Scholar 

  • Mehran, R., Moore, B.E., Shah, M.: A streakline representation of flow in crowded scenes. In: European Conference on Computer Vision (ECCV) (2010)

    Google Scholar 

  • Pérez, P., Hue, C., Vermaak, J., Gangnet, M.: Color-based probabilistic tracking. In: Proceedings of European Conference on Computer Vision, pp. 661–675 (2002)

    Google Scholar 

  • Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)

    Article  Google Scholar 

  • Rodriguez, M., Ali, S., Kanade, T.: Tracking in unstructured crowded scenes. In: Proceedings of IEEE International Conference on Computer Vision (2009)

    Google Scholar 

  • Shechtman, E., Irani, M.: Space-time behavior based correlation. In: Proceedings of IEEE Internationl Conference on Computer Vision and Pattern Recognition, pp. 405–412 (2005)

    Google Scholar 

  • Wang, X., Ma, X., Grimson, W.E.L.: Unsupervised activity perception in crowded and complicated scenes using hierarchical Bayesian models. IEEE Trans. Pattern Anal. Mach. Intell. 31, 539–55 (2009)

    Article  Google Scholar 

  • Wright, J., Pless, R.: Analysis of persistent motion patterns using the 3D structure tensor. In: IEEE Workshop on Motion and Video Computing, pp 14–19 (2005)

    Google Scholar 

  • Yang, Y., Liu, J., Shah, M.: Video scene understanding using multi-scale analysis. In: Proceeding of IEEE International Conference on Computer Vision (2009)

    Google Scholar 

Download references

Acknowledgements

This work was supported in part by National Science Foundation grants IIS-0746717 and IIS-0803670, and Nippon Telegraph and Telephone Corporation. The authors thank Nippon Telegraph and Telephone Corporation for providing the train station videos.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ko Nishino .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Nishino, K., Kratz, L. (2013). Modeling Crowd Flow for Video Analysis of Crowded Scenes. In: Ali, S., Nishino, K., Manocha, D., Shah, M. (eds) Modeling, Simulation and Visual Analysis of Crowds. The International Series in Video Computing, vol 11. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8483-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-8483-7_10

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-8482-0

  • Online ISBN: 978-1-4614-8483-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics