Skip to main content
Log in

Using dynamic Bayesian network for scene modeling and anomaly detection

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In this paper, we address the problem of scene modeling for performing video surveillance. The problem consists of using the trajectories, obtained by observing objects in a scene, to construct a scene model that can be used to distinguish a normal and an acceptable behavior from a atypical one. In this regard, the proposed method is divided into a training phase and a testing phase. During the training phase, the input trajectories are used to identify different paths or routes commonly taken by the objects in a scene. Important discriminative features are then extracted from these identified paths to learn a dynamic Bayesian network (DBN). During the testing phase, the learned network is used to classify the incoming trajectories based on their size, location, speed, acceleration, and spatio-temproal curvature characteristics. The proposed method (i) handles trajectories of varying lengths, (ii) automatically detects the number of paths presents in a scene, and (iii) introduces the novel usage of the DBN, which is very intuitive and accurately captures the dynamics of the scene. We show results on four datasets of varying lengths and successfully show results for both path clustering and anomalous behavior detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Makris D., Ellis T.: Path detection in video surveillance. Image Vis. Comput. J. (IVC) 20, 895–903 (2002)

    Article  Google Scholar 

  2. Junejo, I., Foroosh, H.: Trajectory rectification and path modeling for video surveillance. In: Proceedings of the 11th IEEE International Conference on Computer Vision (ICCV), pp. 1–7 (2007)

  3. Hu W., Tan T., Wang L., Maybank S.: A survey on visual surveillance of object motion and behaviors. IEEE Trans. Syst. Man Cybern. C 34, 334–352 (2004)

    Article  Google Scholar 

  4. Zhang, Z., Huang, K., Tan, T.: Comparison of similarity measures for trajectory clustering in outdoor surveillance scenes. In: Proceedings of the 18th IEEE International Conference on Pattern Recognition (ICPR), vol. III, pp. 1135–1138 (2006)

  5. Vlachos, M., Gunopulos, D. G. K.: Robust similarity measures for mobile objects trajectories. In: Proceedings of the DEXA Workshops, pp. 721–728 (2002)

  6. Keogh, E.J., Pazzani, M.J.: Scaling up dynamic time warping for datamining applications. Knowl. Discov. Data Min. 285–289 (2000)

  7. Rangarajan, K., Allen, W., Sha, M.: Matching motion trajectoriesnext term using scale-space. Elsevier Pattern Recognit. 595–610 (2003)

  8. Grimson, W., Stauffer, C., Romano, R., Lee, L.: Using adaptive tracking to classify and monitor activities in a site. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 22–29 (1998)

  9. Boyd, J.E., Meloche, J., Vardi, Y.: Statistical tracking in video traffic surveillanc. In: Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV), pp. 163–168 (1999)

  10. Johnson N., Hogg D.: Learning the distribution of object trajectories for event recognition. Image Vis. Comput. 14, 583–592 (1996)

    Article  Google Scholar 

  11. Piciarelli, C., Foresti, G., Snidara, L.: Trajectory clustering and its applications for video surveillance. In: Proceedings of the 2nd IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 40–45 (2005)

  12. Khalid, S., Naftel, A.: Classifying spatiotemporal object trajectories using unsupervised learning of basis function coefficients. In: Proceedings of the 3rd ACM International Workshop on Video Surveillance and Sensor Networks, pp. 45–52 (2005)

  13. Calderara, S., Cucchiara, R., Prati, A.: Detection of abnormal behaviors using a mixture of von mises distributions. In: Proceedings of the AVSBS, pp. 141–146 (2007)

  14. Makris D., Ellis T.: Learning semantic scene models from observing activity in visual surveillance. IEEE Trans. Syst. Man Cybern. B 35, 397–408 (2005)

    Article  Google Scholar 

  15. Junejo, I., Foroosh, H.: Euclidean path modeling for video surveillance. Elsevier J. Image Vis. Comput. (IVC) 26, 512–528

  16. Shi J., Malik J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Machine Intell. (PAMI) 22, 888–905 (2000)

    Article  Google Scholar 

  17. Wright, J., Pless, R.: Analysis of persistent motion patterns using the 3d structure tensor. In: Proceedings of the IEEE Workshop on Motion and Video Computing, pp. 14–19 (2005)

  18. Zhang, Z., Huang, K., Tan, T., Wang, L.: Trajectory series analysis based event rule induction for visual surveillance. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–8 (2007)

  19. Jiang, F., Wu, Y., Katsaggelos, A.: Abnormal event detection from surveillance video by dynamic hierarchical clustering. In: Proceedings of the 14th IEEE International Conference on Image Processing (ICIP). V, pp. 145–148 (2007)

  20. Fu, Z., Hu, W., Tan, T.: Similarity based vehicle trajectory clustering and anomaly detection. In: Proceedings of the 12th International Conference on Image Processing (ICIP), pp. 602–605 (2005)

  21. Wang, X., Tieu, K., Grimson, E.: Learning semantic scene models by trajectory analysis. In: Proceedings of the 9th European Conference on Computer Vision (ECCV), pp. 1–8 (2006)

  22. Javed, O., Shah, M.: Tracking and object classification for automated surveillance. In: Proceedings of the 7th European Conference on Computer Vision (ECCV), pp. 439–443 (2002)

  23. Weiss, Y.: Segmentation using eigenvectors: A unifying view. In: Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV), pp. 975–982 (1999)

  24. Rao C., Shah M.: A view-invariant representation of human action. Int. J. Comput. Vis. 50(2), 203–226 (2002)

    Article  MATH  Google Scholar 

  25. Bishop, C.M.: Pattern Recognition and Machine Learning, 1st edn. Springer, Berlin, ISBN: 0-387-31073-8 (2006)

  26. Welch, G., Bishop, G.: An introduction to the kalman filter. ACM SIGGRAPH 2001 Courses (2001)

  27. Bengio, Y., Frasconi, P.: An input output HMM architecture. In: Proceedings of the Advances in Neural Information Processing Systems (NIPS), vol. 7, pp. 427–434 (1995)

  28. Murphy, K.P.: The bayes net toolbox for MATLAB

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Imran N. Junejo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Junejo, I.N. Using dynamic Bayesian network for scene modeling and anomaly detection. SIViP 4, 1–10 (2010). https://doi.org/10.1007/s11760-008-0099-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-008-0099-7

Keywords

Navigation