Skip to main content
Log in

Semantic enhanced cloud environment for surveillance data management using video structural description

  • Published:
Computing Aims and scope Submit manuscript

Abstract

Recently, the number of surveillance video data has grown enormously since the popularity of the smart cities, which brings the difficulties to users for searching and analyzing the content of the videos. These video data are not limited to data anymore, which provide the effective information for criminal investigation systems, intrusion detection system, and many others. However, as the number of available cloud services increases, the problem of data discovery and selection arises. The semantic technology is an effective choice for enhancing the accurate of the data searching and analyzing process. In this paper, a semantic based cloud environment is proposed to facilitate the analyzing and searching process of surveillance video data. An architecture integrating ontology building, semantic annotation, and semantic search is proposed to leverage the semantic description of the video data to find them from concept-based level. A semantic intermediate layer which organizes the video data based on their semantic relations is given. Moreover, the proposed method is used in the intelligent transportation field, which shows the bright prospect of the proposed method in real applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. www.w3.org/RDF/, 2013.

  2. www.openstreetmap.org.

  3. www.opencv.org.

  4. www.virtuoso.com/, 2013.

  5. www.larkc.eu/, 2013.

  6. The 215 illegal traffic events are get from www.shjtaq.com/zwfg/dmb2012.htm.

  7. http://protege.stanford.edu/, 2013.

  8. www.docjar.org, 2013.

  9. www.w3.org/Submission/SWRL/, 2013.

References

  1. Armbrust M et al (2013) Above the clouds: a Berkley view of cloud computing. http://bishop.camp.clarkson.edu/Cloud_Computing_Papers/berkely-abovetheclouds.pdf

  2. Liu Y, Ni M, Hu C (2012) A generalized probabilistic topology control for wireless sensor networks. IEEE J Sel Areas Commun 30(9):1780–1788

    Article  Google Scholar 

  3. Liu Y, Zhu Y, Lionel MN, Xue G (2011) A reliability-oriented transmission service in wireless sensor networks. IEEE Trans Parallel Distrib Syst 22(12):2100–2107

    Article  Google Scholar 

  4. Liu Y, Zhang Q, Lionel MN (2010) Opportunity-based topology control in wireless sensor networks. IEEE Trans Parallel Distrib Syst 21(3):405–416

    Article  Google Scholar 

  5. Wang L, Chen D et al (2013) Towards enabling cyber infrastructure as a service in clouds. Comput Electr Eng 39(1):3–14

    Article  Google Scholar 

  6. Ma Y, Wang L et al (2013) Distributed data structure templates for data-intensive remote sensing application. Concurr Comput Prac Exp 25(12):1784–1797

    Article  Google Scholar 

  7. Wang L, Tao J et al (2013) G-hadoop: MapReduce across distributed data centers for data-intensive computing. Future Gener Comput Syst 29(3):739–750

    Article  Google Scholar 

  8. Wang L, Khan S (2013) Review of performance metrics for green data centers: a taxonomy study. J Supercomput 63(3):639–656

    Article  MathSciNet  Google Scholar 

  9. Cisco Visual Networking Index (2013) Forecast and methodology, 2009–2014. http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/whitepaper_c11-481360_ns827_Networking_Solutions_White_Paper.html

  10. Great Scott! Over 35 Hours of Video Uploaded Every Minute to Youtube (2013) http://youtube-global.blogspot.com/2010/11/great-scott-over-35-hours-of-video.html

  11. Wu L, Wang Y (2010) The process of criminal investigation based on grey hazy set. In: 2010 IEEE international conference on system, man and cybernetics, pp 26–28

  12. Liu L, Li Z, Delp E (2009) Efficient and low-complexity surveillance video compression using backward-channel aware wyner-ziv video coding. IEEE Trans Circuits Syst Video Technol 19(4):452–465

    Google Scholar 

  13. Zhang J, Zulkernine M, Haque A (2008) Random-forests-based network intrusion detection systems. IEEE Trans. Syst. Man Cybern. C Appl Rev 38(5):649–659

    Article  Google Scholar 

  14. Yu H, Pedrinaci C, Dietze S, Domingue J (2012) Using linked data to annotate and search educational video resources for supporting distance learning. IEEE Trans Learn Technol 5(2):130–142

    Article  Google Scholar 

  15. Xu C, Zhang Y, Zhu G, Rui Y, Lu H, Huang Q (2008) Using webcast text for semantic event detection in broadcast sports video. IEEE Trans Multimedia 10(7):1342–1355

    Article  Google Scholar 

  16. Berners-Lee T, Hendler J, Lassila O (2001) The semantic web. Sci Am 284(5):34–43

    Article  Google Scholar 

  17. Chen H, Ahuja N (2012) Exploiting nonlocal spatiotemporal structure for video segmentation. In: 2012 IEEE conference on computer vision and pattern recognition, pp 741–748

  18. Javed K, Babri H, Saeed M (2012) Feature selection based on class-dependent densities for high-dimensional binary data. IEEE Trans Knowl Data Eng 24(3):465–477

    Article  Google Scholar 

  19. Choi M, Torralba A, Willsky A (2012) A tree-based context model for object recognition. IEEE Trans Pattern Anal Mach Intell 34(2):240–252

    Article  Google Scholar 

  20. Luo X, Xu Z, Yu J, Chen X (2011) Building association link network for semantic link on web resources. IEEE Trans Autom Sci Eng 8(3):482–494

    Article  Google Scholar 

  21. Xu Z, Luo X, Wang L (2011) Incremental building association link network. Comput Syst Sci Eng 26(3):153–162

    MathSciNet  Google Scholar 

  22. Zhuge H (2009) Communities and emerging semantics in semantic link network: discovery and learning. IEEE Trans Knowl Data Eng 21(6):785–799

    Article  MathSciNet  Google Scholar 

  23. Zhuge H (2011) Semantic linking through spaces for cyber-physical-socio intelligence: a methodology. Artif Intell 175:988–1019

    Article  Google Scholar 

  24. Hu C, Xu Z et al (2014) Semantic link network based model for organizing multimedia big data. IEEE Trans Emerg Topics Comput. doi:10.1109/TETC.2014.2316525

  25. Xu Z, et al (2014) Knowle: a semantic link network based system for organizing large scale online news events. Future Gener Comput Syst. doi:10.1016/j.future.2014.04.002

  26. Xu Z, Luo X, Zhang S, Wei X, Mei L, Hu C (2013) Mining, temporal explicit and implicit semantic relations between entities using web search engines. Future Gener Comput Syst. doi:10.1016/J.future.2013.9.027

  27. Wigan M, Clarke R (2013) Big data’s big unintended consequences. Computer 46(6):46–53

    Article  Google Scholar 

  28. Yuan D, Yang Y, Liu X, Li W, Cui L, Xu M, Chen J (2013) A highly practical approach towards achieving minimum datasets storage cost in the cloud. IEEE Trans Parallel Distrib Syst 24(6):1234–1244

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Science and Technology Major Project under Grant 2013ZX01033002-003, in part by the National High Technology Research and Development Program of China (863 Program) under Grant 2013AA014601, 2013AA014603, in part by National Key Technology Support Program under Grant 2012BAH07B01, in part by the National Science Foundation of China under Grant 61300202, and in part by the Science Foundation of Shanghai under Grant 13ZR1452900.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zheng Xu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, Z., Mei, L., Liu, Y. et al. Semantic enhanced cloud environment for surveillance data management using video structural description. Computing 98, 35–54 (2016). https://doi.org/10.1007/s00607-014-0408-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00607-014-0408-7

Keywords

Mathematics Subject Classification

Navigation