Skip to main content

Deep Learning-Based Security System Powered by Low Cost Hardware and Panoramic Cameras

  • Conference paper
  • First Online:
  • 1437 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11487))

Abstract

Automatic video surveillance systems are usually designed to detect anomalous objects being present in a scene or behaving dangerously. In order to perform adequately, they must incorporate models able to achieve accurate pattern recognition in an image, and deep learning neural networks excel at this task. However, exhaustive scan of the full image results in multiple image blocks or windows to analyze, which could make the time performance of the system very poor when implemented on low cost devices. This paper presents a system which attempts to detect abnormal moving objects within an area covered by a 360\(^\circ \) camera. The decision about the block of the image to analyze is based on a mixture distribution composed of two components: a uniform probability distribution, which represents a blind random selection, and a mixture of Gaussian probability distributions. Gaussian distributions represent windows in the image where anomalous objects were detected previously and contribute to generate the next window to analyze close to those windows of interest. The system is implemented on a Raspberry Pi microcontroller-based board, which enables the design and implementation of a low-cost monitoring system that is able to perform image processing.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.microsoft.com/en-us/cognitive-toolkit/.

  2. 2.

    https://microsoft.github.io/ELL/.

References

  1. Adnan, L., Yussoff, Y., Johar, H., Baki, S.: Energy-saving street lighting system based on the waspmote mote. Jurnal Teknologi 76(4), 55–58 (2015)

    Article  Google Scholar 

  2. Angelov, P., Sadeghi-Tehran, P., Clarke, C.: AURORA: autonomous real-time on-board video analytics. Neural Comput. Appl. 28(5), 855–865 (2017)

    Article  Google Scholar 

  3. Boult, T., Gao, X., Micheals, R., Eckmann, M.: Omni-directional visual surveillance. Image Vis. Comput. 22(7), 515–534 (2004)

    Article  Google Scholar 

  4. Chen, C., Li, S., Qin, H., Hao, A.: Robust salient motion detection in non-stationary videos via novel integrated strategies of spatio-temporal coherency clues and low-rank analysis. Pattern Recognit. 52, 410–432 (2016)

    Article  Google Scholar 

  5. Ding, C., Bappy, J.H., Farrell, J.A., Roy-Chowdhury, A.K.: Opportunistic image acquisition of individual and group activities in a distributed camera network. IEEE Trans. Circ. Syst. Video Technol. 27(3), 664–672 (2017)

    Article  Google Scholar 

  6. Ding, C., Song, B., Morye, A., Farrell, J., Roy-Chowdhury, A.: Collaborative sensing in a distributed PTZ camera network. IEEE Trans. Image Process. 21(7), 3282–3295 (2012)

    Article  MathSciNet  Google Scholar 

  7. Dobrzynski, M.K., Pericet-Camara, R., Floreano, D.: Vision tape-a flexible compound vision sensor for motion detection and proximity estimation. IEEE Sens. J. 12(5), 1131–1139 (2012)

    Article  Google Scholar 

  8. Dziri, A., Duranton, M., Chapuis, R.: Real-time multiple objects tracking on raspberry-Pi-based smart embedded camera. J. Electron. Imaging 25, 041005 (2016)

    Article  Google Scholar 

  9. Fung, V., Bosch, J.L., Roberts, S.W., Kleissl, J.: Cloud shadow speed sensor. Atmos. Meas. Tech. 7(6), 1693–1700 (2014)

    Article  Google Scholar 

  10. Gandhi, T., Trivedi, M.M.: Motion analysis for event detection and tracking with a mobile omnidirectional camera. Multimedia Syst. 10(2), 131–143 (2004)

    Article  Google Scholar 

  11. Huo, J., Gao, Y., Yang, W., Yin, H.: Multi-instance dictionary learning for detecting abnormal events in surveillance videos. Int. J. Neural Syst. 24(03), 1430010 (2014)

    Article  Google Scholar 

  12. Lacabex, B., Cuesta-Infante, A., Montemayor, A.S., Pantrigo, J.J.: Lightweight tracking-by-detection system for multiple pedestrian targets. Integr. Comput.-Aided Eng. 23(3), 299–311 (2016)

    Article  Google Scholar 

  13. Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., Alsaadi, F.E.: A survey of deep neural network architectures and their applications. Neurocomputing 234(November 2016), 11–26 (2017)

    Google Scholar 

  14. McCann, M.T., Jin, K.H., Unser, M.: Convolutional neural networks for inverse problems in imaging: a review. IEEE Sig. Process. Mag. 34(6), 85–95 (2017)

    Article  Google Scholar 

  15. Mesquita, R., Mello, C.: Object recognition using saliency guided searching. Integr. Comput.-Aided Eng. 23(4), 385–400 (2016)

    Article  Google Scholar 

  16. Micheloni, C., Rinner, B., Foresti, G.: Video analysis in pan-tilt-zoom camera networks. IEEE Sig. Process. Mag. 27(5), 78–90 (2010)

    Article  Google Scholar 

  17. Ortega-Zamorano, F., Molina-Cabello, M.A., López-Rubio, E., Palomo, E.J.: Smart motion detection sensor based on video processing using self-organizing maps. Expert Syst. Appl. 64, 476–489 (2016)

    Article  Google Scholar 

  18. Sajid, H., Cheung, S.C.S., Jacobs, N.: Appearance based background subtraction for PTZ cameras. Sig. Process.: Image Commun. 47, 417–425 (2016)

    Google Scholar 

  19. Sato, Y., Hashimoto, K., Shibata, Y.: A new networked surveillance video system by combination of omni-directional and network controlled cameras. In: Takizawa, M., Barolli, L., Enokido, T. (eds.) NBiS 2008. LNCS, vol. 5186, pp. 313–322. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85693-1_33

    Chapter  Google Scholar 

  20. Scotti, G., Marcenaro, L., Coelho, C., Selvaggi, F., Regazzoni, C.S.: Dual camera intelligent sensor for high definition 360 degrees surveillance. IEE Proc. Vis. Image Sig. Process. 152(2), 250–257 (2005)

    Article  Google Scholar 

  21. Song, K.T., Tai, J.C.: Dynamic calibration of pan-tilt-zoom cameras for traffic monitoring. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 36(5), 1091–1103 (2006)

    Article  Google Scholar 

  22. Tong, L., Dai, F., Zhang, D., Wang, D., Zhang, Y.: Encoder combined video moving object detection. Neurocomputing 139, 150–162 (2014)

    Article  Google Scholar 

  23. Yagi, Y.: Omnidirectional sensing and its applications. IEICE Trans. Inf. Syst. 82(3), 568–579 (1999)

    Google Scholar 

Download references

Acknowledgment

This work is partially supported by the Ministry of Economy and Competitiveness of Spain under grant TIN2014-53465-R, project name Video surveillance by active search of anomalous events. It is also partially supported by the Autonomous Government of Andalusia (Spain) under project P12-TIC-657, project name Self-organizing systems and robust estimators for video surveillance. All of them include funds from the European Regional Development Fund (ERDF). The authors thankfully acknowledge the computer resources, technical expertise and assistance provided by the SCBI (Supercomputing and Bioinformatics) center of the University of Málaga. They also gratefully acknowledge the support of NVIDIA Corporation with the donation of two Titan X GPUs used for this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jesus Benito-Picazo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Benito-Picazo, J., Domínguez, E., Palomo, E.J., López-Rubio, E. (2019). Deep Learning-Based Security System Powered by Low Cost Hardware and Panoramic Cameras. In: Ferrández Vicente, J., Álvarez-Sánchez, J., de la Paz López, F., Toledo Moreo, J., Adeli, H. (eds) From Bioinspired Systems and Biomedical Applications to Machine Learning. IWINAC 2019. Lecture Notes in Computer Science(), vol 11487. Springer, Cham. https://doi.org/10.1007/978-3-030-19651-6_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-19651-6_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-19650-9

  • Online ISBN: 978-3-030-19651-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics