Skip to main content

Prediction of Fire Signatures Based on Fractional Order Optical Flow and Convolution Neural Network

  • Conference paper
  • First Online:
Computer Vision and Image Processing (CVIP 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1777))

Included in the following conference series:

Abstract

As we know that thousands of indoor and outdoor fires break out every day in different parts of the world, which result in a large number of serious causalities and threat to property safety. Therefore, it becomes of extreme importance to detect the fire in its very early stage, because once it is spread it becomes disastrous and difficult to control. The early detection of fire is associated with smoke, which is small at the beginning and have different colors, shape and textures. The initial stage of smoke can be seen easily through digital cameras installed in many locations. This paper proposed a smoke detection algorithm based on dynamical features of smoke using convolutional neural network (CNN). The dynamical features are considered in the form of optical flow color map. The estimation of optical flow is performed based on a fractional order variational model, which is capable in preserving dynamical discontinuities in the optical flow. Optical flow helps to find the active region of the images (video). The estimated color map is further dissected into its RGB channels and the channel with more sensitivity towards smoke motion is segmented with the help of binary mask. Finally, the segmented optical flow color maps are fed into a random forest based CNN architecture and a proposed ensemble learning based CNN architecture. Different accuracy metrics are considered for performance evaluation and comparison with other techniques. A variety of datasets consisting of 10 smoke (4576 frames) and 10 non-smoke (3219 frames) videos are considered for experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aafaq, N., Mian, A., Liu, W., Gilani, S.Z., Shah, M.: Video description: a survey of methods, datasets, and evaluation metrics. ACM Comput. Surv. (CSUR) 52(6), 1–37 (2019)

    Article  Google Scholar 

  2. Ablameyko, S.V., Brovko, N., Bogush, R.: Smoke detection in video based on motion and contrast (2012)

    Google Scholar 

  3. Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vision 92(1), 1–31 (2011)

    Article  Google Scholar 

  4. Balodi, A., Dewal, M., Anand, R.S., Rawat, A.: Texture based classification of the severity of mitral regurgitation. Comput. Biol. Med. 73, 157–164 (2016)

    Article  Google Scholar 

  5. Bansal, R., Pundir, A.S., Raman, B.: Dynamic texture using deep learning. In: Region 10 Conference, pp. 2609–2614 (2017). https://doi.org/10.1109/TENCON.2017.8228302

  6. Bhattiprolu, S.: Python for microscopists (2020). https://github.com/bnsreenu/python_for_microscopists. Accessed 30 May 2022

  7. Chaturvedi, S., Khanna, P., Ojha, A.: A survey on vision-based outdoor smoke detection techniques for environmental safety. ISPRS J. Photogramm. Remote. Sens. 185, 158–187 (2022)

    Article  Google Scholar 

  8. Chino, D.Y., Avalhais, L.P., Rodrigues, J.F., Traina, A.J.: Bowfire: detection of fire in still images by integrating pixel color and texture analysis. In: Conference on Graphics, Patterns and Images, pp. 95–102 (2015)

    Google Scholar 

  9. Dang-Ngoc, H., Nguyen-Trung, H.: Aerial forest fire surveillance-evaluation of forest fire detection model using aerial videos. In: International Conference on Advanced Technologies for Communications, pp. 142–148 (2019)

    Google Scholar 

  10. Ferrari, F.: Weyl and marchaud derivatives: a forgotten history. Mathematics 6(1), 6 (2018)

    Article  MATH  Google Scholar 

  11. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  12. Horn, B.K., Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)

    Article  MATH  Google Scholar 

  13. Huo, Y., et al.: A deep separable convolutional neural network for multiscale image-based smoke detection. Fire Technol. 58(3), 1445–1468 (2022)

    Article  Google Scholar 

  14. Khan, M., Kumar, P.: A nonlinear modeling of fractional order based variational model in optical flow estimation. Optik 261, 169136 (2022)

    Article  Google Scholar 

  15. Kumar, P.: Development of a thermal-visible video surveillance system based on fractional order tv-model. In: Journal of Physics: Conference Series, vol. 1950, p. 012026. IOP Publishing (2021)

    Google Scholar 

  16. Kumar, P., Khan, M., Gupta, S.: Development of an IR video surveillance system based on fractional order tv-model. In: 2021 International Conference on Control, Automation, Power and Signal Processing, pp. 1–7 (2021)

    Google Scholar 

  17. Liang, J.X., Zhao, J.F., Sun, N., Shi, B.J.: Random forest feature selection and back propagation neural network to detect fire using video. J. Sens. 2022 (2022)

    Google Scholar 

  18. Lin, G., Zhang, Y., Zhang, Q., Jia, Y., Xu, G., Wang, J.: Smoke detection in video sequences based on dynamic texture using volume local binary patterns. KSII Trans. Internet Inf. Syst. 11(11), 5522–5536 (2017)

    Google Scholar 

  19. Luo, Y., Zhao, L., Liu, P., Huang, D.: Fire smoke detection algorithm based on motion characteristic and convolutional neural networks. Multimedia Tools Appl. 77(12), 15075–15092 (2018)

    Article  Google Scholar 

  20. Miller, K.S.: Derivatives of noninteger order. Math. Magazine 68(3), 183–192 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  21. Miller, K.S., Ross, B.: An introduction to the fractional calculus and fractional differential equations. Wiley (1993)

    Google Scholar 

  22. Mueller, M., Karasev, P., Kolesov, I., Tannenbaum, A.: Optical flow estimation for flame detection in videos. IEEE Trans. Image Process. 22(7), 2786–2797 (2013)

    Article  Google Scholar 

  23. Muhammad, K., Ahmad, J., Mehmood, I., Rho, S., Baik, S.W.: Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6, 18174–18183 (2018)

    Article  Google Scholar 

  24. Nguyen, V.T., Quach, C.H., Pham, M.T.: Video smoke detection for surveillance cameras based on deep learning in indoor environment. In: International Conference on Recent Advances in Signal Processing, Telecommunications & Computing, pp. 82–86 (2020). https://doi.org/10.1109/SigTelCom49868.2020.9199056

  25. Oldham, K., Spanier, J.: The fractional calculus theory and applications of differentiation and integration to arbitrary order. Elsevier (1974)

    Google Scholar 

  26. Pincott, J., Tien, P.W., Wei, S., Kaiser Calautit, J.: Development and evaluation of a vision-based transfer learning approach for indoor fire and smoke detection. Building Services Engineering Research and Technology p. 01436244221089445 (2022)

    Google Scholar 

  27. Pundir, A.S., Raman, B.: Deep belief network for smoke detection. Fire Technol. 53(6), 1943–1960 (2017)

    Article  Google Scholar 

  28. Pundir, A.S., Raman, B.: Dual deep learning model for image based smoke detection. Fire Technol. 55(6), 2419–2442 (2019)

    Article  Google Scholar 

  29. Riemann, B.: Versuch einer allgemeinen auffassung der integration und differentiation. Gesammelte Werke 62(1876) (1876)

    Google Scholar 

  30. Shakya, S., Kumar, S.: Characterising and predicting the movement of clouds using fractional-order optical flow. IET Image Proc. 13(8), 1375–1381 (2019)

    Article  Google Scholar 

  31. Shi, J., Wang, W., Gao, Y., Yu, N.: Optimal placement and intelligent smoke detection algorithm for wildfire-monitoring cameras. IEEE Access 8, 72326–72339 (2020). https://doi.org/10.1109/ACCESS.2020.2987991

    Article  Google Scholar 

  32. Tu, Z., Xie, W., Zhang, D., Poppe, R., Veltkamp, R.C., Li, B., Yuan, J.: A survey of variational and CNN-based optical flow techniques. Signal Process. Image Commun. 72, 9–24 (2019)

    Article  Google Scholar 

  33. Wu, Y., Chen, M., Wo, Y., Han, G.: Video smoke detection base on dense optical flow and convolutional neural network. Multimedia Tools Appl. 80(28), 35887–35901 (2021)

    Article  Google Scholar 

  34. Xu, G., Zhang, Y., Zhang, Q., Lin, G., Wang, J.: Deep domain adaptation based video smoke detection using synthetic smoke images. Fire Saf. J. 93, 53–59 (2017)

    Article  Google Scholar 

  35. Zalpour, M., Akbarizadeh, G., Alaei-Sheini, N.: A new approach for oil tank detection using deep learning features with control false alarm rate in high-resolution satellite imagery. Int. J. Remote Sens. 41(6), 2239–2262 (2020)

    Article  Google Scholar 

Download references

Acknowledgement

The authors acknowledge to SERB, New Delhi for supporting the presented work with grant no. EEQ/2020/000154. The third author Muzammil Khan shows gratitude to MHRD, New Delhi, Government of India.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muzammil Khan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gupta, S., Khan, M., Kumar, P. (2023). Prediction of Fire Signatures Based on Fractional Order Optical Flow and Convolution Neural Network. In: Gupta, D., Bhurchandi, K., Murala, S., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2022. Communications in Computer and Information Science, vol 1777. Springer, Cham. https://doi.org/10.1007/978-3-031-31417-9_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-31417-9_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-31416-2

  • Online ISBN: 978-3-031-31417-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics