Abstract
As we know that thousands of indoor and outdoor fires break out every day in different parts of the world, which result in a large number of serious causalities and threat to property safety. Therefore, it becomes of extreme importance to detect the fire in its very early stage, because once it is spread it becomes disastrous and difficult to control. The early detection of fire is associated with smoke, which is small at the beginning and have different colors, shape and textures. The initial stage of smoke can be seen easily through digital cameras installed in many locations. This paper proposed a smoke detection algorithm based on dynamical features of smoke using convolutional neural network (CNN). The dynamical features are considered in the form of optical flow color map. The estimation of optical flow is performed based on a fractional order variational model, which is capable in preserving dynamical discontinuities in the optical flow. Optical flow helps to find the active region of the images (video). The estimated color map is further dissected into its RGB channels and the channel with more sensitivity towards smoke motion is segmented with the help of binary mask. Finally, the segmented optical flow color maps are fed into a random forest based CNN architecture and a proposed ensemble learning based CNN architecture. Different accuracy metrics are considered for performance evaluation and comparison with other techniques. A variety of datasets consisting of 10 smoke (4576 frames) and 10 non-smoke (3219 frames) videos are considered for experiments.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aafaq, N., Mian, A., Liu, W., Gilani, S.Z., Shah, M.: Video description: a survey of methods, datasets, and evaluation metrics. ACM Comput. Surv. (CSUR) 52(6), 1–37 (2019)
Ablameyko, S.V., Brovko, N., Bogush, R.: Smoke detection in video based on motion and contrast (2012)
Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vision 92(1), 1–31 (2011)
Balodi, A., Dewal, M., Anand, R.S., Rawat, A.: Texture based classification of the severity of mitral regurgitation. Comput. Biol. Med. 73, 157–164 (2016)
Bansal, R., Pundir, A.S., Raman, B.: Dynamic texture using deep learning. In: Region 10 Conference, pp. 2609–2614 (2017). https://doi.org/10.1109/TENCON.2017.8228302
Bhattiprolu, S.: Python for microscopists (2020). https://github.com/bnsreenu/python_for_microscopists. Accessed 30 May 2022
Chaturvedi, S., Khanna, P., Ojha, A.: A survey on vision-based outdoor smoke detection techniques for environmental safety. ISPRS J. Photogramm. Remote. Sens. 185, 158–187 (2022)
Chino, D.Y., Avalhais, L.P., Rodrigues, J.F., Traina, A.J.: Bowfire: detection of fire in still images by integrating pixel color and texture analysis. In: Conference on Graphics, Patterns and Images, pp. 95–102 (2015)
Dang-Ngoc, H., Nguyen-Trung, H.: Aerial forest fire surveillance-evaluation of forest fire detection model using aerial videos. In: International Conference on Advanced Technologies for Communications, pp. 142–148 (2019)
Ferrari, F.: Weyl and marchaud derivatives: a forgotten history. Mathematics 6(1), 6 (2018)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Horn, B.K., Schunck, B.G.: Determining optical flow. Artif. Intell. 17(1–3), 185–203 (1981)
Huo, Y., et al.: A deep separable convolutional neural network for multiscale image-based smoke detection. Fire Technol. 58(3), 1445–1468 (2022)
Khan, M., Kumar, P.: A nonlinear modeling of fractional order based variational model in optical flow estimation. Optik 261, 169136 (2022)
Kumar, P.: Development of a thermal-visible video surveillance system based on fractional order tv-model. In: Journal of Physics: Conference Series, vol. 1950, p. 012026. IOP Publishing (2021)
Kumar, P., Khan, M., Gupta, S.: Development of an IR video surveillance system based on fractional order tv-model. In: 2021 International Conference on Control, Automation, Power and Signal Processing, pp. 1–7 (2021)
Liang, J.X., Zhao, J.F., Sun, N., Shi, B.J.: Random forest feature selection and back propagation neural network to detect fire using video. J. Sens. 2022 (2022)
Lin, G., Zhang, Y., Zhang, Q., Jia, Y., Xu, G., Wang, J.: Smoke detection in video sequences based on dynamic texture using volume local binary patterns. KSII Trans. Internet Inf. Syst. 11(11), 5522–5536 (2017)
Luo, Y., Zhao, L., Liu, P., Huang, D.: Fire smoke detection algorithm based on motion characteristic and convolutional neural networks. Multimedia Tools Appl. 77(12), 15075–15092 (2018)
Miller, K.S.: Derivatives of noninteger order. Math. Magazine 68(3), 183–192 (1995)
Miller, K.S., Ross, B.: An introduction to the fractional calculus and fractional differential equations. Wiley (1993)
Mueller, M., Karasev, P., Kolesov, I., Tannenbaum, A.: Optical flow estimation for flame detection in videos. IEEE Trans. Image Process. 22(7), 2786–2797 (2013)
Muhammad, K., Ahmad, J., Mehmood, I., Rho, S., Baik, S.W.: Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6, 18174–18183 (2018)
Nguyen, V.T., Quach, C.H., Pham, M.T.: Video smoke detection for surveillance cameras based on deep learning in indoor environment. In: International Conference on Recent Advances in Signal Processing, Telecommunications & Computing, pp. 82–86 (2020). https://doi.org/10.1109/SigTelCom49868.2020.9199056
Oldham, K., Spanier, J.: The fractional calculus theory and applications of differentiation and integration to arbitrary order. Elsevier (1974)
Pincott, J., Tien, P.W., Wei, S., Kaiser Calautit, J.: Development and evaluation of a vision-based transfer learning approach for indoor fire and smoke detection. Building Services Engineering Research and Technology p. 01436244221089445 (2022)
Pundir, A.S., Raman, B.: Deep belief network for smoke detection. Fire Technol. 53(6), 1943–1960 (2017)
Pundir, A.S., Raman, B.: Dual deep learning model for image based smoke detection. Fire Technol. 55(6), 2419–2442 (2019)
Riemann, B.: Versuch einer allgemeinen auffassung der integration und differentiation. Gesammelte Werke 62(1876) (1876)
Shakya, S., Kumar, S.: Characterising and predicting the movement of clouds using fractional-order optical flow. IET Image Proc. 13(8), 1375–1381 (2019)
Shi, J., Wang, W., Gao, Y., Yu, N.: Optimal placement and intelligent smoke detection algorithm for wildfire-monitoring cameras. IEEE Access 8, 72326–72339 (2020). https://doi.org/10.1109/ACCESS.2020.2987991
Tu, Z., Xie, W., Zhang, D., Poppe, R., Veltkamp, R.C., Li, B., Yuan, J.: A survey of variational and CNN-based optical flow techniques. Signal Process. Image Commun. 72, 9–24 (2019)
Wu, Y., Chen, M., Wo, Y., Han, G.: Video smoke detection base on dense optical flow and convolutional neural network. Multimedia Tools Appl. 80(28), 35887–35901 (2021)
Xu, G., Zhang, Y., Zhang, Q., Lin, G., Wang, J.: Deep domain adaptation based video smoke detection using synthetic smoke images. Fire Saf. J. 93, 53–59 (2017)
Zalpour, M., Akbarizadeh, G., Alaei-Sheini, N.: A new approach for oil tank detection using deep learning features with control false alarm rate in high-resolution satellite imagery. Int. J. Remote Sens. 41(6), 2239–2262 (2020)
Acknowledgement
The authors acknowledge to SERB, New Delhi for supporting the presented work with grant no. EEQ/2020/000154. The third author Muzammil Khan shows gratitude to MHRD, New Delhi, Government of India.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gupta, S., Khan, M., Kumar, P. (2023). Prediction of Fire Signatures Based on Fractional Order Optical Flow and Convolution Neural Network. In: Gupta, D., Bhurchandi, K., Murala, S., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2022. Communications in Computer and Information Science, vol 1777. Springer, Cham. https://doi.org/10.1007/978-3-031-31417-9_24
Download citation
DOI: https://doi.org/10.1007/978-3-031-31417-9_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31416-2
Online ISBN: 978-3-031-31417-9
eBook Packages: Computer ScienceComputer Science (R0)