Abstract
Fire and smoke detection using deep learning have recently proven to be a robust and efficient detection approach in contrast to traditional vision-based techniques. Efforts are made by researchers to leverage this promising direction but are always faced with a trade-off between performance accuracy and model size. To tackle this, we present Light-FireNet, an enhanced lightweight, fast, and cost-effective system based on a combination of lighter convolution mechanisms inspired by Hard Swish (H-Swish), and a novel architectural design built from scratch. Experimental results and performance analysis reveal that our proposed method has 32% fewer parameters than AlexNet, 3.03 MB lighter than MobileNetV2, and achieves a better detection accuracy of 97.83%, which is higher than most existing fire detection techniques in the literature.
Similar content being viewed by others
References
Ajith M, Martinez-Ramon M (2019) Unsupervised Segmentation of Fire and Smoke from Infra-Red Videos. IEEE Access 7:182381–182394
Basha SHS, Dubey SR, Pulabaigari V, Mukherjee S (2020) Impact of fully connected layers on the performance of convolutional neural networks for image classification. Neurocomputing 378:112–119
Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circ Syst Video Technol 20(5):721–731
Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185
Chaoxia C, Shang W, Zhang F (2020) Information-guided flame detection based on faster R-CNN. IEEE Access 8:58923–58932
Chen TH, Wu PH, Chiou YC, Ieee (2004) An early fire-detection method based on image processing. In International Conference on Image Processing (ICIP), Singapore, pp 1707–1710
Chino DYT, Avalhais LPS, Rodrigues JJF, Traina AJM (2015) BoWFire: detection of fire in still images by integrating pixel color and texture analysis. Procedings of 28th SIBGRAPI Conf Graphics, Patterns Images, pp 95–102
Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In 30th IEEE/CVF conference on computer vision and pattern recognition (CVPR), Honolulu, HI, 2017, pp 1800–1807
Deng J, Dong W, Socher R, Li LJ, Li K, Li FF (2009) ImageNet: a large-scale hierarchical image database. In IEEE-Computer-Society Conference on Computer Vision and Pattern Recognition Workshops, Miami Beach, FL, pp 248–255: IEEE
Dimitropoulos K, Barmpoutis P, Grammalidis N (2017) Higher-order linear dynamical Systems for Smoke Detection in video surveillance applications. IEEE Trans Circ Syst Video Technol 27(5):1143–1154
Dunnings AJ, Breckon TP (2018) Experimentally defined convolutional neural network architecture variants for non-temporal real-time fire detection. In 25th IEEE international conference on image processing (ICIP), Athens, GREECE, pp 1358–1362
Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circ Syst Video Technol 25(9):1545–1556
Frizzi S, Kaabi R, Bouchouicha M, Ginoux JM, Moreau E, Fnaiech F (2016) Convolutional neural network for video fire and smoke detection. Proceedings of the Iecon 2016 - 42nd Annual Conference of the Ieee Industrial Electronics Society, pp 877–882
Gaur A, Singh A, Kumar A, Kulkarni KS, Lala S, Kapoor K, Srivastava V, Kumar A, Mukhopadhyay SC (2019) Fire sensing technologies: a review. IEEE Sensors J 19(9):3191–3202
He K, Zhang X, Ren S, Sun J (2015) Delving deep into rectifiers: surpassing human-level performance on imagenet classification. Proc IEEE Int Conf Comput Vis, pp 1026–1034
He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In IEEE conference on computer vision and pattern recognition (CVPR), Seattle, WA, pp 770–778
Hou J, Qian JR, Zhang WJ, Zhao ZZ, Pan P (2011) Fire detection algorithms for video images of large space structures. Multimed Tools Appl 52(1):45–63
Howard AG et al (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861 [Online]
Howard A et al (2019) Searching for MobileNetV3. arXiv:1905.02244 [Online]
Hu J, Shen L, Albanie S, Sun G, Wu EH (2020) Squeeze-and-excitation networks. IEEE Trans Pattern Anal Mach Intell 42(8):2011–2023
Huang G, Liu Z, Maaten LVD, Weinberger KQ (2017) Densely connected convolutional networks. IEEE conference on computer vision and pattern recognition (CVPR)
Hüttner V, Steffens CR, Costa Botelho SS (2017) First response fire combat: Deep leaning based visible fire detection. Proc Latin Amer Robot Symp (LARS) Brazilian Symp Robot (SBR), pp 1–6
Iandola FN, Moskewicz MW, Ashraf K, Han S, Dally WJ, Kurt K (2016) SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167 [Online]
Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Saf J 44(3):322–329
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Proc Adv Neural Inf Process Syst pp 1097–1105
Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90
Li Z, Mihaylova LS, Isupova O, Rossi L (2018) Autonomous flame detection in videos with a Dirichlet process Gaussian mixture color model. IEEE Trans Ind Inf 14(3):1146–1154
Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Saf J 41(4):285–289
Muhammad K, Ahmad J, Lv Z, Bellavista P, Yang P, Baik SW (2019) Efficient deep CNN-based fire detection and localization in video surveillance applications. IEEE Trans Syst Man Cybern Syst 49(7):1419–1434
Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183
Muhammad K, Khan S, Elhoseny M, Ahmed SH, Baik SW (2019) Efficient fire detection for uncertain surveillance environment. IEEE Trans Ind Inf 15(5):3113–3122
Nair V, Hinton GE (2010) Rectified linear units improve restricted boltzmann machines. Proceedings of 27th Int Conf Mach Learn (ICML), pp 807–814
Qiu T, Yan Y, Lu G (2012) An autoadaptive edge-detection algorithm for flame and fire image processing. IEEE Trans Instrum Meas 61(5):1486–1493
Ramachandran P, Zoph B, Le QV (2017) Searching for activation functions. arxiv.org/abs/1710.05941 [Online]
Roque G, Padilla VS (2020) LPWAN based IoT surveillance system for outdoor fire detection. IEEE Access 8:114900–114909
Sandler M, Howard A, Zhu ML, Zhmoginov A, Chen LC (2018) MobileNetV2: inverted residuals and linear bottlenecks. In 31st IEEE/CVF conference on computer vision and pattern recognition (CVPR), Salt Lake City, UT, pp 4510–4520
Sharma J, Granmo OC, Goodwin M, F. J. T. (2017) Deep convolutional neural networks for fire detection in images. Proceedings of Int Conf Eng Appl Neural Netw pp 183–193
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 [Online]
Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdino R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958
Steffens CR, Botelho SSDC, Rodrigues RN (2016) A texture driven approach for visible spectrum fire detection on mobile robots. Proc Latin Amer Robot Symp IV Brazilian Robot Symp (LARS/SBR), pp 257–262
Steffens CR, Rodrigues RN, Costa Botelho SS (2015) An unconstrained dataset for non-stationary video-based fire detection. Proc Latin Amer Robot Symp IV Brazilian Robot Symp (LARS/SBR), pp 25–30
Szegedy C, Ioffe S, Vanhoucke V, Alemi AA, Aaai (2017) Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Thirty-First Aaai Conference on Artificial Intelligence, pp 4278–4284
Szegedy C et al (2015) Going deeper with convolutions. In IEEE conference on computer vision and pattern recognition (CVPR), Boston, MA, pp 1–9
Tan M, Le QV (2019) EfficientNet: rethinking model scaling for convolutional neural networks. arXiv:1905.11946 [Online]
Wang T, Bu L, Yang Z, Yuan P, Ouyang J (2020) A new fire detection method using a multi-expert system based on color dispersion, similarity and centroid motion in indoor environment. IEEE-CAA J Autom Sin 7(1):263–275
Wu XH, Lu XB, Leung H (2020) A motion and lightness saliency approach for forest smoke segmentation and detection. Multimed Tools Appl 79(1–2):69–88
Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network. arXiv:1505.00853 [Online]
Yang H, Jang H, Kim T, Lee B (2019) Non-temporal lightweight fire detection network for intelligent surveillance systems. IEEE Access 7:169257–169266
Zhang X, Zhou XY, Lin MX, Sun R (2018) ShuffleNet: an extremely efficient convolutional neural network for Mobile devices. In 31st IEEE/CVF conference on computer vision and pattern recognition (CVPR), Salt Lake City, UT, pp 6848–6856
Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. IEEE/CVF Conference on Computer Vision and Pattern Recognition
Acknowledgments
This work is supported by the National Natural Science Foundation of China under Grant No. 62071396.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors hereby declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khudayberdiev, O., Zhang, J., Abdullahi, S.M. et al. Light-FireNet: an efficient lightweight network for fire detection in diverse environments. Multimed Tools Appl 81, 24553–24572 (2022). https://doi.org/10.1007/s11042-022-12552-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12552-5