Abstract
Video based surveillance of manmade disasters such as fire has become very hot topic in research and it is playing an important role in the development of smart environment. The disasters like fire cause many economic and social damages. We can prevent these damages by early detection of the fire. The current advancement in embedded processing have permitted the detection of fire using vision-based i.e. Convolutional Neural Networks (CNNs) for the surveillance. Therefore, we proposed a method using machine learning techniques for Multimedia Surveillance during fire emergencies. Our proposed model has two main deep neural networks models. Firstly, we used a hybrid model made of Adaboost and many Mulit-layer perceptron (MLP) neural networks. The purpose of hybrid Adaboost-MLP model is to predict fire efficiently. This model used different sensors data like smoke, heat, and gas for training. After predicting the fire, we proposed a CNN model to detect the fire immediately. These results show that our trained model has near 91% fire detection accuracy. We can the false positive results are quite low. These results can be improved more by further training.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abdel-Basset M, Manogaran G, Abdel-Fatah L, Mirjalili S (2018) An improved nature inspired meta-heuristic algorithm for 1-D bin packing problems. Pers Ubiquitous Comput 1117–1132. doi:https://doi.org/10.1007/s00779-018-1132-7
Abdel-Basset M, Manogaran G, Mohamed M, Rushdy E (2018) Internet of things in smart education environment: supportive framework in the decision-making process. Concurr Comput. https://doi.org/10.1002/cpe.4515
Abdul R, Paul A, Gul MJ et al (2018) Exploiting small world problems in a SIoT environment. Energies 11:2089. https://doi.org/10.3390/en11082089
Andrew LM, Awni YH, Andrew YN (2013) Rectifier nonlinearities improve neural network acoustic models. Proc 30 th Int Conf Mach Learn Atlanta, Georgia: 1–6
Anwar S, Hwang K, Sung W (2015) Fixed point optimization of deep convolutional neural networks for object recognition. ICASSP, IEEE international conference on acoustics, speech and signal processing - proceedings. IEEE, Brisbane, QLD, Australia: 1131–1135
Çelik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Saf J 44:147–158. https://doi.org/10.1016/j.firesaf.2008.05.005
Çelik T, Özkaramanlı H, Demirel H (2007) Fire and smoke detection without sensors: image procecessing based approach. 15th European Signal Processing Conference (EUSIPCO). IEEE, Poznan, Poland: 1794–1798
Chan TH, Jia K, Gao S et al (2015) PCANet: a simple deep learning baseline for image classification? IEEE Trans Image Process 24:5017–5032. https://doi.org/10.1109/TIP.2015.2475625
Chen TC, Wu P, Chiou Y (2004) An early fire-detection method based on image processing: 1707–1710
Chino DYT, Avalhais LPS, Rodrigues Jr. JF, Traina AJM (2015) BoWFire: detection of fire in still images by integrating pixel color and texture analysis. 28th SIBGRAPI conference on graphics, patterns and images. IEEE, Salvador, Brazil: 95–102
Ciresan DC, Meier U, Masci J, et al (2011) Flexible, high performance convolutional neural networks for image classification. In: proceedings of the twenty-second international joint conference on artificial intelligence. IJCAI, Barcelona, Catalonia, Spain: 1237–1242
Cun YL, Boser B, Denker JS, et al (1989) Handwritten digit recognition with a Back-propagation network. In: David T (ed) Advances in neural information processing systems 2. Morgan Kaufmann: 396–404
Fraustino JD, Liu B, Yan J (2012) Social media use during disasters: a review of the Knowledge Base and gaps. Dep Homel Secur Sci Technol Cent Excell 1–39
Freund Y (1995) Boosting a weak learning algorithm by majority. Inf Comput. https://doi.org/10.1006/inco.1995.1136
Fukushima K (1980) Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol Cybern 36:193–202. https://doi.org/10.1007/BF00344251
(2018) Gas explosion in harlem blows up 2 buildings, 2 women dead & 17 injured. In: WIKIPEDIA. http://wordondastreet.com/gas-explosion-harlem-blows-2-buildings-2-women-dead-17-injured/. Accessed 16 Dec 2018
Guo L, Ge PS, Zhang MH et al (2012) Pedestrian detection for intelligent transportation systems combining AdaBoost algorithm and support vector machine. Expert Syst Appl 39:4274–4286. https://doi.org/10.1016/j.eswa.2011.09.106
Habiboǧlu YH, Günay O, Çetin AE (2012) Covariance matrix-based fire and flame detection method in video. Mach Vis Appl 23:1103–1113. https://doi.org/10.1007/s00138-011-0369-1
Hubel DH, Wiesel TN (1977) Functional architecture of macaque monkey visual cortex. Proc R Soc B Biol Sci 198:1–59. https://doi.org/10.1098/rspb.1977.0085
Jiang B, Yang J, Lv Z et al (2017) Internet cross-media retrieval based on deep learning. J Vis Commun Image Represent 48:356–366. https://doi.org/10.1016/j.jvcir.2017.02.011
Li W, Zhao R, Xiao T, Wang X (2014) DeepReID: Deep Filter Pairing Neural Network for Person Re-Identification. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Columbus, OH, USA: 152–159
Liu H, Tian HQ, Li YF, Zhang L (2015) Comparison of four Adaboost algorithm based artificial neural networks in wind speed predictions. Energy Convers Manag 92:67–81. https://doi.org/10.1016/j.enconman.2014.12.053
Luo P, Tian Y, Wang X, Tang X (2014) Switchable Deep Network for Pedestrian Detection. IEEE Conference on Computer Vision and Pattern Recognition. IEEE, Columbus, OH, USA: 899–905
Mueller M, Karasev P, Kolesov I, Tannenbaum A (2013) Optical flow estimation for flame detection in videos. IEEE Trans Image Process 22:2786–2797. https://doi.org/10.1109/TIP.2013.2258353
Narwani S, Selva Kumar A (2016) Real-time fire detection for video surveillance applications using a combination of experts based on color, shape and motion. IEEE Trans Circ Syst Video Technol 25:1545–1556. https://doi.org/10.1109/TCSVT.2015.2392531
(2018) November 2015 Paris attacks. In: WIKIPEDIA. https://en.wikipedia.org/wiki/November_2015_Paris_attacks. Accessed 16 Dec 2018
Paul A, Jiang YC, Wang JF, Yang JF (2012) Parallel reconfigurable computing-based mapping algorithm for motion estimation in advanced video coding. ACM Transactions on Embedded Computing Systems (TECS) 11(S2):40
Paul A, Chen B-W, Bharanitharan K, Wang J-F (2013) Video search and indexing with reinforcement agent for interactive multimedia services. ACM Trans Embed Comput Syst 12:1–16. https://doi.org/10.1145/2423636.2423643
Paul A, Ahmad A, Rathore MM, Jabbar S (2016) Smartbuddy: defining human behaviors using big data analytics in social internet of things. IEEE Wirel Commun 23:68–74. https://doi.org/10.1109/MWC.2016.7721744
Paul A, Daniel A, Ahmad A, Rho S (2017) Cooperative cognitive intelligence for internet of vehicles. IEEE Syst J 11(3):1249–1258. https://doi.org/10.1109/JSYST.2015.2411856
Rafei M, Sorkhabi SE, Mosavi MR (2014) Multi-objective optimization by means of multi-dimensional MLP neural networks. Neural Netw World 24:31–56. https://doi.org/10.14311/NNW.2014.24.002
Rehman A, Rathore MM, Paul A et al (2018) Vehicular traffic optimisation and even distribution using ant colony in smart city environment. IET Intell Transp Syst:1–8. https://doi.org/10.1049/iet-its.2017.0308
Rosario DL, Antonio G, Alessia S, Mario V (2014) Improving fire detection reliability by a combination of video analytics. International conference image analysis and recognition. Springer, Cham: 477–478
Saeed F, Paul A, Rehman A et al (2018) IoT-based intelligent modeling of smart home environment for fire prevention and safety. J Sens Actuator Netw 7:11. https://doi.org/10.3390/jsan7010011
Vadim K, Maxime O, Minsu C, Laptev I (2016) ContextLocNet: context-aware deep network models for weakly supervised localization. European conference on computer vision (ECCV): 350–365
Wenlu Z, Rongjian L, Houtao D et al (2015) Deep convolutional neural networks for multi-modality isointense infant brain image segmentation. Neuroimage 108:214–224. https://doi.org/10.1016/j.neuroimage.2014.12.061
Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network. doi:https://doi.org/10.1016/S0266-8920(98)00020-4
Yang J, Jiang B, Li B et al (2017) A fast image retrieval method designed for network big data. IEEE Trans Ind Inform 13:2350–2359. https://doi.org/10.1109/TII.2017.2657545
Acknowledgements
This study was also supported by the National Research Foundation of Korea (NRF) grant funded by the Korean Government (NRF-2017R1C1B5017464). This study was also supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIP) (NRF-2016R1A2A1A05005459).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Saeed, F., Paul, A., Hong, W.H. et al. Machine learning based approach for multimedia surveillance during fire emergencies. Multimed Tools Appl 79, 16201–16217 (2020). https://doi.org/10.1007/s11042-019-7548-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-7548-x