Skip to main content
Log in

Learning-Based Smoke Detection for Unmanned Aerial Vehicles Applied to Forest Fire Surveillance

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Forests are potentially and seriously threatened by fires which have caused huge damages and losses of life and properties every year. In general, it is easier to detect smoke than fire in its early stage. Developing an effective and safe smoke detection method is thereby critical for early forest fire fighting and preventing the fire developing into uncontrollable. This paper presents a learning-based fuzzy smoke detection approach intended to achieve an effective and early forest fire detection, while greatly reduce the negative impacts from clouds in the sky, illumination variations, and changes of forest features. First, a fuzzy-logic based smoke detection rule is designed for detecting and segmenting smoke regions in the visual images captured by the camera onboard an unmanned aerial vehicle (UAV). The differences of each two components of red, green, and blue (RGB) model and intensity in hue, saturation, and intensity (HSI) model of images are chosen as inputs of a fuzzy logic rule, while the smoke likelihood is selected as its output. Then, an extended Kalman filter (EKF) is further employed for reshaping the inputs and output of the fuzzy smoke detection rule on-line. It is expected to provide the smoke detection method with additional regulating flexibility adapting to variations of environmental conditions and reliable automatic detection performance. Next, the morphological operation is also adopted to remove imperfections induced by noises and textures distorted nonconvex/concave segments. Finally, extensive studies on several sets of images containing smoke under distinct environmental conditions are conducted to validate the proposed methodology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Flannigan, M., Cantin, A.S., De Groot, W.J., Wotton, M., Newbery, A., Gowman, L.M.: Global wildland fire season severity in the 21st century. For. Ecology Management. 294, 54–61 (2013)

    Article  Google Scholar 

  2. Le Goff, H., Flannigan, M.D., Bergeron, Y.: Potential changes in monthly fire risk in the eastern Canadian boreal forest under future climate change. Canadian J. For. Res. 39(12), 2369–2380 (2009)

    Article  Google Scholar 

  3. Yuan, C., Zhang, Y.M., Liu, Z.X.: A survey on technologies for automatic forest fire monitoring, detection and fighting using UAVs and remote sensing techniques. Can. J. Forest Res. 45(7), 783–792 (2015)

    Article  Google Scholar 

  4. Ho, C.C.: Machine vision-based real-time early flame and smoke detection. Measurement Sci. Tech. 20(4), 1–13 (2009)

    Article  Google Scholar 

  5. Chen, T.H., Yin, Y.H., Huang, S.F., Ye, Y.T.: The smoke detection for early fire-alarming system based on video processing. IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing. pp. 427–430 (2006)

  6. Yuan, F.: A fast accumulative motion orientation model based on integral image for video smoke detection. Pattern Recognit. Lett. 29(7), 925–932 (2008)

    Article  Google Scholar 

  7. Wei, Z., Wang, X., An, W., Che, J.: Target-tracking based early fire smoke detection in video. International Conference on Image and Graphics. pp. 172–176 (2009)

  8. Yang, J., Chen, F., Zhang, W.: Visual-based smoke detection using support vector machine. Int. Conf. Natural Comput. 4, 301–305 (2008)

    Google Scholar 

  9. Gubbi, J., Marusic, S., Palaniswami, M.: Smoke detection in video using wavelets and support vector machines. Fire Saf. J. 44(8), 1110–1115 (2009)

    Article  Google Scholar 

  10. Töreyin, B.U., Dedeoğlu, Y., Cetin, A.E.: Wavelet based real-time smoke detection in video. European Conference on Signal Processing. pp. 1–4 (2005)

  11. Töreyin, B.U., Dedeoğlu, Y., Cetin, A.E.: Contour based smoke detection in video using wavelets. European Conference on Signal Processing. pp. 1–4 (2006)

  12. Xu, Z., Xu, J.: Automatic fire smoke detection based on image visual features. International Conference on Computational Intelligence and Security Workshops. pp. 316–319 (2007)

  13. Yu, C.Y., Fang, J., Wang, J.J., Zhang, Y.M.: Video fire smoke detection using motion and color features. Fire Technol. 46(3), 651–663 (2010)

    Article  Google Scholar 

  14. Vicente, J., Guillemant, P.: An image processing technique for automatically detecting forest fire. Int. J. Therm. Sciences. 41(12), 1113–1120 (2002)

    Article  Google Scholar 

  15. Xiong, Z., Caballero, R., Wang, H., Finn, A.M., Lelic, M.A., Peng, P.Y.: Video-based smoke detection: possibilities, techniques, and challenges Fire Suppression and Detection Research and Applications Conference (2007)

  16. Cui, Y., Dong, H., Zhou, E.: An early fire detection method based on smoke texture analysis and discrimination. Congress Image Signal Process. 3, 95–99 (2008)

    Article  Google Scholar 

  17. Lee, C.Y., Lin, C.T., Hong, C.T., Su, M.T.: Smoke detection using spatial and temporal analyses. J. Innovative Comput. Inf. Control. 8(7), 4749–4770 (2012)

    Google Scholar 

  18. Tung, T.X., Kim, J.M.: An effective four-stage smoke-detection algorithm using video images for early fire-alarm systems. Fire Saf. J. 46(5), 276–282 (2011)

    Article  Google Scholar 

  19. Chen, T.H., Wu, P.H., Chiou, Y.C.: An early fire-detection method based on image processing. Int. Conference Image Process. 3, 1707–1710 (2004)

    Google Scholar 

  20. Sugeno, M., Yasukawa, T.: A fuzzy-logic-based approach to qualitative modeling. IEEE Trans. Fuzzy Syst. 1(1), 7–31 (1993)

    Article  Google Scholar 

  21. Ahn, K.K., Truong, D.Q.: Online tuning fuzzy PID controller using robust extended Kalman filter. J. Process Control 19(6), 1011–1023 (2009)

    Article  Google Scholar 

  22. Liu, Z.X., Yuan, C., Zhang, Y.M., Luo, J.: A learning-based fault tolerant tracking control of an unmanned quadrotor helicopter. J. Intell. Robot. Syst. 84(1), 145–162 (2016)

    Article  Google Scholar 

  23. Grewal, M.S.: Kalman filtering. Springer, Berlin (2011)

    Google Scholar 

Download references

Acknowledgments

This work was supported in part by the Natural Sciences and Engineering Research Council of Canada, in part by the National Natural Science Foundation of China under Grant 61573282. The authors would like to express their sincere gratitude to the Editor-in-Chief, the Guest Editors, and the anonymous reviewers whose insightful comments have helped to improve the quality of this paper considerably.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Youmin Zhang.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported partially by Natural Sciences and Engineering Research Council of Canada.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, C., Liu, Z. & Zhang, Y. Learning-Based Smoke Detection for Unmanned Aerial Vehicles Applied to Forest Fire Surveillance. J Intell Robot Syst 93, 337–349 (2019). https://doi.org/10.1007/s10846-018-0803-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-018-0803-y

Keywords

Navigation