Skip to main content

Advertisement

SpringerLink
Log in

Aerial Images-Based Forest Fire Detection for Firefighting Using Optical Remote Sensing Techniques and Unmanned Aerial Vehicles

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Due to their fast response capability, low cost and without danger to personnel safety since there is no human pilot on-board, unmanned aerial vehicles (UAVs) with vision-based systems have great potential for monitoring and detecting forest fires. This paper proposes a novel forest fire detection method using both color and motion features for processing images captured from the camera mounted on a UAV which is moving during the whole mission period. First, a color-based fire detection algorithm with light computational demand is designed to extract fire-colored pixels as fire candidate regions by making use of chromatic feature of fire and obtaining fire candidate regions for further analysis. As the pose variations and low-frequency vibrations of UAV cause all objects and background in the images are moving, it is challenging to identify fires defending on a single motion based method. Two types of optical flow algorithms, a classical optical flow algorithm and an optimal mass transport optical flow algorithm, are then combined to compute motion vectors of the fire candidate regions. Fires are thereby expected to be distinguished from other fire analogues based on their motion features. Several groups of experiments are conducted to validate that the proposed method can effectively extract and track fire pixels in aerial video sequences. The good performance is anticipated to significantly improve the accuracy of forest fire detection and reduce false alarm rates without increasing much computation efforts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Yuan, C., Zhang, Y. M., Liu, Z. X.: A survey on technologies for automatic forest fire monitoring, detection and fighting using UAVs and remote sensing techniques. Can. J. Forest Res. 45(7), 783–792 (2015)

    Article  Google Scholar 

  2. Kolarić, D., Skala, K., Dubravić, A.: Integrated system for forest fire early detection and management. Period. Biol. 110(2), 205–211 (2008)

    Google Scholar 

  3. Martinez-de Dios, J. R., Arrue, B. C., Ollero, A., Merino, L., Gómez-Rodríguez, F.: Computer vision techniques for forest fire perception. Image Vision Comput. 26(4), 550–562 (2008)

    Article  Google Scholar 

  4. Gonzalez, J. R., Palahi, M., Trasobares, A., Pukkala, T.: A fire probability model for forest stands in Catalonia (North-East Spain). Ann. For. Sci. 63(2), 169–176 (2006)

    Article  Google Scholar 

  5. Lin, H., Liu, Z., Zhao, T., Zhang, Y.: Early warning system of forest fire detection based on video technology. In: International Symposium on Linear Drives for Industry Applications, pp 751–758 (2014)

  6. Everaerts, J.: The use of unmanned aerial vehicles (UAVs) for remote sensing and mapping. Int. Arch. Photogramm. 37, 1187–1192 (2008)

    Google Scholar 

  7. Berni, J. A., Zarco-Tejada, P. J., Suárez, L., Fereres, E.: Thermal and narrowband multispectral remote sensing for vegetation monitoring from an unmanned aerial vehicle. IEEE Trans. Geosci. Remote Sens. 47(3), 722–738 (2009)

    Article  Google Scholar 

  8. Yuan, C., Liu, Z. X., Zhang, Y. M.: UAVS-based forest fire detection and tracking using image processing techniques. In: International Conference on Unmanned Aircraft Systems, pp 639–643 (2015)

  9. Yuan, C., Liu, Z. X., Zhang, Y. M.: Vision-based forest fire detection in aerial images for firefighting using UAVs. In: International Conference on Unmanned Aircraft Systems, pp 1200–1205 (2016)

  10. Sharifi, F., Zhang, Y. M., Aghdam, A. G.: A distributed deployment strategy for multi-agent systems subject to health degradation and communication delays. J. Intell. Rob. Syst. 73(1–4), 623–633 (2014)

    Article  Google Scholar 

  11. Merino, L., Caballero, F., Martínez-de-Dios, J.R., Maza, I., Ollero, A.: An unmanned aircraft system for automatic forest fire monitoring and measurement. J. Intell. Robot. Syst. 65(1-4), 533–548 (2012)

    Article  Google Scholar 

  12. Liu, Z. X., Yuan, C., Zhang, Y. M., Luo, J.: A learning-based fault tolerant tracking control of an unmanned quadrotor helicopter. J. Intell. Robot. Syst., 1–18 (2015)

  13. Liu, Z. X., Yu, X., Yuan, C., Zhang, Y. M.: Leader-follower formation control of unmanned aerial vehicles with fault tolerant and collision avoidance capabilities. In: International Conference on Unmanned Aircraft Systems, pp 1025–1030 (2015)

  14. Ollero, A., Arrue, B. C., Martínez-de-Dios, J.R., Murillo, J.J.: Techniques for reducing false alarms in infrared forest-fire automatic detection systems. Control Eng. Practice. 7(1), 123–131 (1999)

  15. Ferruz, J., Ollero, A.: Real-time feature matching in image sequences for nonstructured environments: applications to vehicle guidance. J. Intell. Robot. Syst. 28(1–2), 85–123 (2000)

    Article  Google Scholar 

  16. Merino, L., Caballero, F., Martínez-de-Dios, J.R., Ferruz, J., Ollero, A.: A cooperative perception system for multiple UAVs: Application to automatic detection of forest fires. J. Field Robot. 23(3-4), 165–184 (2006)

    Article  Google Scholar 

  17. Maza, I., Caballero, F., Capitán, J., Martínez-de-Dios, J.R., Ollero, A.: Experimental results in multi-UAV coordination for disaster management and civil security applications. J. Intell. Robot. Syst. 61(1-4), 563–585 (2010)

    Article  Google Scholar 

  18. Ambrosia, V. G., Wegener, S., Zajkowski, T., Sullivan, D. V., Buechel, S., Enomoto, F., Lobitz, B., Johan, S., Brass, J., Hinkley, E.: The Ikhana unmanned airborne system (UAS) western states fire imaging missions: from concept to reality (2006–2010). Geocarto Int. 26(2), 85–101 (2011)

    Article  Google Scholar 

  19. Martínez-de-Dios, J.R., Merino, L., Caballero, F., Ollero, A.: Automatic forest-fire measuring using ground stations and unmanned aerial systems. Sensors 11(6), 6328–6353 (2011)

    Article  Google Scholar 

  20. Bradley, J. M., Taylor, C. N.: Georeferenced mosaics for tracking fires using unmanned miniature air vehicles. J. Aerosp. Comput. Inf. Commun. 8(10), 295–309 (2011)

    Article  Google Scholar 

  21. Celik, T., Ozkaramanl, H., Demirel, H.: Fire pixel classification using fuzzy logic and statistical color model. In: IEEE International Conference on Acoustic Speech Signal Processing, vol. 1, pp 1205–1208 (2007)

  22. Chen, T., Wu, P., Chiou, Y.: An early fire-detection method based on image processing. In: IEEE International Conference on Image Processing, pp 1707–1710 (2004)

  23. Toreyin, B. U., Dedeoglu, Y., Cetin, A. E.: Flame detection in video using hidden Markov models. In: IEEE International Conference on Image Processing, vol. 2, pp 1230–1233 (2005)

  24. Celik, T., Demirel, H., Ozkaramanli, H., Uyguroglu, M.: Fire detection using statistical color model in video sequences. J. Visual Commun. Image Represent. 18(2), 176–185 (2007)

    Article  Google Scholar 

  25. Celik, T., Demirel, H.: Fire detection in video sequences using a generic color model. Fire Saf. J. 44(2), 147–158 (2009)

    Article  Google Scholar 

  26. Gunay, O., Tasdemir, K., Toreyin, B. U., Cetin, A. E.: Video based wildfire detection at night. Fire Saf. J. 44(6), 860–868 (2009)

    Article  Google Scholar 

  27. Gunay, O., Toreyin, B. U., Kose, K., Cetin, A. E.: Entropy-functional-based online adaptive decision fusion framework with application to wildfire detection in video. IEEE Trans. Image Process. 21 (5), 2853–2865 (2012)

    Article  MathSciNet  Google Scholar 

  28. Phillips, W., Shah, M., Lobo, N. V.: Flame recognition in video. In: IEEE Workshop on Applications of Computer Vision, pp 224–229 (2000)

  29. Ko, B. C., Cheong, K. H., Nam, J. Y.: Fire detection based on vision sensor and support vector machines. Fire Saf. J. 44(3), 322–329 (2009)

    Article  Google Scholar 

  30. Rodríguez-Canosa, G. R., Thomas, S., del Cerro, J., Barrientos, A., MacDonald, B.: A real-time method to detect and track moving objects (DATMO) from unmanned aerial vehicles (UAVs) using a single camera. Remote Sens. 4(4), 1090–1111 (2012)

    Article  Google Scholar 

  31. Miller, A., Babenko, P., Hu, M., Shah, M.: Person Tracking in UAV Video. Lecture Notes in Computer Science. Springer, Berlin/Heidelberg (2008)

    Google Scholar 

  32. Huang, C. H., Wu, Y. T., Kao, J. H., Shih, M. Y., Chou, C. C.: A hybrid moving object detection method for aerial images. In: Pacific-Rim Conference on Multimedia, pp 357–368 (2010)

  33. Suganuma, N., Kubo, T.: Fast dynamic object extraction using stereovision based on occupancy grid maps and optical flow. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp 978–983 (2011)

  34. Mueller, M., Karasev, P., Kolesov, I., Tannenbaum, A.: Optical flow estimation for flame detection in videos. IEEE Trans. Image Process. 22(7), 2786–2797 (2013)

    Article  Google Scholar 

  35. Horn, B. K., Schunck, B. G.: Determining optical flow. Artif. Intell. 17(1-3), 185–203 (1981)

    Article  Google Scholar 

  36. Cetin, A. E., Dimitropoulos, K., Gouverneur, B., Grammalidisb, N., Gunaya, O., Habiboglua, Y. H., Töreyind, B. U., Verstockte, S.: Video fire detection–review. Digital Signal Process. 23(6), 827–1843 (2013)

    Article  Google Scholar 

  37. Stevens, B. L., Lewis, F. L.: Aircraft Control and Simulation. Wiley (2003)

  38. Katić, D., Vukobratović, M.: Survey of intelligent control techniques for humanoid robots. J. Intell. Robot. Syst. 37(2), 117–141 (2003)

    Article  Google Scholar 

  39. Amit, Y.: 2D Object Detection and Recognition: Models, Algorithms, and Networks. MIT Press, Chicago: Cambridge, Mass (2002)

    Google Scholar 

  40. Utkin, V. I.: Sliding Modes in Control and Optimization. Springer Science & Business Media (2013)

Download references

Author information

Authors and Affiliations

  1. Department of Mechanical and Industrial Engineering, Concordia University, 1455 de Maisonneuve Blvd. W., Montreal, QC, H3G 1M8, Canada

    Chi Yuan, Zhixiang Liu & Youmin Zhang

  2. Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing, Xi’an University of Technology, Xi’an, Shaanxi, 710048, China

    Youmin Zhang

Authors
  1. Chi Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhixiang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Youmin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Youmin Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, C., Liu, Z. & Zhang, Y. Aerial Images-Based Forest Fire Detection for Firefighting Using Optical Remote Sensing Techniques and Unmanned Aerial Vehicles. J Intell Robot Syst 88, 635–654 (2017). https://doi.org/10.1007/s10846-016-0464-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-016-0464-7

Keywords

Search

Navigation