Skip to main content
Log in

A UAV Guidance System Using Crop Row Detection and Line Follower Algorithms

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

In precision agriculture, activities such as selective spraying of agrochemicals are essential to maintaining high productivity and quality of agricultural products. The use of unmanned aerial vehicles (UAVs) to perform this activity reduces soil compaction, compared to the use of heavy machinery, and helps to reduce the waste of these artificial substances through a punctual and self-regulating application. This work proposes an entire guiding system for use on UAVs (hardware and software) based on image processing techniques. The software part consists of two algorithms. The first algorithm is the Crop Row Detection which is responsible for the correct identification of the crop rows. The second algorithm is the Line Filter that is responsible for generating the driving parameters sent to the flight controller. In the field experiments performed on the proposed hardware, the algorithm achieved a detection rate of 100% of the crop rows for images with resolutions above 320 × 240. The system performance was measured in laboratory experiments and reached 31.22 FPS for images with small resolution, 320 × 240, and 1.63 FPS for the highest resolution, 1920 × 1080. The main contribution of this work is the design and development of an entire embedded guidance system composed of a hardware and software architectures. Other contributions are: the proposed filter for the image pretreatment; the filter to remove the false positive lines; and the algorithm for generating the guiding parameters based on detected crop rows.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Valavanis, K.P.: Advances in unmanned aerial vehicles: state of the art and the road to autonomy, vol 33. Springer Science & Business Media (2008)

  2. Kanellakis, C., Nikolakopoulos, G.: Survey on computer vision for uavs: Current developments and trends. J. Intell. Robot. Syst. 87(1), 141–168 (2017). https://doi.org/10.1007/s10846-017-0483-z

    Article  Google Scholar 

  3. Puri, V., Nayyar, A., Raja, L.: Agriculture drones: A modern breakthrough in precision agriculture. J. Statist. Manag. Syst. 20(4), 507–518 (2017). https://doi.org/10.1080/09720510.2017.1395171

    Article  Google Scholar 

  4. Luo, H., Niu, Y., Zhu, M., Hu, X., Ma, H.: Optimization of pesticide spraying tasks via multi-uavs using genetic algorithm. Math. Probl. Eng., 2017 (2017)

    Google Scholar 

  5. Faiçal, BS, Pessin, G., Filho, G.P.R, Carvalho, A.C.P.L.F, Furquim, G., Ueyama, J.: Fine-tuning of uav control rules for spraying pesticides on crop fields. In: 2014 IEEE 26th International Conference on Tools with Artificial Intelligence, pp. 527–533. https://doi.org/10.1109/ICTAI.2014.85 (2014)

  6. Faiçal, B.S., Costa, F.G., Pessin, G., Ueyama, J., Freitas, H., Colombo, A., Fini, P.H., Villas, L., Osório, F.S., Vargas, P.A., Braun, T.: The use of unmanned aerial vehicles and wireless sensor networks for spraying pesticides. J. Syst. Archit. 60(4), 393–404 (2014). https://doi.org/10.1016/j.sysarc.2014.01.004. http://www.sciencedirect.com/science/article/pii/S1383762114000204

    Article  Google Scholar 

  7. Vidović, I., Cupec, R., Hocenski, Ž.: Crop row detection by global energy minimization. Pattern Recogn. 55, 68–86 (2016)

    Article  Google Scholar 

  8. Ji, R., Qi, L.: Crop-row detection algorithm based on random hough transformation. Math. Comput. Model. 54(3), 1016–1020 (2011)

    Article  Google Scholar 

  9. Jinlin, X., Weiping, J.: Vision-based guidance line detection in row crop fields. In: 2010 International Conference on Intelligent Computation Technology and Automation (ICICTA), vol. 3, pp. 1140–1143. IEEE (2010)

  10. Jiang, G., Wang, Z., Liu, H.: Automatic detection of crop rows based on multi-rois. Expert Syst. Appl. 42 (5), 2429–2441 (2015). https://doi.org/10.1016/j.eswa.2014.10.033. http://www.sciencedirect.com/science/article/pii/S0957417414006575

    Article  Google Scholar 

  11. Guerrero, J., Guijarro, M., Montalvo, M., Romeo, J., Emmi, L., Ribeiro, A., Pajares, G.: Automatic expert system based on images for accuracy crop row detection in maize fields. Expert Syst. Appl. 40(2), 656–664 (2013). https://doi.org/10.1016/j.eswa.2012.07.073. http://www.sciencedirect.com/science/article/pii/S0957417412009293

    Article  Google Scholar 

  12. Hough, P.: Method and means for recognizing complex patterns. https://www.google.com/patents/US3069654, uS Patent 3,069,654 (1962)

  13. García-Santillán, I.D., Montalvo, M., Guerrero, J.M., Pajares, G.: Automatic detection of curved and straight crop rows from images in maize fields. Biosyst. Eng. 156(Supplement C), 61–79 (2017). https://doi.org/10.1016/j.biosystemseng.2017.01.013. http://www.sciencedirect.com/science/article/pii/S1537511016301106

    Article  Google Scholar 

  14. Jiang, G.Q., Zhao, C.J., Si, Y.S.: A machine vision based crop rows detection for agricultural robots. In: 2010 International Conference on Wavelet Analysis and Pattern Recognition, pp.114–118. https://doi.org/10.1109/ICWAPR.2010.5576422 (2010)

  15. Gonzalez, R., Wintz, P.: Digital Image Processing. Addison-Wesley Publishing Co. Inc., Reading (1977)

    MATH  Google Scholar 

  16. Woebbecke, D., Meyer, G., Von Bargen, K., Mortensen, D., et al.: Color indices for weed identification under various soil, residue, and lighting conditions. Trans. ASAE-Amer. Soc. Agric. Eng. 38(1), 259–270 (1995)

    Article  Google Scholar 

  17. Jiang, G.Q., Zhao, C.J., Si, Y.S.: A machine vision based crop rows detection for agricultural robots. In: 2010 International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR). IEEE, pp. 114–118 (2010)

  18. Sobel, I., Feldman, G.: A 3 × 3 isotropic gradient operator for image processing. A talk at the Stanford Artificial Project in pp. 271–272 (1968)

  19. Duda, R.O., Hart, P.E.: Use of the hough transformation to detect lines and curves in pictures. Commun. ACM 15(1), 11–15 (1972)

    Article  Google Scholar 

  20. Cano, E., Horton, R., Liljegren, C., Bulanon, D.M.: Comparison of small unmanned aerial vehicles performance using image processing. J. Imag. 3(1), 4 (2017)

    Article  Google Scholar 

  21. Richardson, M., Wallace, S.: Getting Started with Raspberry PI. O’Reilly Media, Inc (2012)

  22. Mhatre, V., Chavan, S., Samuel, A., Patil, A., Chittimilla, A., Kumar, N.: Embedded video processing and data acquisition for unmanned aerial vehicle. In: 2015 International Conference on Computers, Communications, and Systems (ICCCS), pp. 141–145. https://doi.org/10.1109/CCOMS.2015.7562889 (2015)

  23. Kaehler, A., Bradski, G.: Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library. O’Reilly Media, Inc (2016)

  24. Meier, L., Camacho, J., Godbolt, B., Goppert, J., Heng, L., Lizarraga, M., et al.: Mavlink: Micro air vehicle communication protocol. Online Tillgänglig: http://qgroundcontrolorg/mavlink/start [Hämtad 2014-05-22] (2013)

  25. Van Weert, P., Gregoire, M.: C++ Standard Library Quick Reference. Apress (2016)

Download references

Acknowledgments

The authors would like to thank for the help of the technician staff at UFRGS that contributed to this project supporting the field trials. The authors thank Marcos Vizzotto for helping with the hardware assembling. Finally, the authors thank CAPES, CNPQ, and FAPERGS for the financial support to this project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maik Basso.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Basso, M., Pignaton de Freitas, E. A UAV Guidance System Using Crop Row Detection and Line Follower Algorithms. J Intell Robot Syst 97, 605–621 (2020). https://doi.org/10.1007/s10846-019-01006-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-019-01006-0

Keywords

Navigation