Abstract
The accuracy of crop rows line extraction is the key to the automatic navigation of agricultural machinery. In the paper, an improved algorithm is proposed to solve the problem of poor connectivity, single pixel and redundant pixels. Firstly, image pre-processing operations is used in order to obtain a binary image, then the binary image is thinned. In the refinement process, the connectivity of the skeleton is maintained by the introduction of Euclidean distance. Experimental results show that the proposed method has good adaptability to the row crop, and the skeleton lines that are extracted is more accurate. Compared with the traditional algorithms, the error of the navigation line is relatively small by using this algorithm, which could meet the needs of the practical application.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Agricultural machine vision navigation plays a key role in automatic picking, irrigation, fertilization and visual navigation is the basis of crop recognition. Precision pesticide technology is a mainstream trend in the development of modern precision agriculture. Its main idea is using an image acquisition device to analyze and process these images. Then a series of processes were used to extract the navigation line of crop to control agricultural machinery for walking.
In the early 20th century, Marchant and Brivot Silsoe research center [1] and the Swedish expert Astrand and Baerveldt [2] had made a contribution to vision navigation algorithm research respectively and achieved some results. Ollis and Stentz [3] used color camera to obtain the field map of crops and the edge of the harvest crop is extracted. Søgaard and Olsen [4] proposed a algorithm with respect to the extraction of crop line based on the Hough transform. Kaizua and Imoub [5] extracted the characteristics of seedling through analysing the spectral characteristics of seedling and the extraction of seedling target line was achieved. In recent years, the domestic also appeared a lot of researches in this aspect. Zhibin et al. [6, 7] who had combined Hough transform and Fisher criterion overcame the insufficiency of the traditional Hough transform and made a model of multiple ridge line. Luo et al. [8] set up a mobile platform for agricultural intelligent operation. Zhao et al. [9] put forward a kind of improvement algorithm based on vertical histogram projection and combined the projection and Hough transform method to detect crop rows. Although these algorithms are valuable, the application of precision pesticide machinery is difficult to achieve because of poor adaptability.
The improved super green algorithm was used greatly reduce the effect of noise. Hough transform reduced the operation time and improved the accuracy. At the same time, an experimental platform was built to conduct different images and a good reconstructions result was obtained, which had good adaptation and accuracy and satisfied the needs of practical application.
2 Segmentation of Crop Rows
2.1 Acquisition of Crop Rows Image
The rows of chinese chives were taked as research object in the experiment. The model of industrial digital camera is MV-VD030SM/SC that was produced by Shanxi Dimensional Image Technology Co., LTD and the model of industrial lens is AFT-0641MP that was produced by AI Feite Photoelectric Technology Co., LTD, which was used to acquire leek images. The output was 8 bit RGB color images. The original image of chinese chives was shown in Fig. 1.
2.2 Gray Processing
Leek images usually contain much color information. It was found that these color information was not wery well for the following process. However, RGB color image was converted to grayscale image had more advantages than using color information processing. Gray processing is the basis of image analysis. The image of leek crop rows taken in farmland had obvious characteristics of green (as shown in Fig. 1). In other words, the G component was higher than the soil background. In order to distinguish crop rows and background better, the traditional super green gray algorithm (2G-R-B) [10] was used to process this image and the effect was shown in Fig. 2a. It was seen that the background noise of the traditional super green gray algorithm was obvious from Fig. 2a, which is not conducive to the follow processing. Therefore, the super green gray algorithm was improved. The improved super green algorithm was as below:
From Fig. 2b, it could be seen that the background noise of chinese chives crop rows were greatly reduced and the crop lines profile were also obvious.
2.3 Filtering Denoising
The crop rows after gray processing were still exist noise. In order to get the target of low noise, the grayscale image need to further denoise. The method of combining 3 × 3 Gaussian template and 3 × 3 median filter window was used to filter operation. The image after two filtering times was shown in Fig. 3. After filtering, crop rows had been separated clearly.
2.4 Two Value Processing
In order to further extract the row target, the image was processed by two value operation. The two main methods of two value had threshold and the biggest variance. The threshold of threshold method was determined according to experiment and experience, but the brightness of different pictures or the same picture were different, which made the application of the method inconvenient. In order to extract the target region, OTSU algorithm was used to process the image automatically. In addition, it was not disturbed by the brightness information and had good treatment result. The binary image was shown in Fig. 4.
3 The Detection of Crop Rows
3.1 Morphological Processing
As there were still many small noise in the crop row image after binarization processing. These noise that was compared with the crop row area was small, so morphological algorithm was used to remove these noise. The main morphological method is erosion and dilation. The crop rows towarded its center gradually and removed the holes that was smaller than structural element by erosion. While, the dilation had the opposite effect, which could filled the void and increased crop line width. In order not to change and eliminate the useful information of crop row, the morphological processing template that would be used must be appropriate. The structure elements of 3*3 template was used in this paper. The times was determined by experiment. The Chinese chives lines contour were shown in Fig. 5.
3.2 The Skeleton Extraction of Crop Rows
As the navigation path [11–15] is a linear structure, the skeleton of crop rows should be single pixel width. The outline image after morphological processing could not meet the requirements of machine vision navigation line. Then in order to extract the skeleton information of crop row, thinning algorithm was used(as shown in Fig. 6a). At the same time, the crop rows that were most closely to the center were remained and the redundant skeleton lines was removed to reduce calculation and increase accuracy. The extracted result of the central crop rows was shown in Fig. 6b.
3.3 Trunk Line Fitting
The skeleton of central crop rows does not reflect the navigation line. In precision spraying, the skeleton line should be fitted a straight line to realize path planning [16]. The random hough transform [17] was used to fit the crop rows in this paper. The traditional hough transform put the data points of image space map into the parameter space. This was a dispersed mapping of one to many. The random Hough transform improved the velocity of calculation. The result was shown in Fig. 7.
3.4 The Effect of Extraction of Other Images
In order to verify the algorithm that had been proposed in this paper has a good adaptability to the chinese chives crop rows, the corn crop rows were also carried out the same behavior. The results were shown in Fig. 8. From the figure, it can be seen that the goal lines of the corn crop rows can be extracted clearly, and the skeleton contain less redundant branches. It provided a basis for the analysis of precision pesticide system.
3.5 Deviation Calculation
The deviation that is compared by center line of crop rows after fitting and the actual crop lines was the key technology of precision spraying. In this paper, the deviation of the above two kinds of crop rows were analysed, and it was shown in Table 1. From Table 1, we can see that the algorithm could meet the demand of precision spraying technology in the field.
4 Conclusions
-
(1)
The method of gray processing was improved for background segmentation, which had better result and adaptability than before. The median filtering algorithm could reduce the noise effectively.
-
(2)
In this paper, the morphological processing and thinning on binary image were used. The navigation offset was got according to deviation and position information and realized the automatic navigation of agricultural machinery.
-
(3)
The information of corresponding deviation that was got through experiment proved that this method had improved accuracy and adaptability greatly, which achieved desired results on chinese chives. It had certain reference value to the follow-up study.
References
Marchant, J.A., Brivot, R.: Real time tracking of plan trows using a Hough transform. Real Time Imag. 1(5), 363–371 (1995)
Astrand, B., Baerveldt, A.-J.: A vision based row-following system for agricultural field machinery. Mechatronics 15(2), 251–269 (2005)
Ollis, M., Stentz, A.: First result in vision-based crop line tracking. In: Proceedings of the 1996 IEEE Conference on Robotics and Automation (ICRA 1996), Minneapolis, MN, pp. 951–956 (1996)
Søgaard, H.T., Olsen, H.J.: Determination of crop rows by image analysis without segmentation. Comput. Electron. Agric. 38(2), 141–158 (2003)
Kaizua, Y., Imoub, K.: A dual-spectral camera system for paddy rice seedling row detection. Comput. Electron. Agric. 63(1), 49–56 (2008)
Zhang, Z., Luo, X., Zhou, X., et al.: Crop rows detection based on hough transform and fisher discriminant criterion function. J. Image Graph. 12(12), 2164–2168 (2007)
Zhang, Z., Luo, X., Li, Q., et al.: New algorithm for machine vision navigation of farm machine based on well-ordered set and crop row structure. Trans. Chin. Soc. Agric. Eng. (Trans. CSAE) 23(7), 122–126 (2007)
Luo, X., Ou, Y., Zhao, Z., et al.: Research and development of intelligent flexible chassis for precision farming. Trans. Chin. Soc. Agric. Eng. (Trans. CSAE) 21(2), 83–85 (2005)
Zhao, R., Li, M., et al.: Rapid crop-row detection based on improved hough transformation. Trans. Chin. Soc. Agric. Mach. 40(7), 163–165, 221 (2009)
Zhang, L., Wang, S., Chen, B., et al.: Crop-edge detection based on machine vision. New Zealand J. Agric. Res. 50(5), 1367–1374 (2007)
Nirmal Singh, N., Chatterjee, A., Chatterjee, A., et al.: A two-layered subgoal based mobile robot navigation algorithm with vision system and IR sensor. Measurement 44(5), 620–641 (2011)
Xue, J., Zhang, L., Grift, T.E.: Variable field-of-view machine vision based row guidance of an agricultural robot. Comput. Electron. Agric. 84, 85–91 (2012)
Ji, R., Qi, L.: Crop-row detection algorithm based on random hough transformation. Math. Comput. Model. 54(3–4), 1016–1020 (2011)
Jiang, H., Xiao, Y., Zhang, Y., et al.: Curve path detection of unstructured roads for the outdoor robot navigation. Math. Comput. Model. 58(3–4), 536–544 (2013)
Huang, K.-Y.: Detection and classification of areca nuts with machine vision. Comput. Math. Appl. 64(5), 739–746 (2012)
Ahmed, F., Al-Mamun, H.A., Hossain Bari, A.S.M., et al.: Classification of crops and weeds from digital images: a support vector machine approach. Crop Prot. 40(10), 98–104 (2012)
Ji, J., Chen, G., Sun, L.: A novel Hough transform method for line detection by enhancing accumulator array. Pattern Recogn. Lett. 32(11), 1503–1510 (2011)
Acknowledgments
This work was financially supported by the open fund project of NERCITA (KFZN2012W12-012), Zhengzhou Municipal Science and Technology Bureau project (131PPTGG411-13), and backbone teacher plan project of Zhengzhou University of Light Industry, Science and Technology Innovation Fund Project of Zhengzhou University of Light Industry graduate student (2014003).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 IFIP International Federation for Information Processing
About this paper
Cite this paper
Diao, Z., Wu, B., Wei, Y., Wu, Y. (2016). The Extraction Algorithm of Crop Rows Line Based on Machine Vision. In: Li, D., Li, Z. (eds) Computer and Computing Technologies in Agriculture IX. CCTA 2015. IFIP Advances in Information and Communication Technology, vol 478. Springer, Cham. https://doi.org/10.1007/978-3-319-48357-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-48357-3_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48356-6
Online ISBN: 978-3-319-48357-3
eBook Packages: Computer ScienceComputer Science (R0)