Skip to main content
SpringerLink
Log in

Crop growth stage estimation prior to canopy closure using deep learning algorithms

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Growth stage determination plays an important role in yield prediction and cereal husbandry decision-making. Conventionally, crop growth stage determination is performed manually by means of visual inspection. This paper investigates wheat and barley growth stage estimation by classification of proximal images using convolutional neural networks (ConvNets). A dataset consisting of 138,000 images captured prior to the crop canopy closure stage was acquired from 4 sites (7 different fields) in Ireland. The dataset includes images of 12 growth stages of wheat and 11 growth stages of barley captured for a number of crop varieties, seed rates and brightness levels. A camera was held at 2 m from the ground and two camera poses were used—downward-looking and declined to \(45^\circ\) below the horizon. Classification was carried out using three different machine learning approaches: (1) a 5-layer ConvNet model, including three convolutional layers, which was trained from scratch on our crop dataset; (2) transfer learning based on a VGG19 network pre-trained on ImageNet with an additional four fully connected layers, and (3) a support vector machine with conventional feature extraction. The classification accuracies of the aforementioned models were found to be (1) 91.1–94.2% for the ConvNet model, (2) 99.7–100% for the transfer learning model and (3) 63.6–65.1% for the SVM. For both crops, the best accuracy was obtained using the \(45^\circ\) camera pose and the transfer learning ConvNet model. For the growth stage classification task, the transfer learning ConvNet has the advantage of significantly reduced training time when compared with the built-from-scratch ConvNet model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. The fields are reported by number in this paper (Tables 1 and 2) and the exact location of each field is available upon request.

References

  1. Agarap AF (2018) Deep learning using rectified linear units (relu). arXiv preprint arXiv:1803.08375

  2. Agriculture (2018) H.D.B.: wheat growth guide, pp 1–42. https://horticulture.ahdb.org.uk/

  3. Al-Ameen Z, Sulong G, Johar MGM, Verma N, Kumar R, Dachyar M, Alkhawlani M, Mohsen A, Singh H, Singh S et al (2012) A comprehensive study on fast image deblurring techniques. Int J Adv Sci Technol 4:4

    Google Scholar 

  4. Ata-Ul-Karim ST, Liu X, Lu Z, Yuan Z, Zhu Y, Cao W (2016) In-season estimation of rice grain yield using critical nitrogen dilution curve. Field Crops Res 195:1–8

    Article  Google Scholar 

  5. Bansal R, Raj G, Choudhury T (2016) Blur image detection using Laplacian operator and open-cv. In: 2016 international conference system modeling and advancement in research trends (SMART). IEEE, pp 63–67

  6. Burges CJ (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Discov 2(2):121–167

    Article  Google Scholar 

  7. de Jesús Rubio J (2009) Sofmls: online self-organizing fuzzy modified least-squares network. IEEE Trans Fuzzy Syst 17(6):1296–1309

    Article  Google Scholar 

  8. de Jesús Rubio J (2017) Usnfis: uniform stable neuro fuzzy inference system. Neurocomputing 262:57–66

    Article  Google Scholar 

  9. de Jesus Rubio J, Pan Y, Lughofer E, Chen MY, Qiu J (2019) Fast learning of neural networks with application to big data processes. Neurocomputing 390:294–296

    Article  Google Scholar 

  10. Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255

  11. Dyrmann M, Karstoft H, Midtiby HS (2016) Plant species classification using deep convolutional neural network. Biosyst Eng 151:72–80

    Article  Google Scholar 

  12. Feng D, Xu W, He Z, Zhao W, Yang M (2019) Advances in plant nutrition diagnosis based on remote sensing and computer application. Neural Comput Appl. https://doi.org/10.1007/s00521-018-3932-0

    Article  Google Scholar 

  13. Ford A, Roberts A (1998) Colour space conversions. Westminster University, London, pp 1–31

    Google Scholar 

  14. Glorot X, Bordes A, Bengio Y (2011) Deep sparse rectifier neural networks. In: Proceedings of the fourteenth international conference on artificial intelligence and statistics, pp 315–323

  15. Grinblat GL, Uzal LC, Larese MG, Granitto PM (2016) Deep learning for plant identification using vein morphological patterns. Comput Electron Agric 127:418–424

    Article  Google Scholar 

  16. Hunt ER, Hively WD, Fujikawa S, Linden D, Daughtry CS, McCarty G (2010) Acquisition of nir-green-blue digital photographs from unmanned aircraft for crop monitoring. Remote Sens 2(1):290–305

    Article  Google Scholar 

  17. Jolliffe I (2011) Principal component analysis. Springer, Berlin

    MATH  Google Scholar 

  18. Kaya A, Keceli AS, Catal C, Yalic HY, Temucin H, Tekinerdogan B (2019) Analysis of transfer learning for deep neural network based plant classification models. Comput Electron Agric 158:20–29

    Article  Google Scholar 

  19. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  20. Larese MG, Namías R, Craviotto RM, Arango MR, Gallo C, Granitto PM (2014) Automatic classification of legumes using leaf vein image features. Pattern Recognit 47(1):158–168

    Article  Google Scholar 

  21. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436

    Article  Google Scholar 

  22. Lee SH, Chan CS, Mayo SJ, Remagnino P (2017) How deep learning extracts and learns leaf features for plant classification. Pattern Recognit 71:1–13

    Article  Google Scholar 

  23. Luo Y, Tang X (2008) Photo and video quality evaluation: focusing on the subject. In: European conference on computer vision. Springer, pp 386–399

  24. Mahmoodi S, Rahimi A (2009) Estimation of critical period for weed control in corn in Iran. World Acad Sci Eng Technol 49:67–72

    Google Scholar 

  25. Meda-Campaña JA (2018) On the estimation and control of nonlinear systems with parametric uncertainties and noisy outputs. IEEE Access 6:31968–31973

    Article  Google Scholar 

  26. Meier U (1997) Growth stages of mono- and dicotyledonous plants. Blackwell Wissenschafts-Verlag, Berlin

    Google Scholar 

  27. Meyer GE, Hindman TW, Laksmi K (1999) Machine vision detection parameters for plant species identification. In: Precision agriculture and biological quality, vol 3543, Int. Society for Optics and Photonics, pp 327–336

  28. Quan L, Feng H, Lv Y, Wang Q, Zhang C, Liu J, Yuan Z (2019) Maize seedling detection under different growth stages and complex field environments based on an improved faster r-cnn. Biosyst Eng 184:1–23

    Article  Google Scholar 

  29. Sadeghi-Tehran P, Sabermanesh K, Virlet N, Hawkesford MJ (2017) Automated method to determine two critical growth stages of wheat: heading and flowering. Front Plant Sci 8:252

    Article  Google Scholar 

  30. Sekizawa H, Yamamoto N, Kawakami H, Saito T (1994) Brightness referenced color image correcting apparatus. US Patent 5,278,641

  31. Shin HC, Roth HR, Gao M, Lu L, Xu Z, Nogues I, Yao J, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298

    Article  Google Scholar 

  32. Sibi P, Jones SA, Siddarth P (2013) Analysis of different activation functions using back propagation neural networks. J Theor Appl Inf Technol 47(3):1264–1268

    Google Scholar 

  33. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. ArXiv Preprint arXiv:1409.1556

  34. Soltani A, Galeshi S (2002) Importance of rapid canopy closure for wheat production in a temperate sub-humid environment: experimentation and simulation. Field Crops Res 77(1):17–30

    Article  Google Scholar 

  35. Srbinovska M, Gavrovski C, Dimcev V, Krkoleva A, Borozan V (2015) Environmental parameters monitoring in precision agriculture using wireless sensor networks. J Clean Prod 88:297–307

    Article  Google Scholar 

  36. Subramanian V, Burks TF, Arroyo A (2006) Development of machine vision and laser radar based autonomous vehicle guidance systems for citrus grove navigation. Comput Electron Agric 53(2):130–143

    Article  Google Scholar 

  37. Thomas W (2014) The value of decimal cereal growth stages. Ann Appl Biol 165(3):303–304

    Article  Google Scholar 

  38. Ting KM (2017) Confusion matrix. Encyclopedia of machine learning and data mining, pp 260–260

  39. Tokekar P, Vander Hook J, Mulla D, Isler V (2016) Sensor planning for a symbiotic uav and ugv system for precision agriculture. IEEE Trans Robot 32(6):1498–1511

    Article  Google Scholar 

  40. Wang J, Chen L, Zhang J, Yuan Y, Li M, Zeng W (2018) Cnn transfer learning for automatic image-based classification of crop disease. In: Chinese conference on image and graphics technologies. Springer, pp 319–329

  41. Wang L (2005) Support vector machines: theory and applications, vol 177. Springer, Berlin

    Book  Google Scholar 

  42. Xue J, Zhang L, Grift TE (2012) Variable field-of-view machine vision based row guidance of an agricultural robot. Comput Electron Agric 84:85–91

    Article  Google Scholar 

  43. Yalcin H, Razavi S (2016) Plant classification using convolutional neural networks. In: 2016 Fifth international conference on agro-geoinformatics (agro-geoinformatics). IEEE, pp 1–5

  44. Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems, pp 3320–3328

  45. Yu Z, Cao Z, Wu X, Bai X, Qin Y, Zhuo W, Xiao Y, Zhang X, Xue H (2013) Automatic image-based detection technology for two critical growth stages of maize: emergence and three-leaf stage. Agric For Meteorol 174:65–84

    Article  Google Scholar 

  46. Yudhana A, Umar R, Ayudewi FM (2019) The monitoring of corn sprouts growth using the region growing methods. In: Journal of Physics: conference series, vol 1373, IOP Publishing, p 012054

  47. Zadoks JC, Chang TT, Konzak CF (1974) A decimal code for the growth stages of cereals. Weed Res 14(6):415–421

    Article  Google Scholar 

  48. Zainuddin Z, Manjang S, Wijaya AS, et al. (2019) Rice farming age detection use drone based on svm histogram image classification. In: Journal of Physics: conference series, vol 1198. IOP Publishing, p 092001

  49. Zhang N, Wang M, Wang N (2002) Precision agriculture—a worldwide overview. Comput Electron Agric 36(2–3):113–132

    Article  Google Scholar 

  50. Zhao S, Zheng H, Chi M, Chai X, Liu Y (2019) Rapid yield prediction in paddy fields based on 2d image modelling of rice panicles. Comput Electron Agric 162:759–766

    Article  Google Scholar 

Download references

Acknowledgements

This research forms part of the CONSUS program which is funded under the Science Foundation Ireland Strategic Partnerships Program (16/SPP/3296) and is co-funded by Origin Enterprises Plc. The authors would like to thank Lyons Research Field of UCD, Irish farmers in County Louth: J., P. and T. McGuiness, B. Lynch and P. O’Grady in Newbridge, Kildare, for their kind co-operation during the data collection and also providing us with the metadata for the fields.

Author information

Authors and Affiliations

  1. School of Computer Science, UCD, Dublin, Ireland

    Sanaz Rasti, Chris J. Bleakley, Guénolé C. M. Silvestre & Gregory M. P. O’Hare

  2. School of Biosystems and Food Engineering, UCD, Dublin, Ireland

    N. M. Holden

  3. Origin Enterprises plc, Dublin, Ireland

    David Langton

Authors
  1. Sanaz Rasti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chris J. Bleakley
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guénolé C. M. Silvestre
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. N. M. Holden
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. David Langton
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Gregory M. P. O’Hare
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanaz Rasti.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest regarding the publication of this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rasti, S., Bleakley, C.J., Silvestre, G.C.M. et al. Crop growth stage estimation prior to canopy closure using deep learning algorithms. Neural Comput & Applic 33, 1733–1743 (2021). https://doi.org/10.1007/s00521-020-05064-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05064-6

Keywords

Search

Navigation