Abstract
Coffee is one of the most important agricultural products and consumed beverages in the world. Then, adequate control of the diseases is necessary to guarantee its production. Coffee rust is a relevant coffee disease, which is caused by the fungus hemileia vastatrix. Recently, deep learning techniques have been used to identify coffee diseases and the severity of each disease. In this paper, we propose a new interpretable transfer learning method to estimate the severity of coffee rust called CoffeeSE. The proposed method consists of four stages: Leaf segmentation, patch sampling, patch-based classification, and quantification/interpretation analysis. On the classification stage, a Brazilian dataset is used to transfer by fine-tuning new weights to a pre-trained classifier. So, this new classifier is tested in Peruvian coffee leaves infected with coffee rust. Our approach shows acceptable quantification results according to an expert agronomist. In addition, an interpretability module of the patch-classifier is proposed to provide a visual and textual explanation of the most relevant pixels used in the classification process.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alzubaidi, L., et al.: Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J. Big Data 8(1), 1–74 (2021). https://doi.org/10.1186/s40537-021-00444-8
Avelino, J., et al.: The coffee rust crises in Colombia and Central America (2008–2013): impacts, plausible causes and proposed solutions. Food Secur. 7, 303–321 (2015)
Berns, R.: Color and Spatial Vision, pp. 17–35. Wiley, March 2019
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)
Bridson, R.: Fast Poisson disk sampling in arbitrary dimensions. In: ACM SIGGRAPH 2007 Sketches on - SIGGRAPH 2007, pp. 22–32. ACM Press, San Diego (2007)
C., R., Kolmogorov, V., Blake, A.: “GrabCut”: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Chakraborty, S., et al.: Interpretability of deep learning models: a survey of results. In: 2017 IEEE SmartWorld, Ubiquitous Intelligence Computing, Advanced Trusted Computed, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation, pp. 1–6 (2017)
Danahy, E.E., Agaian, S.S., Panetta, K.A.: Algorithms for the resizing of binary and grayscale images using a logical transform. In: Astola, J.T., Egiazarian, K.O., Dougherty, E.R. (eds.) Image Processing: Algorithms and Systems V, vol. 6497, pp. 305–314. International Society for Optics and Photonics, SPIE (2007)
Deng, Y., Manjunath, B.S., Shin, H.: Color image segmentation. In: CVPR 1999, pp. 2446–2451 (1999)
Dimitriou, N., Arandjelović, O., Caie, P.D.: Deep learning for whole slide image analysis: an overview. Front. Med. 6, 264 (2019)
Doignon, C., Nageotte, F., de Mathelin, M.: Detection of grey regions in color images : application to the segmentation of a surgical instrument in robotized laparoscopy. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems 2004. (IROS 2004). Proceedings, vol. 4, pp. 3394–3399, September 2004
Esgario, J.G.M., Krohling, R.A., Ventura, J.A.: Deep learning for classification and severity estimation of coffee leaf biotic stress (2019)
Esgario, J.G., de Castro, P.B., Tassis, L.M., Krohling, R.A.: An app to assist farmers in the identification of diseases and pests of coffee leaves using deep learning. Inf. Process. Agric. (2021)
Esgario, J.G., Krohling, R.A., Ventura, J.A.: Deep learning for classification and severity estimation of coffee leaf biotic stress. Comput. Electron. Agric. 169, 105162 (2020)
Fuentes, A., Yoon, S., Kim, S., Park, D.: A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9), 2022 (2017)
Barbedo, J.G.A., et al.: Annotated plant pathology databases for image-based detection and recognition of diseases. IEEE Latin Am. Trans. 16(6), 1749–1757 (2018)
Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., Kagal, L.: Explaining explanations: an overview of interpretability of machine learning (2019)
Hartigan, J.A., Wong, M.A.: A k-means clustering algorithm. JSTOR Appl. Stat. 28(1), 100–108 (1979)
Hitimana, E., Gwun, O.: Automatic estimation of live coffee leaf infection based on image processing techniques. Comput. Sci. Inf. Technol. (CS IT) (2014). https://doi.org/10.5121/csit.2014.4221
Hooker, S., Erhan, D., Kindermans, P.J., Kim, B.: A benchmark for interpretability methods in deep neural networks (2019)
Jau, U.L., Teh, C.S., Ng, G.W.: A comparison of RGB and HSI color segmentation in real - time video images: a preliminary study on road sign detection. In: 2008 International Symposium on Information Technology, vol. 4, pp. 1–6 (2008)
Khattab, D., Ebied, H., Hussein, A., Tolba, M.: Color image segmentation based on different color space models using automatic GrabCut. Sci. World J. 2014, 126025 (2014)
Liu, B., Yin, C., Liu, Z., Zhang, Y.: Automatic segmentation on cell image fusing gray and gradient information. In: 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society 2007. EMBS 2007, pp. 5624–5627, August 2007
Luo, M.R.: CIELAB. In: Luo, R. (ed.) Encyclopedia of Color Science and Technology, pp. 1–7. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-27851-8_11-1
Manso, G.L., Knidel, H., Krohling, R.A., Ventura, J.A.: A smartphone application to detection and classification of coffee leaf miner and coffee leaf rust (2019)
Marcos, A., Rodovalho, N.L.S., Backes, A.: Coffee leaf rust detection using convolutional neural network. In: 2019 XV Workshop de Visão Computacional (WVC), pp. 38–42 (2019)
Plataniotis, K., Venetsanopoulos, A.: Color Image Processing and Applications. Digital Signal Processing. Springer, Heidelberg (2000). https://doi.org/10.1007/978-3-662-04186-4
Rahimzadeganasl, A., Sertel, E.: Automatic building detection based on CIE LUV color space using very high resolution pleiades images. In: 2017 25th Signal Processing and Communications Applications Conference (SIU), pp. 1–4 (2017)
Rahman, M., Islam, M.: Segmentation of color image using adaptive thresholding and masking with watershed algorithm. In: 2013 International Conference on Informatics, Electronics Vision (ICIEV), pp. 1–6, May 2013
Sammut, C., Webb, G.I.: Encyclopedia of Machine Learning, 1st edn. Springer, Boston (2011). https://doi.org/10.1007/978-0-387-30164-8
Sanchez-Lopez, J.R., Marin-Hernandez, A., Palacios-Hernandez, E.R., Rios-Figueroa, H.V., Marin-Urias, L.F.: A real-time 3D pose based visual servoing implementation for an autonomous mobile robot manipulator. Procedia Technol. 7(0), 416–423 (2013). 3rd Iberoamerican Conference on Electronics Engineering and Computer Science, CIIECC 2013
Smilkov, D., Thorat, N., Kim, B., Viégas, F., Wattenberg, M.: SmoothGrad: removing noise by adding noise. arXiv, June 2017
Soares, J.V.B., Jacobs, D.W.: Efficient segmentation of leaves in semi-controlled conditions. Mach. Vis. Appl. 24(8), 1623–1643 (2013). https://doi.org/10.1007/s00138-013-0530-0
Sørenson, T.: A Method of Establishing Groups of Equal Amplitude in Plant Sociology Based on Similarity of Species Content and Its Application to Analyses of the Vegetation on Danish Commons. Biologiske skrifter, I kommission hos E. Munksgaard (1948)
Suhartono, D., Aditya, W., Lestari, M., Yasin, M.: Expert system in detecting coffee plant diseases. Int. J. Electr. Energy 156–162 (2013)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2818–2826 (2016)
Talhinhas, P., et al.: The coffee leaf rust pathogen Hemileia vastatrix: one and a half centuries around the tropics. Mol. Plant Pathol. 18(8), 1039–1051 (2017)
Vezina, M., Ziou, D., Kerouh, F.: Color space identification for image display. In: Kamel, M., Campilho, A. (eds.) ICIAR 2015. LNCS, vol. 9164, pp. 465–472. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20801-5_51
Wang, X., Hänsch, R., Ma, L., Hellwich, O.: Comparison of different color spaces for image segmentation using graph-cut. In: 2014 International Conference on Computer Vision Theory and Applications (VISAPP), vol. 1, pp. 301–308 (2014)
Yamashita, R., Nishio, M., Do, R.K.G., Togashi, K.: Convolutional neural networks: an overview and application in radiology. Insights Imaging 9(4), 611–629 (2018). https://doi.org/10.1007/s13244-018-0639-9
Yebasse, M., Shimelis, B., Warku, H., Ko, J., Cheoi, K.J.: Coffee disease visualization and classification. Plants 10(6), 1257 (2021)
Zhuang, F., et al.: A comprehensive survey on transfer learning. CoRR abs/1911.02685 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Incahuanaco-Quispe, F., Hinojosa-Cardenas, E., Pilares-Figueroa, D., Beltrán-Castañón, C.A. (2022). CoffeeSE: Interpretable Transfer Learning Method for Estimating the Severity of Coffee Rust. In: Lossio-Ventura, J.A., et al. Information Management and Big Data. SIMBig 2021. Communications in Computer and Information Science, vol 1577. Springer, Cham. https://doi.org/10.1007/978-3-031-04447-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-031-04447-2_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-04446-5
Online ISBN: 978-3-031-04447-2
eBook Packages: Computer ScienceComputer Science (R0)