Abstract
The utilization of Artificial Intelligence (AI) and Machine Learning(ML) in the image processing domain is useful to detect and recognize the types of soil. The main aim of the present work is to process the soil images and classify them accurately by using Tensorflow and Keras Deep Learning (DL) frameworks with pre-trained weights. There are several ML models already implemented for the classification of soil images. A dataset has 903 soil images of four different types of soil (alluvial, black, clay, and red). These images were divided into a training dataset and a validation dataset. The image augmentation process was applied to the dataset, and then the models are trained with these augmented images. In the present work, the Convolutional Neural Network (CNN) model was implemented to classify the soil images and achieved an accuracy of 99.86% for training and 97.68% for validation. Furthermore, six Deep Convolution Neural Network (DCNN) models were implemented, such as Rsnet152V2, VGG-16, VGG-19, Inception-ResNetV2, Xception, and DenseNet201, to classify the soil images. The accuracy of a Rsnet152V2, VGG-16, VGG-19, Inception-ResNetV2, Xception, and Densnet201 DCNN models were 99.15%, 97.58%, 98.44%, 98.15%, 98.86%, and 98.58%, respectively. The performance of CNN and DCNN models was evaluated using a confusion matrix and K-fold technique. The proposed CNN model has outperformed the DCNN models, and also literature reported works.
Similar content being viewed by others
References
Alemi A (2016) Improving Inception and Image Classification in TensorFlow. https://ai.googleblog.com/2016/08/improving-inception-and-image.html
Alom MZ, Hasan M, Yakopcic C, Taha TM, Asari VK (2021) Inception recurrent convolutional neural network for object recognition. Mach Vis Appl 32:28. https://doi.org/10.1007/s00138-020-01157-3
Anguraj DK, Mandhala VN, Bhattacharyya D, Kim TH (2021) Hybrid neural network classification for irrigation control in WSN based precision agriculture. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02704-6
Athanasios V, Nikolaos D, Anastasios D, Eftychios P (2018) Deep learning for computer vision: a brief review. Computational Intelligence and Neuroscience Article ID 7068349. https://doi.org/10.1155/2018/7068349
Azizi A, Gilandeh YA, Tarahom MG, Saleh-Bigdeli AA, Moghaddam HA (2020) Classification of soil aggregates: a novel approach based on deep learning. Soil Tillage Res 199:104586
Babenko A, Slesarev A, Chigorin A, Lempitsky V (2014) Neural codes for image retrieval. In: European conference on computer vision. Springer, Cham, pp 584–599
Behrens T, Schmidt K, MacMillan RA et al (2018)Multi-scale digital soil mapping with deep learning. Sci Rep 8:15244. https://doi.org/10.1038/s41598-018-33516-6
Bhattacharya B, Solomatine DP (2006) Machine learning in soil classification. Neural Netw 19(2):186–195
Cavallaro G, Riedel M, Bodenstein C et al (2015) Scalable developments for big data analytics in remote sensing. IEEE International Geoscience and Remote Sensing Symposium (IGARSS) pp 2015:1366–1369
Chandan RT (2018) An intelligent model for Indian soil classification using various machine learning techniques. International Journal of Computational Engineering Research (IJCER) 33:2250–3005
Choudhury RD, Barman U (2020) Soil texture classification using multi class support vector machine. Information Processing in Agriculture 7(2):318–332
Christian S, Sergey I, Vincent V, Alex A (2016) Inception-v4, inception-ResNet and the impact of residual connections on learning. Computer Vision and Pattern Recognition arXiv 1602:07261
Chu J, Guo Z, Leng L (2018) Object detection based on multi-layer convolution feature fusion and online hard example mining. IEEE Access 6:19959–19967
Chung SO, Cho KH, Cho JW, Jung KY, Yamakawa T (2012) Soil texture classification algorithm using rgb characteristics of soil images. J Fac Agr Kyushuuniv 57(2):393–397
Doulamis A, Doulamis N, Maragos P (2001) Generalized multiscale connected operators with applications to granulometric image analysis. In: Proceedings 2001 international conference on image processing (cat. No.01CH37205), vol 3, pp 684–687. https://doi.org/10.1109/ICIP.2001.958211
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Computer Electronics Agriculture 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009
Foody GM, Mathur A, Sanchez-Hernandez C, Boyd DS (2006) Training set size requirements for the classification of a specific class. Remote Sens Environ 1:1–14
Franc O (2017) Xception: deep learning with depth wise separable convolutions. Computer vision foundation Google Inc IEEE Xplore
Gu J, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J, Chen T (2018) Recent advances in convolutional neural networks. Pattern Recogn 77:354–377
Guan Q, Wang Y, Ping B, Li D, du J, Qin Y, Lu H, Wan X, Xiang J (2019) Deep convolutional neural network VGG-16 model for differential diagnosing of papillary thyroid carcinomas in cytological images: a pilot study. J Cancer 10:4876–4882
Guang Y, Shujun Q, Pengfei C (2015) Rock and soil classification using PLS-DA and SVM combined with a laser-induced breakdown spectroscopy library. Plasma SciTechnol 17(8):656–663
He K et al (2016) Identity mappings in deep residual networks. In: EuropeanConference on Computer Vision. Springer
He K et al (2016) Deep residual learning for image recognition. In: Proceedingsof the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778. https://doi.org/10.1109/CVPR.2016.90
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Las Vegas NV, pp 770–778
Honawad SK, Chinchali SS, Pawar K, Deshpande P (2017) Soil classification and suitable crop prediction. 4IOSR Journal of Computer Engineering (IOSR-JCE):25–29
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the 2017 IEEE conference on computer vision and pattern recognition (CVPR) Honolulu HI USA 21–26, pp 2261–2269
Hussain M (2020) What is rectified linear unit (ReLU)?. Introduction to ReLU Activation Function. https://www.mygreatlearning.com/blog/relu-activation-function/
Javaheri SH, Teimourpour B (2014) Response modeling in direct marketing, in Data Mining Applications with R. https://doi.org/10.1016/B978-0-12-411511-8.00006-2
Kestrilia RP, Syaiful A, Tatas HPB, Agus S (2020)Real-time assessment of plant photosynthetic pigment contentswith an artificial intelligence approach in a mobile application. Journal of Agricultural Engineering LI:1082
Kiattisin S (2021) Machine learning techniques for classifying the sweetness of watermelon using acoustic signal and image processing. Comput Electron Agric 181:105938
Kumar V, Balakrishnan N (2021) Artificial intelligence-based agriculture automated monitoring systems using WSN. J Ambient Intell Human Comput. 12:8009–8016. https://doi.org/10.1007/s12652-020-02530-w
Lameck O, Odhiambo RS, Freeland RE, Yoder J, Wesley H (2002) Application of fuzzy-neural network in classification of soils using ground-penetrating radar imagery. In: 2002 ASAE annual international meeting/ CIGR XVth world congress
Lu Y, Perez D, Dao M, Kwan C, Li J (2018) Deep learning with synthetic hyperspectral images for improved soil detection in multispectral imagery. In: 2018 9th IEEE annual ubiquitous computing, Electronics & Mobile Communication Conference (UEMCON), pp 666–672. https://doi.org/10.1109/UEMCON.2018.8796838
Mengistu AD, Alemayehu DM (2018) Soil characterization and classification: a hybrid approach of computer vision and sensor network. Int J Electr Comput Eng 8(2):989–995
Mohapatra H, Rath AK (2021) IoE based framework for smart agriculture. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-021-02908-4
Nguyen L, Lin D, Lin Z, Cao J (2018) Deep CNNs for microscopic image classification by exploiting transfer learning and feature concatenation. In: 2018 IEEE International Symposium on Circuits and Systems (ISCAS), pp 1–5. https://doi.org/10.1109/ISCAS.2018.8351550
Online Article, Top 6 Indian AgriTech startups that are Revolutionising Agriculture (2018). https://analyticsindiamag.com/top-6-indian-agritech-startups-that-are-revolutionising-agriculture/
Online Article (n.d.) Machine Learning In Agriculture: How Ai Helps Solve The Industry's Most Pressing Challenges. https://objectcomputing.com/expertise/machine-learning/machine-learning-in-agriculture
Online Article (n.d.) https://www.mathworks.com/help/physmod/simscape/ug/estimate-computation-costs.html
Online Article Salty Soils. (n.d.) http://www.fao.org/3/r4082e/r4082e08.htm
Pan Y, Pi D, Khan I et al (2021) DenseNetFuse: a study of deep unsupervised DenseNet to infrared and visual image fusion. J Ambient Intell Human Comput. 12:10339–10351. https://doi.org/10.1007/s12652-020-02820-3
Pannu HS, Ahuja S, Dang N, Soni S, Malhi AK (2020) Deep learning based image classification for intestinal hemorrhage. Multimed Tools Appl 79:21941–21966. https://doi.org/10.1007/s11042-020-08905-7
Parab J, Sequeira M, Lanjewar M, Pinto C, Naik G (2021) Backpropagation neural network-based machine learning model for prediction of blood urea and glucose in CKD patients. IEEE Journal of Translational Engineering in Health and Medicine 9:1–8 Art no. 4900608. https://doi.org/10.1109/JTEHM.2021.3079714
Patil N, Patil PN, Rao PV (2021) Convolution neural network and deep-belief network (DBN) based automatic detection and diagnosis of Glaucoma. Multimed Tools Appl 80:29481–29495. https://doi.org/10.1007/s11042-021-11087-5
Ramezan CA, Warner TA, Maxwell AE, Price BS (2021) Effects of training set size on supervised machine-learning land-cover classification of large-area high-resolution remotely sensed data. Remote Sens 13(3):368. https://doi.org/10.3390/rs13030368
Rao A, Abhishek JU, Manjunatha GNS, Beham R (2016) Machine learn soil classification. Crop Detect 4:792–794
Sanjay M (2018) Why and how to Cross Validate a Model? Importance and types of Cross validation techniques. https://towardsdatascience.com/why-and-how-to-cross-validate-a-model-d6424b45261f
Santos L, Santos FN, Oliveira PM, Shinde P (2020) Deep Learning Applications in Agriculture: A Short Review. In: Silva M, Luís LJ, Reis L, Sanfeliu A, Tardioli D (eds) Robot 2019: Fourth Iberian Robotics Conference. ROBOT 2019. Advances in intelligent systems and computing, vol 1092. Springer, Cham. https://doi.org/10.1007/978-3-030-35990-4_12
Shenbagavalli R, Ramar K (2011) Classification of soil textures based on Law’s features extracted from preprocessing images on sequential and random windows. Bonfring Int J Adv Image Process 1(1):15–15
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
Srivastava P, Shukla A, Bansal A (2021) A comprehensive review on soil classification using deep learning and computer vision techniques. Multimed Tools Appl 80:14887–14914. https://doi.org/10.1007/s11042-021-10544-5
Srunitha K, Padmavathi S (2016) Performance of SVM classifier for image based soil classification. In: Int. Conf. on signal processing, communication, power and embedded system. SCOPES, pp 411–415
Szegedy C, Liu W, Jia Y, Sermanet P et al (2015) Going deeper with convolutions. In: Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit, pp 1–9
Szegedy C, Ioffe S, Vanhoucke V, Alemi A (2017) Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning In AAAI, pp 4278–4284
Too EC, Yujian L, Njuki S, Yingchun L (2018) A comparative study of fine-tuning deep learning models for plant disease identification. Computers and Electronics in Agriculture 161:272–279. https://doi.org/10.1016/j.compag.2018.03.032
Varçın F (2020) Crop pest classification with a genetic algorithm-based weighted ensemble of deep convolutional neural networks. Comput Electron Agric 179:105809
Vibhute AD, Kale KV, Dhumal RK, Mehrotra SC (2015) Soil type classification and mapping using hyperspectral remote sensing data. In: Conference on man and machine interfacing (MAMI), pp 1–4
Wu W, Li AD, He XH, Ma R, Liu HB, Lv JK (2018) A comparison of support vector machines, artificial neural network and classification tree for identifying soil texture classes in Southwest China. Comput Electron Agric 144:86–93
Yanming G, Yu L, Ard O, Songyang L, Song W, Michael SL (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27–48
Zhang X, Younan NH, King RL (2003) Soil texture classification, using wavelet transform and maximum likelihood approach. In: 2003 IEEE International Geoscience and Remote Sensing Symposium. Toulouse: Proceedings (IEEE Cat.No.03CH37477), pp 2888–2890
Zhang Y, Chu J, Leng L, Miao J (2020)Mask-refined R-CNN: a network for refining object details in instance segmentation. Sensors 20(4):1010
Zhao Z, Chow TL, Rees HW, Yang Q, Xing Z, Meng FR (2009) Predict soil texture distributions using an artificial neural network model. Comput Electron Agric 65:36–48
Author information
Authors and Affiliations
Contributions
M G Lanjewar: Methodology, Software, Validation, Investigation, Writing - Original Draft, Performance analysis. O L Gurav: Dataset creation, Software.
Corresponding author
Ethics declarations
Conflicts of interest/competing interests
No conflict of interest.
Ethics approval
NA.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lanjewar, M.G., Gurav, O.L. Convolutional Neural Networks based classifications of soil images. Multimed Tools Appl 81, 10313–10336 (2022). https://doi.org/10.1007/s11042-022-12200-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12200-y