Skip to main content
SpringerLink
Log in

Integrated fuzzy and deep learning model for identification of coconut maturity without human intervention

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Maturity of the coconut is judged manually based on the shape, color, weight, shaking sound, timeframe, etc. Currently, there is not much research being done to find solutions involving the latest techniques including fuzzy, machine learning and deep learning techniques for identifying maturity of the coconuts without human intervention. These techniques have significant challenges in detecting the multiple classes in coconut maturity due to difference in size and shape of the coconuts and the complex nature of their backgrounds as each coconut tree and each coconut bunch are unique. In this research work, we propose an integrated fuzzy and deep learning model (IFDM) to identify the maturity classes of coconut. Deep learning-based Mask R-CNN is used to classify and segment the coconut images. The combined fuzzy system (CFS) extracts the color, shape and scratch features with a fuzzy extraction technique for each feature. A probability-based fuzzy integration (PFI) method integrates the output from each fuzzy extraction to classify the coconuts. Decision-making probability (DMP) model combines the class probability of the probability-based fuzzy integration method and Mask R-CNN model to obtain the final coconut maturity class. The dataset with 10,000 images is used for training. Two test datasets, the first one containing 1754 real-time coconut images and the second containing 1000 cropped coconut images from the background, are used for testing. Using the proposed learning model in real time, an accuracy of 86.3% is obtained in classifying the maturity classes of coconuts. While integrating the models like Yolo v3, Yolo v5, Faster R-CNN, random forest and KNN with combined fuzzy system, Mask R-CNN performed better in terms of accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Megalingam RK, Manoharan SK, Mohandas SM, Vadivel SRR, Gangireddy G, Ghanta S, Saikumar KS, Teja PS, Sivanantham V (2021) Amaran: an unmanned robotic coconut tree climber and harvester. IEEE/ASME Trans Mechatron 26(1):288–299. https://doi.org/10.1109/TMECH.2020.3014293

    Article  Google Scholar 

  2. Siva Raja PM, Rani AV (2020) Brain tumor classification using a hybrid deep autoencoder with Bayesian fuzzy clustering-based segmentation approach. Biocybern Biomed Eng 40(1):440–453. https://doi.org/10.1016/j.bbe.2020.01.006

    Article  Google Scholar 

  3. Pitchai R, Supraja P, Victoria AH, Madhavi M (2020) Brain tumor segmentation using deep learning and fuzzy K-means clustering for magnetic resonance images. Neural Process Lett. https://doi.org/10.1007/s11063-020-10326-4

    Article  Google Scholar 

  4. Sadad T, Munir A, Saba T, Hussain A (2018) Fuzzy C-means and region growing based classification of tumor from mammograms using hybrid texture feature. J Comput Sci 29:34–45. https://doi.org/10.1016/j.jocs.2018.09.015

    Article  MathSciNet  Google Scholar 

  5. Mishro PK, Agrawal S, Panda R, Abraham A (2021) A novel type-2 fuzzy C-means clustering for brain MR image segmentation. IEEE Trans Cybern 51(8):3901–3912. https://doi.org/10.1109/TCYB.2020.2994235

    Article  PubMed  Google Scholar 

  6. Rejeesh MR (2019) Interest point based face recognition using adaptive neuro fuzzy inference system. Multimed Tools Appl 78(16):22691–22710. https://doi.org/10.1007/s11042-019-7577-5

    Article  Google Scholar 

  7. Chen L, Su W, Wu M, Pedrycz W, Hirota K (2020) A fuzzy deep neural network with sparse autoencoder for emotional intention understanding in human-robot interaction. IEEE Trans Fuzzy Syst 28(7):1252–1264. https://doi.org/10.1109/TFUZZ.2020.2966167

    Article  Google Scholar 

  8. Rao A, Kulkarni SB (2020) A hybrid approach for plant leaf disease detection and classification using digital image processing methods. The Int J Electr Eng Educ. https://doi.org/10.1177/0020720920953126

    Article  Google Scholar 

  9. Megalingam RK, Gangireddy R, Sriteja G, Kashyap A and Ganesh AS (2017) Adding intelligence to the robotic coconut tree climber. In: 2017 International Conference on Inventive Computing and Informatics (ICICI), pp 613-617. https://doi.org/10.1109/ICICI.2017.8365206

  10. Megalingam RK, Ashish P, Tom C, Harikrishna M, Anandkumar, Venu M (2013) Kinect based wireless robotic coconut tree climber. In: Proceedings of 3rd international conference on advancements in electronics and power engineering (ICAEPE'2013)

  11. Megalingam RK, Sakthiprasad KM, Sreekanth M, Vamsy G (2022) A survey on robotic coconut tree climbers – existing methods and techniques. In: IOP conference series: materials science and engineering 225. 012201. https://doi.org/10.1088/1757-899X/225/1/012201

  12. Megalingam RK, Thejus P, Allan P, Trayesh V, Gokul M (2015) Robotic arm design for coconut-tree climbing robot. Appl Mech Mater 786:328–333. https://doi.org/10.4028/www.scientific.net/AMM.786.328

    Article  Google Scholar 

  13. Sakthiprasad KM and Megalingam RK (2020) Intelligent Control of Actuators using Current Sensor Feedback for a Coconut Tree Climber. In: 2020 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA), pp 178–183. https://doi.org/10.1109/ICIMIA48430.2020.9074849

  14. Jia W, Liu X, Wang Y, Pedrycz W, Zhou J (2022) Semisupervised learning via axiomatic fuzzy set theory and SVM. IEEE Trans Cybern 52(6):4661–4674. https://doi.org/10.1109/TCYB.2020.3032707

    Article  PubMed  Google Scholar 

  15. Zheng W, Yan L, Gou C, Wang F-Y (2022) Fuzzy deep forest with deep contours feature for leaf cultivar classification. IEEE Trans Fuzzy Syst. https://doi.org/10.1109/TFUZZ.2022.3177764

    Article  Google Scholar 

  16. Kumar A et al (2021) CoMHisP: a novel feature extractor for histopathological image classification based on fuzzy SVM with within-class relative density. IEEE Trans Fuzzy Syst 29(1):103–117. https://doi.org/10.1109/TFUZZ.2020.2995968

    Article  Google Scholar 

  17. Huang YP, Wang TH, Basanta H (2020) Using fuzzy mask R-CNN Model to automatically identify tomato ripeness. IEEE Access 8:207672–207682. https://doi.org/10.1109/ACCESS.2020.3038184

    Article  Google Scholar 

  18. Sadiq M, Masood S, Pal O (2022) FD-YOLOv5: a fuzzy image enhancement based robust object detection model for safety helmet detection. Int J Fuzzy Syst. https://doi.org/10.1007/s40815-022-01267-2

    Article  Google Scholar 

  19. Hu C, Liu X, Pan Z, Li P (2019) Automatic detection of single ripe tomato on plant combining faster R-CNN and intuitionistic fuzzy set. IEEE Access 7:154683–154696. https://doi.org/10.1109/ACCESS.2019.2949343

    Article  Google Scholar 

  20. Lin CJ, Jhang JY (2022) Intelligent traffic-monitoring system based on YOLO and convolutional fuzzy neural networks. IEEE Access 10:14120–14133. https://doi.org/10.1109/ACCESS.2022.3147866

    Article  Google Scholar 

  21. Zaghari N, Fathy M, Jameii SM, Shahverdy M (2021) The improvement in obstacle detection in autonomous vehicles using YOLO non-maximum suppression fuzzy algorithm. J Supercomput. https://doi.org/10.1007/s11227-021-03813-5

    Article  Google Scholar 

  22. Kumari N, Kr Dwivedi R, Kr Bhatt A, Belwal R (2021) Automated fruit grading using optimal feature selection and hybrid classification by self-adaptive chicken swarm optimization: grading of mango. Neural Comput Appl. https://doi.org/10.1007/s00521-021-06473-x

    Article  Google Scholar 

  23. Liu G, Nouaze JC, Touko Mbouembe PL, Kim JH (2020) YOLO-tomato: a robust algorithm for tomato detection based on YOLOv3. Sensors 20(7):2145. https://doi.org/10.3390/s20072145

    Article  ADS  PubMed  PubMed Central  Google Scholar 

  24. Wang Z, Jin L, Wang S, Xu H (2022) Apple stem/calyx real-time recognition using YOLO-v5 algorithm for fruit automatic loading system. Postharvest Biol Technol 185:111808. https://doi.org/10.1016/j.postharvbio.2021.111808

    Article  CAS  Google Scholar 

  25. Song Z, Fu L, Wu J, Liu Z, Li R, Cui Y (2019) Kiwifruit detection in field images using Faster R-CNN with VGG16. IFAC-PapersOnLine 52(30):76–81. https://doi.org/10.1016/j.ifacol.2019.12.500

    Article  MathSciNet  Google Scholar 

  26. Parvathi S, Tamil Selvi S (2021) Detection of maturity stages of coconuts in complex background using Faster R-CNN model. Biosyst Eng 202:119–132. https://doi.org/10.1016/j.biosystemseng.2020.12.002

    Article  CAS  Google Scholar 

  27. Subramanian P, Sankar TS (2022) Coconut maturity recognition using convolutional neural network. Algorithms Intell Syst. https://doi.org/10.1007/978-981-16-9991-7_7

    Article  Google Scholar 

  28. Caladcad JA et al (2020) Determining Philippine coconut maturity level using machine learning algorithms based on acoustic signal. Comput Electron Agric 172:105327. https://doi.org/10.1016/j.compag.2020.105327

    Article  Google Scholar 

  29. Korytkowski M, Rutkowski L, Scherer R (2016) Fast image classification by boosting fuzzy classifiers. Inf Sci 327:175–182. https://doi.org/10.1016/j.ins.2015.08.030

    Article  MathSciNet  Google Scholar 

  30. Bonissone P, Cadenas JM, Carmen Garrido M, Andrés Díaz-Valladares R (2010) A fuzzy random forest. Int J Approx Reason 51(7):729–747. https://doi.org/10.1016/j.ijar.2010.02.003

    Article  MathSciNet  Google Scholar 

  31. Sarkar SS, Ansari MS, Mahanty A et al (2021) Microstructure image classification: a classifier combination approach using fuzzy integral measure. Integr Mater Manuf Innov 10:286–298. https://doi.org/10.1007/s40192-021-00210-x

    Article  Google Scholar 

Download references

Acknowledgements

The authors sincerely thank Electronics and Communication Engineering department and Humanitarian Technology (HuT) Labs of Amrita Vishwa Vidyapeetham, Amritapuri Campus, for the persistent help and support in conducting this research.

Funding

No funding was received for conducting this study.

Author information

Authors and Affiliations

  1. Amrita Coconut and Research Development (ACORD) Center, Department of Electronics and Communication Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, 690525, India

    Rajesh Kannan Megalingam, Sakthiprasad Kuttankulangara Manoharan & Ragavendra Balasubramani Maruthababu

Authors
  1. Rajesh Kannan Megalingam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sakthiprasad Kuttankulangara Manoharan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ragavendra Balasubramani Maruthababu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rajesh Kannan Megalingam.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article. The authors have no relevant financial or non-financial interests to disclose.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Megalingam, R.K., Manoharan, S.K. & Maruthababu, R.B. Integrated fuzzy and deep learning model for identification of coconut maturity without human intervention. Neural Comput & Applic 36, 6133–6145 (2024). https://doi.org/10.1007/s00521-023-09402-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-09402-2

Keywords

Search

Navigation