Skip to main content

Advertisement

Springer Nature Link
Log in

Classifying nanostructured and heterogeneous materials from transmission electron microscopy images using convolutional neural networks

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Artificial intelligence and nanotechnology are two areas of science that have changed the world and made life easier during this last decade. Both fields are undergoing significant knowledge expansion, and both bear the promise of a better future for humankind. This research study used convolutional neural networks to classify images of nanostructured materials of different chemical components, obtained through transmission electron microscopy (TEM). A total of 685 ground truth images from a reduced collection of nanostructured TEM images were analyzed. They were classified into three groups: silicate, silica, and coating, each type belonging to chemical compounds of yttrium silicate, silicon oxide nanoparticles, and silicon oxide nanoparticles as a thin layer (coating), respectively. The classification, location, and segmentation of chemical compounds were conducted using Mask R-CNN (Region-Convolution Neural Network) with ResNet101 as the backbone for convolutional neural networks and trained with the collection of images created. The results showed accuracy scores from 85 to 99% for the three classes. The trained model was also able to classify overlapping and agglomerated clusters of these three compounds.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Bayda S, Adeel M, Tuccinardi T, Cordani M, Rizzolio F (2020) The history of nanoscience and nanotechnology: from chemical-physical applications to nanomedicine. Molecules 25(1):112

    Article  Google Scholar 

  2. Cervantes-Vásquez D, Contreras OE, Hirata GA (2013) Quantum efficiency of silica-coated rare-earth doped yttrium silicate. J Lumin 143:226–232

    Article  Google Scholar 

  3. Pitts WH, McCulloch WS (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–133

    Article  MathSciNet  Google Scholar 

  4. Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444

    Article  Google Scholar 

  5. Fisker R, Carstensen JM, Hansen MF, Bodker F, Morup S (2000) Estimation of nanoparticle size distributions by image analysis. Nanoparticle Res 2:267–277

    Article  Google Scholar 

  6. Zafari S, Eerola T, Sampo J, Kälviäinen H, Haario H (2017) Segmentation of partially overlapping convex objects using branch and bound algorithm. Lecture Notes Comput Sci 10118:76–90

    Article  Google Scholar 

  7. Phoulady HA, Goldgof D, Hall LO, Mouton PR (2017) A framework for nucleus and overlapping cytoplasm segmentation in cervical cytology extended depth of field and volume images. Comput Med Imag Gr 59:38–49

    Article  Google Scholar 

  8. Saleh HM, Saad NH, Ashidi NMI (2019) Overlapping chromosome segmentation using u-net: convolutional networks with test time augmentation. Proced Comput Sci 159:524–533

    Article  Google Scholar 

  9. Bohm A, Tatarchenko M, Falk T (2019) “Isoov2 dl - semantic instance segmentation of touching and overlapping objects,” in 2019 IEEE 16th International symposium on biomedical imaging (ISBI 2019), pp 343–347

  10. Kowal M, Zejmo M, Skobel M, Korbicz J, Monczak R (2020) Cell nuclei segmentation in cytological images using convolutional neural network and seeded watershed algorithm. J Digital Imag 33:231–242

    Article  Google Scholar 

  11. Fukushima K (1980) Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol Cybern 36:193–202

    Article  Google Scholar 

  12. He K, Gkioxari G, Dollár P, Girshick R (2020) Mask R-CNN. IEEE Trans Pattern Anal Mach Intell 42(2):386–397

    Article  Google Scholar 

  13. Yu J, Li Y, Gao C, Gao H, Xia G, Yu ZL, Li Y (2020) Exemplar-based recursive instance segmentation with application to plant image analysis. IEEE Trans Image Process 29:389–404

    Article  MathSciNet  Google Scholar 

  14. Romera-Paredes B, Torr PHS (2016) Recurrent instance segmentation. Recurrent instance segmentation. Springer International Publishing, Heidelberg, pp 312–329

    Google Scholar 

  15. Schumann O, Hahn M, Dickmann J, Wöhler C (2018) “Supervised clustering for radar applications : on the way to radar instance segmentation,” in IEEE MTT-S International conference on microwaves for intelligent mobility (ICMIM), (Munich), pp 1–4, IEEE

  16. Loussaief S, Abdelkrim A (2018) Convolutional neural network hyper-parameters optimization based on genetic algorithms. Int J Adv Comput Sci Appl 9(10):252–266

    Google Scholar 

  17. Girshick R (2015) “Fast R-CNN,” in Proceedings of the IEEE international conference on computer vision, pp 1440–1448

  18. Ren S, He K, Girshick R, Sun J (2016) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149

    Article  Google Scholar 

  19. He K, Gkioxari G, Dollár P, Girshick R (2017) “Mask R-CNN,” in 2017 IEEE international conference on computer vision (ICCV), pp 2980–2988

  20. Flores D-L, Gutierrez E, Cervantes D, Chacon M, Hirata G (2017) White-light emission from y2sio5:ce3+, tb3+ and sr2si5n8:eu2+ phosphor blends: a predictive model. Micro Nano Lett 12(7):500–504

    Article  Google Scholar 

  21. Raj S, Kumar S, Raj S (2015) An improved histogram equalization technique for image contrast enhancement. In: International conference on communication and computing, pp 1–6

  22. Pizer SM, Johnston RE, Ericksen JP, Yankaskas BC, Muller KE (1990) Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the first conference on visualization in biomedical computing, pp 337–345. https://doi.org/10.1109/VBC.1990.109340

    Article  Google Scholar 

  23. Shorten C, Khoshgoftaar TM (2019) A survey on image data augmentation for deep learning. J Big Data 6(1):1–48

    Article  Google Scholar 

  24. Giryes R, Sapiro G, Bronstein AM (2016) Deep neural networks with random gaussian weights: A universal classification strategy? IEEE Trans Signal Process 64(13):3444–3457

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

We thank Fernanda García and Karla Juárez for their exhaustive work creating the ground truth images. Carlos Cabrera thanks CICESE and CONACYT for the scholarship grant.

Author information

Authors and Affiliations

  1. Universidad Autónoma de Baja California, Carretera Tijuana-Ensenada 3917, Zona Playitas, Ensenada, Baja California, Mexico

    Carlos Cabrera, David Cervantes, Franklin Muñoz & Dora-Luz Flores

  2. Centro de Nanociencias y Nanotecnología, Carretera Tijuana-Ensenada Km 107, Ensenada, Baja California, Mexico

    Gustavo Hirata

  3. Centro de Investigación Científica y de Educación Superior de Ensenada, Carretera Tijuana-Ensenada 3918, Zona Playitas, Ensenada, Baja California, Mexico

    Carlos Cabrera & Patricia Juárez

Authors
  1. Carlos Cabrera
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. David Cervantes
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Franklin Muñoz
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Gustavo Hirata
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Patricia Juárez
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Dora-Luz Flores
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Dora-Luz Flores.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cabrera, C., Cervantes, D., Muñoz, F. et al. Classifying nanostructured and heterogeneous materials from transmission electron microscopy images using convolutional neural networks. Neural Comput & Applic 34, 11035–11047 (2022). https://doi.org/10.1007/s00521-022-07029-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-07029-3

Keywords