Skip to main content

Advertisement

Log in

Thermal infrared imaging based breast cancer diagnosis using machine learning techniques

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The human’s temperature is little known and important to the diagnosis of diseases, according to most researchers and health workers.In ancient medicine, doctors may treat patients with wet mud or slurry clay. The part that would dry up first was considered the diseased part when either of these spread over the body. This can be done today with thermal cameras generating pictures with electromagnetic frequencies. Inflammation and blockage areas that predict cancer without radiation or touch may be detected by thermography. It can be used before any visible symptoms occur as a great advantage in medical testing. Machine learning (ML) is used in this paper as statistical techniques to give software programs the capacity to learn from information without being directly coded. ML can help to do so by learning these thermal scans and identifying suspected areas where a doctor needs to research more. Thermal photography is a comparatively better alternative to other methods that need sophisticated equipment, enabling machines to provide an easier and more effective approach to clinics and hospitals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Acharya UR, Ng EY-K, Tan J-H, Sree SV (2012) Thermography based breast cancer detection using texture features and support vector machine. J Med Syst 36(3):1503–1510

    Article  Google Scholar 

  2. Agravat RR, Raval MS (2019) Prediction of overall survival of brain tumor patients. In: TENCON 2019-2019 IEEE Region 10 Conference (TENCON). IEEE, pp 31–35

  3. Bettegowda C, Sausen M, Leary RJ, Kinde I, Wang Y, Agrawal N, Bartlett BR, Wang H, Luber B, Alani RM et al (2014) Detection of circulating tumor dna in early-and late-stage human malignancies. Sci Transl Med 6 (224):224ra24–224ra24

    Article  Google Scholar 

  4. Cano F, Madabhushi A, Cruz-Roa A (2018) A comparative analysis of sensitivity of convolutional neural networks for histopathology image classification in breast cancer. In: Romero E, Lepore N, Brieva J (eds) 14th international symposium on medical information processing and analysis. International society for optics and photonics, vol 10975. SPIE, pp 277–284. [Online]. Available: https://doi.org/10.1117/12.2511647

  5. Cho N, Han W, Han B-K, Bae MS, Ko ES, Nam SJ, Chae EY, Lee JW, Kim SH, Kang BJ et al (2017) Breast cancer screening with mammography plus ultrasonography or magnetic resonance imaging in women 50 years or younger at diagnosis and treated with breast conservation therapy. JAMA Oncol 3(11):1495–1502

    Article  Google Scholar 

  6. de Oliveira NPD, dos Santos Siqueira CA, de Lima KYN, de Camargo Cancela M, de Souza DLB (2020) Association of cervical and breast cancer mortality with socioeconomic indicators and availability of health services, vol 64

  7. Dong Y, Jiang Z, Shen H, Pan WD, Williams LA, Reddy VV, Benjamin WH, Bryan AW (2017) Evaluations of deep convolutional neural networks for automatic identification of malaria infected cells. In: 2017 IEEE EMBS international conference on Biomedical and Health Informatics (BHI). IEEE, pp 101–104

  8. Elias T (2019) Visual lab - a methodology for breast disease computer-aided diagnosis. [online] visual. ic.uff.br. http://visual.ic.uff.br/en/proeng/thiagoelias/. accessed: 2020-01-20

  9. Erdoğan H (2019) Trajectory Analysis and control using recurrent neural networks

  10. Etehadtavakol M, Emrani Z, Ng E (2019) Rapid extraction of the hottest or coldest regions of medical thermographic images. Med Biol Eng Comput 57(2):379–388

    Article  Google Scholar 

  11. Fan D-P, Cheng M-M, Liu J-J, Gao S-H, Hou Q, Borji A (2018) Salient objects in clutter: bringing salient object detection to the foreground. In: Proceedings of the European Conference on Computer Vision (ECCV), pp 186–202

  12. Fernández-Ovies FJ, Alférez-Baquero ES, de Andrés-Galiana EJ, Cernea A, Fernández-Muñiz Z, Fernández-martínez JL (2019) Detection of breast cancer using infrared thermography and deep neural networks. In: International work-conference on bioinformatics and biomedical engineering. Springer, pp 514–523

  13. Foa EB, Chrestman KR, Gilboa-Schechtman E (2008) Prolonged exposure therapy for adolescents with PTSD emotional processing of traumatic experiences, therapist guide. Oxford University Press, Oxford

    Book  Google Scholar 

  14. Frize M, Herry C, Scales N (2003) Processing thermal images to detect breast cancer and assess pain, in 4th International. In: IEEE EMBS special topic conference on information technology applications in biomedicine, 2003. IEEE, pp 234–237

  15. Fu K, Zhao Q, Gu IY-H, Yang J (2019) Deepside: a general deep framework for salient object detection. Neurocomputing 356:69–82

    Article  Google Scholar 

  16. Fu K, Fan D-P, Ji G-P, Zhao Q (2020). Jl-dcf:, Joint learning and densely-cooperative fusion framework for rgb-d salient object detection, arXiv:2004.08515

  17. Gerasimova E, Audit B, Roux SG, Khalil A, Gileva O, Argoul F, Naimark O, Arneodo A (2014) Wavelet-based multifractal analysis of dynamic infrared thermograms to assist in early breast cancer diagnosis. Front Physiol 5:176

    Article  MATH  Google Scholar 

  18. Gong C, Tao D, Liu W, Maybank SJ, Fang M, Fu K, Yang J (2015) Saliency propagation from simple to difficult. In: Proceedings of the IEEE conference on computer vision and pattern recognition , pp 2531–2539

  19. Hafiz AM, Bhat GM (2020) A survey of deep learning techniques for medical diagnosis. In: Information and communication technology for sustainable development. Springer, pp 161–170

  20. Hamidinekoo A, Denton E, Rampun A, Honnor K, Zwiggelaar R (2018) Deep learning in mammography and breast histology, an overview and future trends. Med Image Anal 47:45–67

    Article  Google Scholar 

  21. Hunter JD (2007) Matplotlib: a 2d graphics environment. Comput Sci Eng 9(3):90–95

    Article  Google Scholar 

  22. Jaeger BM, Hong AS, Letter H, Odell MC (2016) Advancements in imaging technology for detection and diagnosis of palpable breast masses. Clin Obstet Gynecol 59(2):336–350

    Article  Google Scholar 

  23. Janghel R, Shukla A, Tiwari R, Kala R (2010) Breast cancer diagnosis using artificial neural network models. In: The 3rd international conference on information sciences and interaction sciences. IEEE, pp 89–94

  24. Jones GW (2007) Delayed marriage and very low fertility in pacific asia. Popul Dev Rev 33(3):453–478

    Article  Google Scholar 

  25. Josephine Selle J, Shenbagavalli A, Sriraam N, Venkatraman B, Jayashree M, Menaka M (2018) Automated recognition of rois for breast thermograms of lateral view-a pilot study. Quant Infrared Thermogr J 15(2):194–213

    Google Scholar 

  26. Joshi AV (2020) Deep learning, in machine learning and artificial intelligence. Springer, Berlin, pp 117–126

    Book  Google Scholar 

  27. Kadam VJ, Jadhav SM, Vijayakumar K (2019) Breast cancer diagnosis using feature ensemble learning based on stacked sparse autoencoders and softmax regression. J Med Syst 43(8):263

    Article  Google Scholar 

  28. Karim CN, Mohamed O, Ryad T (2018) A new approach for breast abnormality detection based on thermography. Med Technol J 2(3):245–254

    Article  Google Scholar 

  29. Khan S, Yong S-P (2017) A deep learning architecture for classifying medical images of anatomy object. In: 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). IEEE, pp 1661–1668

  30. Köṡüṡ N, Köṡüṡ A, Duran M, Simavlı S, Turhan N (2010) Comparison of standard mammography with digital mammography and digital infrared thermal imaging for breast cancer screening. J Turk Ger Gynecol Assoc 11(3):152

    Article  Google Scholar 

  31. Kremer JM (2017) Characterization of Axenic Immune Deficiency in Arabidopsis thaliana. Michigan State University

  32. Leaf C (2004) Why we’re losing the war on cancer (and how to win it). Fortune-European Edition- 149(5):42–55

    Google Scholar 

  33. Liu K, Kang G, Zhang N, Hou B (2018) Breast cancer classification based on fully-connected layer first convolutional neural networks. IEEE Access 6:23722–23732

    Article  Google Scholar 

  34. Lu Y, Zhang L, Wang B, Yang J (2014) Feature ensemble learning based on sparse autoencoders for image classification. In: 2014 International Joint Conference on Neural Networks (IJCNN), pp 1739–1745

  35. Lunenfeld B, Stratton P (2013) The clinical consequences of an ageing world and preventive strategies. Best Pract Res Clin Obstet Gynaecol 27(5):643–659

    Article  Google Scholar 

  36. Maestre CR, Gregori FA, López MP, Aldeguer RR Jupyter notebook: theory and practice of mathematical models in engineering and architecture

  37. Mahmoudzadeh E, Montazeri M, Zekri M, Sadri S (2015) Extended hidden markov model for optimized segmentation of breast thermography images. Infrared Phys Technol 72:19–28

    Article  Google Scholar 

  38. Mambou SJ, Maresova P, Krejcar O, Selamat A, Kuca K (2018) Breast cancer detection using infrared thermal imaging and a deep learning model. Sensors 18(9):2799

    Article  Google Scholar 

  39. Maxim LD, Niebo R, Utell MJ (2014) Screening tests: a review with examples. Inhal Toxicol 26(13):811–828

    Article  Google Scholar 

  40. McKinney W (2012) Python for data analysis: data wrangling with pandas. NumPy, and IPython. O’Reilly Media Inc.

  41. Milosevic M, Jankovic D, Peulic A (2014) Thermography based breast cancer detection using texture features and minimum variance quantization. EXCLI J 13:1204

    Google Scholar 

  42. Nie G-Y, Cheng M-M, Liu Y, Liang Z, Fan D-P, Liu Y, Wang Y (2019) Multi-level context ultra-aggregation for stereo matching. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3283–3291

  43. Oliphant TE et al (2019) Numpy: N-dimensional array package for python

  44. Opencv documentation (2019) https://opencv.org/about/, accessed: 2020-01-20

  45. Python data analysis library. [Online]. Available: https://pandas.pydata.org/

  46. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V et al (2011) Scikit-learn: Machine learning in python. J Mach Learn Res 12:2825–2830

    MathSciNet  MATH  Google Scholar 

  47. Qi H, Head JF (2001) Asymmetry analysis using automatic segmentation and classification for breast cancer detection in thermograms. In: 2001 conference proceedings of the 23rd annual international conference of the IEEE engineering in medicine and biology society, vol 3. IEEE, pp 2866–2869

  48. Qi H, Kuruganti PT, Snyder WE (2012) Detecting breast cancer from thermal infrared images by asymmetry analysis. Med Med Res 38

  49. Rahman MM, Saha KC, Mukherjee SC, Pati S, Dutta RN, Roy S, Quamruzzaman Q, Rahman M, Chakraborti D (2015) Groundwater arsenic contamination in bengal delta and its health effects. In: Safe and sustainable use of arsenic-contaminated aquifers in the gangetic plain. Springer, pp 215–253

  50. Rampun A, Scotney BW, Morrow PJ, Wang H, Winder J (2018) Breast density classification using local quinary patterns with various neighbourhood topologies. J Imaging 4(1):14

    Article  Google Scholar 

  51. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252

    Article  MathSciNet  Google Scholar 

  52. Santana MAd, Pereira JMS, Silva FLd, Lima NMd, Sousa FNd, Arruda GMSd, Lima RdCFd, Silva WWAd, Santos WPd (2018) Breast cancer diagnosis based on mammary thermography and extreme learning machines. Res Biomed Eng 34(1):45–53. https://doi.org/10.1590/2446-4740.05217

    Article  Google Scholar 

  53. Schaefer G, Závišek M, Nakashima T (2009) Thermography based breast cancer analysis using statistical features and fuzzy classification. Pattern Recogn 42(6):1133–1137

    Article  Google Scholar 

  54. Shen L, Margolies LR, Rothstein JH, Fluder E, McBride R, Sieh W (2019) Deep learning to improve breast cancer detection on screening mammography. Sci Rep 9(1):1–12

    Google Scholar 

  55. Silva LF, Sequeiros GO, Santos MLO, Fontes CA, Muchaluat-Saade DC, Conci A (2015) Thermal signal analysis for breast cancer risk verification. In: MedInfo, pp 746–750

  56. Silva LF, Santos AAS, Bravo RS, Silva AC, Muchaluat-Saade DC, Conci A (2016) Hybrid analysis for indicating patients with breast cancer using temperature time series. Comput Methods Programs Biomed 130:142–153

    Article  Google Scholar 

  57. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition, arXiv:1409.1556

  58. U of Ottawa Evidence-Based Practice Center, Moher D, Schachter HM (2004) Measuring the quality of breast cancer care in women. Agency for Healthcare Research and Quality

  59. ul Hassan M (2018) Vgg16–convolutional network for classification and detection, Neurohive. Dostopno na: https://neurohive.io/en/popular-networks/vgg16/ [10. 4. 2019]

  60. Upadhyay RP (2012) An overview of the burden of non-communicable diseases in india. Iran J Public Health 41(3):1

    Google Scholar 

  61. Vikhe P, Thool V (2018) Morphological operation and scaled réyni entropy based approach for masses detection in mammograms. Multimed Tools Appl 77 (18):23777–23802

    Article  Google Scholar 

  62. W.H. Organization (2019) Global action plan on physical activity 2018-2030: more active people for a healthier world. World Health Organization, 2019

    Google Scholar 

  63. Wu G, Lin Z, Han J, Liu L, Ding G, Zhang B, Shen J (2018) Unsupervised deep hashing via binary latent factor models for large-scale cross-modal retrieval. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, IJCAI-18. International joint conferences on artificial intelligence organization, pp 2854–2860. [Online]. Available: https://doi.org/10.24963/ijcai.2018/396

  64. Yadav SS, Jadhav SM (2019) Deep convolutional neural network based medical image classification for disease diagnosis. J Big Data 6(1):113

    Article  Google Scholar 

  65. Yao X, Wei W, Li J, Wang L, Xu Z, Wan Y, Li K, Sun S (2014) A comparison of mammography, ultrasonography, and far-infrared thermography with pathological results in screening and early diagnosis of breast cancer. Asian Biomed 8(1):11–19

    Article  Google Scholar 

Download references

Funding

No funding was received for this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Samir S. Yadav.

Ethics declarations

Conflict of interests

The authors declare no conflict of interest, financial or otherwise.

Additional information

Research involving human participants and/or animals

This research paper does not contain any studies with human participants or animals performed by any of the authors.

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yadav, S.S., Jadhav, S.M. Thermal infrared imaging based breast cancer diagnosis using machine learning techniques. Multimed Tools Appl 81, 13139–13157 (2022). https://doi.org/10.1007/s11042-020-09600-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09600-3

Keywords

Navigation