Skip to main content
Springer Nature Link
Log in

Magnification Independent Breast Cancer Analysis Using Vision Transformer

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Breast Cancer (BC) remains a critical global health challenge, accounting for millions of lives annually. Most breast cancer detection techniques are designed for binary classification. However, further classifying these types into their subtypes remains challenging due to cell coherence, variations in colour distribution, and intraclass similarity. Additionally, these techniques are limited to specific magnification levels of input images. As a result, the need to develop multiclass classification techniques independent of magnification levels has become increasingly demanding. This research introduces an innovative approach based on an enhanced vision transformer (ViT) for BC analysis that seamlessly handles binary and multiclass classification tasks in a magnification-independent manner. The proposed framework incorporates convolutional layers into the ViT model to simultaneously enhance its capability to capture local and global features. This innovative adjustment also empowers the model to capture complex patterns and subtle features by overcoming the issue of different magnification levels. Extensive experiments are conducted on the benchmark BreaKHis dataset to validate the effectiveness of the proposed framework. It achieves an accuracy of 89.43% for binary classification (benign vs. malignant) and 57.94% and 74.71% for multiclass benign and multiclass malignant subclass classification, respectively. The results confirm that the proposed framework surpasses the performance of the original ViT model and other state-of-the-art techniques.

Highlights

• Introduction of CEV-BCA, an innovative approach to Breast Cancer Analysis

• Seamlessly performs binary and multiclass classification tasks independent of magnification levels

• Enhancement of ViT model with convolutional layers to capture local and global features effectively

• Demonstrates superior performance compared to state-of-the-art techniques, achieving high accuracy for both binary and multiclass classification tasks

AbstractSection Graphical Abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data availability

The dataset used in this study is the benchmark BreaKHis dataset, publicly available at https://web.inf.ufpr.br/vri/databases/breast-cancer-histopathological-database-breakhis/. This database has been built in collaboration with the P&D Laboratory – Pathological Anatomy and Cytopathology, Parana, Brazil.

References

  1. P. Bisoyi, "Malignant tumors – as cancer," Underst. Cancer From Basics to Ther., pp. 21–36, Jan. 2022, https://doi.org/10.1016/B978-0-323-99883-3.00011-1.

  2. "Cancer Terms | SEER Training." https://training.seer.cancer.gov/disease/cancer/terms.html (accessed Sep. 14, 2022).

  3. "Cancer." https://www.who.int/news-room/fact-sheets/detail/cancer (accessed Sep. 14, 2022).

  4. H Sung et al Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries CA Cancer J Clin 71 3 209 249 https://doi.org/10.3322/CAAC.21660

  5. "Breast Cancer: Statistics | Cancer.Net." https://www.cancer.net/cancer-types/breast-cancer/statistics (accessed Sep. 14, 2022).

  6. P. Kumar, S. Chauhan, and L. K. Awasthi, "Artificial Intelligence in Healthcare: Review, Ethics, Trust Challenges & Future Research Directions," Eng. Appl. Artif. Intell., vol. 120, no. May 2022, p. 105894, 2023, https://doi.org/10.1016/j.engappai.2023.105894.

  7. Helvie MA (2010) Digital Mammography Imaging: Breast Tomosynthesis and Advanced Applications. Radiol Clin North Am 48(5):917. https://doi.org/10.1016/J.RCL.2010.06.009

    Article  MATH  Google Scholar 

  8. Murtaza G et al (2020) Deep learning-based breast cancer classification through medical imaging modalities: state of the art and research challenges. Artif Intell Rev 53(3):1655–1720. https://doi.org/10.1007/S10462-019-09716-5/FIGURES/4

    Article  MATH  Google Scholar 

  9. G. Chen, Y. Dai, and J. Zhang, "RRCNet: Refinement residual convolutional network for breast ultrasound images segmentation," Eng. Appl. Artif. Intell., vol. 117, no. November 2022, p. 105601, 2023, https://doi.org/10.1016/j.engappai.2022.105601.

  10. Elmore JG, Armstrong K, Lehman CD, Fletcher SW (2005) Screening for Breast Cancer. JAMA 293(10):1245. https://doi.org/10.1001/JAMA.293.10.1245

    Article  Google Scholar 

  11. Suh HJ, Choi JS, Ko K (2014) Extra-Mammary Findings Detected on Breast Magnetic Resonance Imaging: A Pictorial Essay. Korean J Radiol 15(4):423. https://doi.org/10.3348/KJR.2014.15.4.423

    Article  MATH  Google Scholar 

  12. Schmidt G, Dinter D, Reiser MF, Schoenberg SO (2010) The Uses and Limitations of Whole-Body Magnetic Resonance Imaging. Dtsch Arztebl Int 107(22):383. https://doi.org/10.3238/ARZTEBL.2010.0383

    Article  Google Scholar 

  13. Pavithra PR, Ravichandran KS, Sekar KR, Manikandan R (2018) The effect of thermography on breast cancer detection. Syst Rev Pharm 9(1):10–16. https://doi.org/10.5530/srp.2018.1.3

    Article  MATH  Google Scholar 

  14. N. AB et al., "Modern breast cancer detection: a technological review," Int. J. Biomed. Imaging, vol. 2009, 2009, https://doi.org/10.1155/2009/902326.

  15. "Computerized nuclear morphometry as an objective method for characterizing human cancer cell populations - PubMed."

  16. K. M, F. P, O. A, K. J, and M. R, "Computer-aided diagnosis of breast cancer based on fine needle biopsy microscopic images," Comput. Biol. Med., vol. 43, no. 10, pp. 1563–1572, Oct. 2013, https://doi.org/10.1016/J.COMPBIOMED.2013.08.003.

  17. George YM, Zayed HH, Roushdy MI, Elbagoury BM (2014) Remote computer-aided breast cancer detection and diagnosis system based on cytological images. IEEE Syst J 8(3):949–964. https://doi.org/10.1109/JSYST.2013.2279415

    Article  Google Scholar 

  18. Spanhol FA, Oliveira LS, Petitjean C, Heutte L (2016) A Dataset for Breast Cancer Histopathological Image Classification. IEEE Trans Biomed Eng 63(7):1455–1462. https://doi.org/10.1109/TBME.2015.2496264

    Article  Google Scholar 

  19. L. V. Haar, T. Elvira, and O. Ochoa, "An analysis of explainability methods for convolutional neural networks," Eng. Appl. Artif. Intell., vol. 117, no. March 2022, p. 105606, 2023, https://doi.org/10.1016/j.engappai.2022.105606.

  20. Jg L et al (2017) Deep Learning in Medical Imaging: General Overview. Korean J Radiol 18(4):570–584. https://doi.org/10.3348/KJR.2017.18.4.570

    Article  MATH  Google Scholar 

  21. Lan K et al (2020) Multi-view convolutional neural network with leader and long-tail particle swarm optimizer for enhancing heart disease and breast cancer detection. Neural Comput Appl 32(19):15469–15488. https://doi.org/10.1007/S00521-020-04769-Y/FIGURES/16

    Article  MATH  Google Scholar 

  22. Truong TD, Pham HT-T (2018) Breast Cancer Histopathological Image Classification Utilizing Convolutional Neural Network. IFMBE Proc 69:531–536. https://doi.org/10.1007/978-981-13-5859-3_92

    Article  Google Scholar 

  23. Jiang Y, Chen L, Zhang H, Xiao X (2019) Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module. PLoS ONE 14(3):e0214587. https://doi.org/10.1371/JOURNAL.PONE.0214587

    Article  Google Scholar 

  24. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2323. https://doi.org/10.1109/5.726791

    Article  MATH  Google Scholar 

  25. Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386

    Article  MATH  Google Scholar 

  26. N. Bayramoglu, J. Kannala, and J. Heikkila, "Deep learning for magnification independent breast cancer histopathology image classification," Proc. - Int. Conf. Pattern Recognit., vol. 0, pp. 2440–2445, Jan. 2016, https://doi.org/10.1109/ICPR.2016.7900002.

  27. D. E, Ş. A, K. Z, G. Y, B. V, and B. Ü, "Transfer learning based histopathologic image classification for breast cancer detection," Heal. Inf. Sci. Syst., vol. 6, no. 1, Dec. 2018, https://doi.org/10.1007/S13755-018-0057-X.

  28. Sudharshan PJ, Petitjean C, Spanhol F, Oliveira LE, Heutte L, Honeine P (2019) Multiple instance learning for histopathological breast cancer image classification. Expert Syst Appl 117:103–111. https://doi.org/10.1016/J.ESWA.2018.09.049

    Article  Google Scholar 

  29. J. Xie, R. Liu, J. Luttrell, IV, and C. Zhang, "Deep Learning Based Analysis of Histopathological Images of Breast Cancer," Front. Genet., vol. 10, no. FEB, p. 80, 2019, https://doi.org/10.3389/FGENE.2019.00080.

  30. Yari Y, Nguyen TV, Nguyen HT (2020) Deep learning applied for histological diagnosis of breast cancer. IEEE Access 8:162432–162448. https://doi.org/10.1109/ACCESS.2020.3021557

    Article  MATH  Google Scholar 

  31. Boumaraf S, Liu X, Zheng Z, Ma X, Ferkous C (2021) A new transfer learning based approach to magnification dependent and independent classification of breast cancer in histopathological images. Biomed Signal Process Control 63:102192. https://doi.org/10.1016/J.BSPC.2020.102192

    Article  Google Scholar 

  32. S. Ayyachamy, V. Alex, M. Khened, and G. Krishnamurthi, "Medical image retrieval using Resnet-18," https://doi.org/10.1117/12.2515588, vol. 10954, pp. 233–241, Mar. 2019, https://doi.org/10.1117/12.2515588.

  33. V. Gupta and A. Bhavsar, "Breast Cancer Histopathological Image Classification: Is Magnification Important?," IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Work., vol. 2017-July, pp. 769–776, 2017, https://doi.org/10.1109/CVPRW.2017.107.

  34. Benhammou Y, Achchab B, Herrera F, Tabik S (2020) BreakHis based breast cancer automatic diagnosis using deep learning: Taxonomy, survey and insights. Neurocomputing 375:9–24. https://doi.org/10.1016/J.NEUCOM.2019.09.044

    Article  Google Scholar 

  35. Gour M, Jain S, Kumar TS (2020) Residual learning based CNN for breast cancer histopathological image classification. Int J Imaging Syst Technol 30(3):621–635. https://doi.org/10.1002/IMA.22403

    Article  MATH  Google Scholar 

  36. Li X, Shen X, Zhou Y, Wang X, Li T-Q (2020) Classification of breast cancer histopathological images using interleaved DenseNet with SENet (IDSNet). PLoS ONE 15(5):e0232127. https://doi.org/10.1371/JOURNAL.PONE.0232127

    Article  Google Scholar 

  37. Gupta V, Vasudev M, Doegar A, Sambyal N (2021) Breast cancer detection from histopathology images using modified residual neural networks. Biocybern Biomed Eng 41(4):1272–1287. https://doi.org/10.1016/J.BBE.2021.08.011

    Article  Google Scholar 

  38. Wang P, Wang J, Li Y, Li P, Li L, Jiang M (2021) Automatic classification of breast cancer histopathological images based on deep feature fusion and enhanced routing. Biomed Signal Process Control 65:102341. https://doi.org/10.1016/J.BSPC.2020.102341

    Article  MATH  Google Scholar 

  39. Zhou Y, Zhang C, Gao S (2022) Breast Cancer Classification From Histopathological Images Using Resolution Adaptive Network. IEEE Access 10:35977–35991. https://doi.org/10.1109/ACCESS.2022.3163822

    Article  Google Scholar 

  40. A. Ameh Joseph, M. Abdullahi, S. B. Junaidu, H. Hassan Ibrahim, and H. Chiroma, "Improved multi-classification of breast cancer histopathological images using handcrafted features and deep neural network (dense layer)," Intell. Syst. with Appl., vol. 14, p. 200066, May 2022, https://doi.org/10.1016/J.ISWA.2022.200066.

  41. Maleki A, Raahemi M, Nasiri H (2023) Breast cancer diagnosis from histopathology images using deep neural network and XGBoost. Biomed Signal Process Control 86:105152. https://doi.org/10.1016/J.BSPC.2023.105152

    Article  Google Scholar 

  42. R. Karthiga, K. Narasimhan, N.Raju, and R. Amirtharajan, "Automatic approach for breast cancer detection based on deep belief network using histopathology images," Multimed. Tools Appl., pp. 1–18, Mar. 2024, https://doi.org/10.1007/S11042-024-18949-8/METRICS.

  43. Bolhasani H, Amjadi E, Tabatabaeian M, Jassbi SJ (2020) A histopathological image dataset for grading breast invasive ductal carcinomas. Informatics Med Unlocked 19:100341. https://doi.org/10.1016/J.IMU.2020.100341

    Article  Google Scholar 

  44. Araujo T et al (2017) Classification of breast cancer histology images using Convolutional Neural Networks. PLoS ONE 12(6):e0177544. https://doi.org/10.1371/JOURNAL.PONE.0177544

    Article  MATH  Google Scholar 

  45. Aresta G et al (2019) BACH: Grand challenge on breast cancer histology images. Med Image Anal 56:122–139. https://doi.org/10.1016/J.MEDIA.2019.05.010

    Article  Google Scholar 

  46. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., ... & Houlsby, N. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929.

  47. Cuenat S, Couturier R (2022) “Convolutional Neural Network (CNN) vs Vision Transformer (ViT) for Digital Holography,” 2022 2nd Int. Conf Comput Control Robot ICCCR 2022:235–240. https://doi.org/10.1109/ICCCR54399.2022.9790134

    Article  Google Scholar 

  48. S. Khan, M. Naseer, M. Hayat, S. W. Zamir, F. S. Khan, and M. Shah, "Transformers in Vision: A Survey," ACM Comput. Surv., pp. 1–30, 2022, https://doi.org/10.1145/3505244.

  49. P. Jeevan, "Resource-efficient Hybrid X-formers for Vision," pp. 2982–2990.

  50. Q. Wang et al., "Learning deep transformer models for machine translation," ACL 2019 - 57th Annu. Meet. Assoc. Comput. Linguist. Proc. Conf., pp. 1810–1822, 2020, https://doi.org/10.18653/v1/p19-1176.

  51. Baevski A, Auli M (2019) “Adaptive input representations for neural language modeling,” 7th Int. Conf Learn Represent ICLR 2019:1–13

    MATH  Google Scholar 

  52. F. A. Furfari(tony), "The Transformer," IEEE Ind. Appl. Mag., vol. 8, no. 1, pp. 8–15, 2002, https://doi.org/10.1109/2943.974352.

  53. D. P. Kingma and J. L. Ba, "Adam: A Method for Stochastic Optimization," 3rd Int. Conf. Learn. Represent. ICLR 2015 - Conf. Track Proc., Dec. 2014, https://doi.org/10.48550/arxiv.1412.6980.

  54. "Welcome To Colaboratory - Colaboratory."

  55. F. A. Spanhol, L. S. Oliveira, P. R. Cavalin, C. Petitjean, and L. Heutte, "Deep features for breast cancer histopathological image classification," in 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2017, pp. 1868–1873.

  56. Shallu and R. Mehra, "Automatic magnification independent classification of breast cancer tissue in histological images using deep convolutional neural network," in Advanced Informatics for Computing Research: Second International Conference, ICAICR 2018, Shimla, India, July 14--15, 2018, Revised Selected Papers, Part I 2, 2019, pp. 772–781.

  57. Rashedi E, Rashedi E, Nezamabadi-Pour H (2018) A comprehensive survey on gravitational search algorithm. Swarm Evol Comput 41:141–158

    Article  MATH  Google Scholar 

  58. Mozaffari MH, Abdy H, Zahiri SH (2016) IPO: an inclined planes system optimization algorithm. Comput Informatics 35(1):222–240

    MathSciNet  MATH  Google Scholar 

  59. Wang D, Tan D, Liu L (2018) Particle swarm optimization algorithm: an overview. Soft Comput 22:387–408

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, COMSATS University Islamabad, Lahore Campus, Pakistan

    Shehroz Tariq, Allah Bux Sargano & Zulfiqar Habib

  2. Department of Computer Science, National University of Modern Languages Islamabad, Faisalabad Campus, Pakistan

    Shehroz Tariq

  3. School of Information Technology, Murdoch University, Perth, Australia

    Rehan Raza

Authors
  1. Shehroz Tariq
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Rehan Raza
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Allah Bux Sargano
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Zulfiqar Habib
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Shehroz Tariq: Conceptualization, Methodology, Software, Validation, Formal analysis, Investigation, Writing – original draft, Visualization, Project administration. Rehan Raza: Conceptualization, Methodology, Validation, Formal analysis, Investigation, Writing – review & editing, Supervision. Allah Bux Sargano: Validation, Investigation, Resources, Supervision. Zulfiqar Habib: Writing – review & editing, Supervision.

Corresponding author

Correspondence to Allah Bux Sargano.

Ethics declarations

Competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tariq, S., Raza, R., Sargano, A.B. et al. Magnification Independent Breast Cancer Analysis Using Vision Transformer. Multimed Tools Appl 84, 2029–2057 (2025). https://doi.org/10.1007/s11042-024-19685-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-19685-9

Keywords