Skip to main content
Springer Nature Link
Log in

A deep learning approach for nucleus segmentation and tumor classification from lung histopathological images

  • Original Article
  • Published:
Network Modeling Analysis in Health Informatics and Bioinformatics Aims and scope Submit manuscript

Abstract

Lung cancer is the leading cause of death worldwide. Early diagnosis is crucial to improve patients’ chance of survival. Automated detection and analysis of cancer types can significantly improve the diagnosis process. It can aid treatment through follow-up analyses. This paper proposes a deep learning based pipeline for multi-class classification of lung tumor type (Benign (B), ADenoCarcinoma (ADC) and Squamous-Cell Carcinoma (SCC)) from histopathological images. A baseline classification method, the \(P_{dir}\) pipeline, is proposed where Whole Slide Histopathological Image (WSHI) patches are classified using the proposed Deep Convolutional Neural Network (DCNN) classifier. Since each cancer type is characterized by the difference in the structure of the nuceli, this research work proposes to improve the performance of classification by segmenting the nuclei. The \(P_{seg}\) pipeline is proposed to extract the nuclear regions from the WSHI patches using an Xception-style UNet based neural network, and this segmented region is then categorised into tumor types using the same downstream DCNN architecture. The classification system showed an accuracy of 95.40% and 99.60% using the \(P_{dir}\) and \(P_{seg}\) pipelines, respectively. The classification performed through \(P_{seg}\) pipeline exhibits significant improvement compared to the \(P_{dir}\) pipeline, supporting our hypothesis that nucleus segmentation improves classification performance. This paper posits that segmenting and retaining the nuclear regions in the input image to the tumor type classifier suppresses the importance of less relevant portions of the image during model training, pronounces nuclear region boundaries to highlight shape features, and reduces the overall computation cost of training. Ultimately, it induces a positive impact on classification performance. The enhanced performance obtained using the proposed \(P_{seg}\) pipeline supports our hypothesis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

The data that supports the findings of this study is available from Kaggle at https://www.kaggle.com/andrewmvd/lung-and-colon-cancer-histopathological-images. However, the nucleus segmentation masks that were generated and verified by medical experts are restricted from public availability. This data may be made available from the authors upon reasonable request.

References

  • Abdolhoseini M, Kluge MG, Walker FR et al (2019) Segmentation of heavily clustered nuclei from histopathological images. Sci Rep 9(1):4551. https://doi.org/10.1038/s41598-019-38813-2

    Article  Google Scholar 

  • Araujo A, Norris W, Sim J (2019) Computing receptive fields of convolutional neural networks. Distill. https://doi.org/10.23915/distill.00021

    Article  Google Scholar 

  • Baratloo A, Hosseini M, Negida A, et al (2015) Part 1: simple definition and calculation of accuracy, sensitivity and specificity. 3(2):48–49

  • Borkowski AA, Bui MM, Thomas LB, et al (2023) Lc25000 lung and colon histopathological image dataset. https://github.com/tampapath/lung_colon_image_set

  • Chen M, Huang S, Huang Z et al (2021) Detection of lung cancer from pathological images using CNN model. IEEE Int Conf Comput Sci Electr Inform Eng Intell Control Technol. https://doi.org/10.1109/CEI52496.2021.9574590

    Article  Google Scholar 

  • Cheng Z, Qu A (2020) A fast and accurate algorithm for nuclei instance segmentation in microscopy images. IEEE Access 8:158,679-158,689

    Article  Google Scholar 

  • Chollet F (2017) Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1251–1258

  • Coudray N, Ocampo PS, Sakellaropoulos T et al (2018) Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med 24(10):1559–1567

    Article  Google Scholar 

  • Cui Y, Zhang G, Liu Z et al (2019) A deep learning algorithm for one-step contour aware nuclei segmentation of histopathology images. Med Biol Eng Comput 57(9):2027–2043

    Article  Google Scholar 

  • Dabeer S, Khan MM, Islam S (2019) Cancer diagnosis in histopathological image: Cnn based approach. Inform Med Unlocked. https://doi.org/10.1016/j.imu.2019.100231

    Article  Google Scholar 

  • Deng J, Dong W, Socher R, et al (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp 248–255

  • Devore JL (2011) Probability and statistics for engineering and the sciences, 8th edn. Brooks/Cole

    Google Scholar 

  • Drozdzal M, Vorontsov E, Chartrand G et al (2016) The importance of skip connections in biomedical image segmentation. Deep learning and data labeling for medical applications. Springer, pp 179–187

    Chapter  Google Scholar 

  • Dumoulin V, Visin F (2018) A guide to convolution arithmetic for deep learning. Stat 1050:11

    Google Scholar 

  • Filho A, Silva A, Paiva A et al (2018) Classification of patterns of benignity and malignancy based on CT using topology-based phylogenetic diversity index and convolutional neural network. Pattern Recogn. https://doi.org/10.1016/j.patcog.2018.03.032

    Article  Google Scholar 

  • Filipczuk P, Kowal M, Obuchowicz A (2011) Automatic breast cancer diagnosis based on k-means clustering and adaptive thresholding hybrid segmentation. In: Choraś RS (ed) Image processing and communications challenges 3. Springer, Berlin, pp 295–302

    Chapter  Google Scholar 

  • Gecer B, Aksoy S, Mercan E et al (2018) Detection and classification of cancer in whole slide breast histopathology images using deep convolutional networks. Pattern Recogn 84:345–356. https://doi.org/10.1016/j.patcog.2018.07.022

    Article  Google Scholar 

  • Graham S, Shaban M, Qaiser T et al (2018) Classification of lung cancer histology images using patch-level summary statistics. Med Imaging 1058119:327

    Google Scholar 

  • Hatuwal B, Thapa H (2020) Lung cancer detection using convolutional neural network on histopathological images. Int J Comput Trends Technol 68:21–24. https://doi.org/10.14445/22312803/IJCTT-V68I10P104

    Article  Google Scholar 

  • He K, Zhang X, Ren S et al (2016) Identity mappings in deep residual networks. European conference on computer vision. Springer, Berlin, pp 630–645

    Google Scholar 

  • Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. Internat J Uncertain Fuzziness Knowl-Based Syst 6:107–116. https://doi.org/10.1142/S0218488598000094

    Article  MATH  Google Scholar 

  • Hussein IJ, Burhanuddin MA, Mohammed MA et al (2021) Fully automatic segmentation of gynaecological abnormality using a new viola-jones model. Comput Mater Contin 66:3161

    Google Scholar 

  • Hussein IJ, Burhanuddin MA, Mohammed MA et al (2022) Fully-automatic identification of gynaecological abnormality using a new adaptive frequency filter and histogram of oriented gradients (hog). Expert Syst 39(3):e12,789

    Article  Google Scholar 

  • Jung H, Lodhi B, Kang J (2019) An automatic nuclei segmentation method based on deep convolutional neural networks for histopathology images. BMC Biomed Eng 1(1):1–12

    Article  Google Scholar 

  • Kaiser L, Gomez AN, Chollet F (2018) Depthwise separable convolutions for neural machine translation. In: International Conference on Learning Representations

  • Kalinathan L, Kathavarayan RS, Nagendram D et al (2018) Segmentation of hepatocellular carcinoma and dysplastic liver tumors in histopathology images using area based adaptive expectation maximization. Multimed Tools Appl 77(2):1761–1782

    Article  Google Scholar 

  • Kalinathan L, Kathavarayan RS, Kanmani M et al (2020) Nuclei detection in hepatocellular carcinoma and dysplastic liver nodules in histopathology images using bootstrap regression. Histol Histopathol 35(10):1115–1123

    Google Scholar 

  • Kong H, Gurcan M, Belkacem-Boussaid K (2011) Partitioning histopathological images: an integrated framework for supervised color-texture segmentation and cell splitting. IEEE Trans Med Imaging 30:1661–77. https://doi.org/10.1109/TMI.2011.2141674

    Article  Google Scholar 

  • Kouwenhoven E, Giezen M, Struikmans H (2009) Measuring the similarity of target volume delineations independent of the number of observers. Phys Med Biol 54(9):2863

    Article  Google Scholar 

  • Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90

    Article  Google Scholar 

  • Lad N, Daveshwar M (2019) Histopathological study of lung biopsy in association with immunohistochemistry. J Evol Med Dent Sci. https://doi.org/10.14260/jemds/2019/779

    Article  Google Scholar 

  • Lee H, Kim J (2016) Segmentation of overlapping cervical cells in microscopic images with superpixel partitioning and cell-wise contour refinement. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp 63–69

  • Liu H (2020) Chapter 3 - rail transit collaborative robot systems. In: Liu H (ed) Robot systems for rail transit applications. Elsevier, pp 89–141. https://doi.org/10.1016/B978-0-12-822968-2.00003-6

    Chapter  Google Scholar 

  • Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3431–3440

  • Luo W, Li Y, Urtasun R, et al (2016) Understanding the effective receptive field in deep convolutional neural networks. In: Lee D, Sugiyama M, Luxburg U et al (eds) Advances in Neural Information Processing Systems vol. 29. https://proceedings.neurips.cc/paper_files/paper/2016/file/c8067ad1937f728f51288b3eb986afaa-Paper.pdf

  • Macenko M, Niethammer M, Marron JS, et al (2009) A method for normalizing histology slides for quantitative analysis. In: 2009 IEEE International Symposium on Biomedical Imaging: from Nano to Macro, IEEE, pp 1107–1110

  • Mangal S, Chaurasia A, Khajanchi A (2020) Convolution neural networks for diagnosing colon and lung cancer histopathological images. arXiv preprint arXiv:2009.03878

  • Masood A, Sheng B, Li P et al (2018) Computer-assisted decision support system in pulmonary cancer detection and stage classification on CT images. J Biomed Inform. https://doi.org/10.1016/j.jbi.2018.01.005

    Article  Google Scholar 

  • Masud M, Sikder N, Nahid AA et al (2021) A machine learning approach to diagnosing lung and colon cancer using a deep learning-based classification framework. Sensors. https://doi.org/10.3390/s21030748

    Article  Google Scholar 

  • Medeiros R, Filho PP, Barata Rodrigues M et al (2020) Lung nodule malignancy classification in chest computed tomography images using transfer learning and convolutional neural networks. Neural Comput Appl. https://doi.org/10.1007/s00521-018-3895-1

    Article  Google Scholar 

  • Mehmood S, Ghazal TM, Khan MA et al (2022) Malignancy detection in lung and colon histopathology images using transfer learning with class selective image processing. IEEE Access 10:25,657-25,668. https://doi.org/10.1109/ACCESS.2022.3150924

    Article  Google Scholar 

  • Nirali L, Daveshwar M (2019) Histopathological study of lung biopsy in association with immunohistochemistry. J Evolution Med Dent Sci 8(48):3609

    Article  Google Scholar 

  • Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66

    Article  Google Scholar 

  • Phoulady HA, Goldgof DB, Hall LO et al (2016) Nucleus segmentation in histology images with hierarchical multilevel thresholding. Med Imaging 9791:280

    Google Scholar 

  • Qureshi H, Sertel O, Rajpoot N et al (2008) Adaptive discriminant wavelet packet transform and local binary patterns for meningioma subtype classification. In: Metaxas D, Axel L, Fichtinger G et al (eds) Medical image computing and computer-assisted intervention - MICCAI 2008. Springer, Berlin, pp 196–204

    Chapter  Google Scholar 

  • Rastogi A (2018) Changing role of histopathology in the diagnosis and management of hepatocellular carcinoma. World J Gastroenterol 24(35):4000–4013. https://doi.org/10.3748/wjg.v24.i35.4000

    Article  Google Scholar 

  • Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 234–241

    Google Scholar 

  • Sertel O, Lozanski G, Shana’ah A et al (2010) Computer-aided detection of centroblasts for follicular lymphoma grading using adaptive likelihood-based cell segmentation. IEEE Trans Biomed Eng 57(10):2613–2616. https://doi.org/10.1109/TBME.2010.2055058

    Article  Google Scholar 

  • Shakeel PM, Burhanuddin M, Desa MI (2020) Automatic lung cancer detection from CT image using improved deep neural network and ensemble classifier. Neural Comput Appl 34:9579

    Article  Google Scholar 

  • Sharma S, Mehra R (2020) Conventional machine learning and deep learning approach for multi-classification of breast cancer histopathology images-a comparative insight. J Digit Imaging 33(3):632–654

    Article  Google Scholar 

  • Shukla K, Tiwari A, Sharma S et al (2017) Classification of histopathological images of breast cancerous and non cancerous cells based on morphological features. Biomed Pharmacol J 10(1):353–366

    Article  Google Scholar 

  • Sirinukunwattana K, Ahmed RS, Tsang YW et al (2016) Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images. IEEE Trans Med Imaging 35(5):1196–1206

    Article  Google Scholar 

  • Sun W, Zheng B, Qian W (2017) Automatic feature learning using multichannel ROI based on deep structured algorithms for computerized lung cancer diagnosis. Comput Biol Med 89:530–539. https://doi.org/10.1016/j.compbiomed.2017.04.006

    Article  Google Scholar 

  • Suresh S, Mohan S (2020) Roi-based feature learning for efficient true positive prediction using convolutional neural network for lung cancer diagnosis. Neural Comput Appl 32(20):15,989-16,009

    Article  Google Scholar 

  • Suzuki S, Be K (1985) Topological structural analysis of digitized binary images by border following. Comput Vis Graph Image Process 30(1):32–46. https://doi.org/10.1016/0734-189X(85)90016-7

    Article  MATH  Google Scholar 

  • Uppada R, Rao SK, Prasad K (2017) Supervised classification of breast cancer malignancy using integrated modified marker controlled watershed approach. In: 2017 IEEE 7th International Advance Computing Conference (IACC), pp 584–589

  • Van Eycke YR, Allard J, Salmon I et al (2017) Image processing in digital pathology: an opportunity to solve inter-batch variability of immunohistochemical staining. Sci Rep 7(1):1–15

    Google Scholar 

  • Veit A, Wilber M, Belongie S (2016) Residual networks behave like ensembles of relatively shallow networks. arXiv preprint arXiv:1605.06431

  • Veta M, van Diest PJ, Kornegoor R et al (2013) Automatic nuclei segmentation in h &e stained breast cancer histopathology images. PLoS ONE 8(7):null. https://doi.org/10.1371/journal.pone.0070221

    Article  Google Scholar 

  • Vu QD, Graham S, Kurc T et al (2019) Methods for segmentation and classification of digital microscopy tissue images. Front Bioeng Biotechnol 7:53. https://doi.org/10.3389/fbioe.2019.00053

    Article  Google Scholar 

  • Win KY, Choomchuay S, Hamamoto K et al (2018) Comparative study on automated cell nuclei segmentation methods for cytology pleural effusion images. J Healthc Eng. https://doi.org/10.1155/2018/9240389

    Article  Google Scholar 

  • Xing F, Xie Y, Yang L (2016) An automatic learning-based framework for robust nucleus segmentation. IEEE Trans Med Imaging 35(2):550–566. https://doi.org/10.1109/TMI.2015.2481436

    Article  Google Scholar 

  • Xu J, Gong L, Wang G et al (2019) Convolutional neural network initialized active contour model with adaptive ellipse fitting for nuclear segmentation on breast histopathological images. J Med Imaging (Bellingham, Wash) 6(1):017,501. https://doi.org/10.1117/1.jmi.6.1.017501

    Article  Google Scholar 

  • Xu R et al (2022) Histopathological tissue segmentation of lung cancer with bilinear cnn and soft attention. Biomed Res Int. https://doi.org/10.1155/2022/7966553

    Article  Google Scholar 

  • Yang X, Li H, Zhou X (2006) Nuclei segmentation using marker-controlled watershed, tracking using mean-shift, and Kalman filter in time-lapse microscopy. IEEE Trans Circuits Syst I Regul Pap 53(11):2405–2414. https://doi.org/10.1109/TCSI.2006.884469

    Article  Google Scholar 

  • Yu KH, Zhang C, Berry GJ et al (2016) Predicting non-small cell lung cancer prognosis by fully automated microscopic pathology image features. Nat Commun 7(1):12,474. https://doi.org/10.1038/ncomms12474

    Article  Google Scholar 

  • Zhang M, Wu T, Bennett KM (2015) Small blob identification in medical images using regional features from optimum scale. IEEE Trans Biomed Eng 62(4):1051–1062. https://doi.org/10.1109/TBME.2014.2360154

    Article  Google Scholar 

Download references

Funding

No funding was received for this research work, or for the preparation of this manuscript.

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Vellore Institute of Technology, Chennai Campus, Chennai, Tamilnadu, 600127, India

    S. M. Jaisakthi

  2. Department of Computer Science and Engineering, Sri Sivasubramaniya Nadar College of Engineering, Chennai, Tamilnadu, 603110, India

    Karthik Desingu, P. Mirunalini, S. Pavya & N. Priyadharshini

Authors
  1. S. M. Jaisakthi
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Karthik Desingu
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. P. Mirunalini
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. S. Pavya
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. N. Priyadharshini
    View author publications

    You can also search for this author inPubMed Google Scholar

Contributions

Experiments and Implementation: KD, PS and PN; Validation: MP and JSM; Manuscript preparation review and editing: MP, JSM and KD. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to P. Mirunalini.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare that are relevant to the content of this article.

Ethical approval

The data that is used in this study is publicly available in https://www.kaggle.com/andrewmvd/lung-and-colon-cancer-histopathological-images. These images were generated from an original sample of HIPAA compliant and validated sources.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jaisakthi, S.M., Desingu, K., Mirunalini, P. et al. A deep learning approach for nucleus segmentation and tumor classification from lung histopathological images. Netw Model Anal Health Inform Bioinforma 12, 22 (2023). https://doi.org/10.1007/s13721-023-00417-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13721-023-00417-2

Keywords