Abstract
Ovarian cancer has the sixth-largest fatality rate in the United States among all cancers. A non-surgical assay capable of detecting ovarian cancer with acceptable sensitivity and specificity has yet to be developed. However, such a discovery would profoundly impact the pace of the treatment and improvement to patients’ quality of life. Achieving such a solution requires high-quality imaging, image processing, and machine learning to support an acceptably robust automated diagnosis. In this work, we propose an automated framework that learns to identify ovarian cancer in transgenic mice from optical coherence tomography (OCT) recordings. Classification is accomplished using a neural network that perceives spatially ordered sequences of tomograms. We present three neural network-based approaches, namely a VGG-supported feed-forward network, a 3D convolutional neural network, and a convolutional LSTM (Long Short-Term Memory) network. Our experimental results show that our models achieve a favorable performance with no manual tuning or feature crafting, despite the challenging noise inherent in OCT images. Specifically, our best performing model, the convolutional LSTM-based neural network, achieves a mean AUC (± standard error) of 0.81 ± 0.037. To the best of the authors’ knowledge, no application of machine learning to analyze depth-resolved OCT images of whole ovaries has been documented in the literature. A significant broader impact of this research is the potential transferability of the proposed diagnostic system from transgenic mice to human organs, which would enable medical intervention from early detection of an extremely deadly affliction.






Similar content being viewed by others
Data availability
Data will be made available upon request.
Code availability
Source code can be found at https://github.com/dmschwar/OCT-based-OCD.
References
US Cancer Statistics Working Group, “US cancer statistics data visualizations tool, based on november 2018 submission data (1999-2016): US Department of Health and Human services, Centers for Disease Control and Prevention and National Cancer Institute,” Centers for Disease Control and Prevention and National Cancer Institute, 2019
Buys SS, Partridge E, Black A, Johnson CC, Lamerato L, Isaacs C, Reding DJ, Greenlee RT, Yokochi LA, Kessel B et al (2011) Effect of screening on ovarian cancer mortality: the prostate, lung, colorectal and ovarian (plco) cancer screening randomized controlled trial. Jama 305(22):2295–2303
Swanson Ea, Izatt Ja, Hee MR, Huang D, Lin CP, Schuman JS, Puliafito Ca, Fujimoto JG (1993) In vivo retinal imaging by optical coherence tomography. Opt Lett 18(21):1864–6
Hee MR, Izatt JA, Swanson EA, Huang D, Schuman JS, Lin CP, Puliafito CA, Fujimoto JG (1995) Optical coherence tomography of the human retina. Arch Ophthalmol 113(3):325
Abràmoff M, Garvin MK, Sonka M (2010) Retinal imaging and image analysis. IEEE Rev Biomed Eng 1(3):169–208
Tsuboi M, Hayashi A, Ikeda N, Honda H, Kato Y, Ichinose S, Kato H (2005) Optical coherence tomography in the diagnosis of bronchial lesions. Lung Cancer 49(3):387–394
Otte S, Otte C, Schlaefer A, Wittig L, Hüttmann G, Dromann D, Zeli A (2013) “OCT A-Scan based lung tumor tissue classification with Bidirectional Long Short Term Memory networks,” In 2013 IEEE International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6
Lightdale CJ (2013) Optical coherence tomography in Barrett’s esophagus. Gastrointest Endosc Clin N Am 23(3):549–563
Ferrante G, Presbitero P, Whitbourn R, Barlis P (2013) “Current applications of optical coherence tomography for coronary intervention”
Abdolmanafi A, Duong L, Dahdah N, Cheriet F (2017) Deep feature learning for automatic tissue classification of coronary artery using optical coherence tomography. Biomed Opt Express 8(2):1203
Hariri LP, Liebmann ER, Marion SL, Hoyer PB, Davis JR, Brewer MA, Barton JK (2010) Simultaneous optical coherence tomography and laser induced fluorescence imaging in rat model of ovarian carcinogenesis. Cancer Biol Ther 10(5):438–447
Wang T (2015) An overview of optical coherence tomography for ovarian tissue imaging and characterization. Wiley Interdiscip Rev Nanomed Nanobiotechnol 7(1):1–16
Drexler W, Liu M, Kumar A, Kamali T, Unterhuber A, Leitgeb RA (2014) Optical coherence tomography today: speed, contrast, and multimodality. J Biomed Opt 19(7):071412
Schmitt J (1999) Optical Coherence Tomography (OCT): a review. IEEE J Sel Top Quantum Electron 5(4):1205–1215
Sawyer T, Chandra S, Rice P, Koevary J, Barton J (2018) Three-dimensional texture analysis of optical coherence tomography images of ovarian tissue. Phys Med Biol 63:23
Welge WA, DeMarco AT, Watson JM, Rice PS, Barton JK, Kupinski MA (2014) Diagnostic potential of multimodal imaging of ovarian tissue using optical coherence tomography and second-harmonic generation microscopy. J Med Imag 1(2):025501
Brewer Ma, Utzinger U, Barton JK, Hoying JB, Kirkpatrick ND, Brands WR, Davis JR, Hunt K, Stevens SJ, Gmitro AF (2004) Imaging of the ovary. Technol Cancer Res Treat 3(6):617–627
Watanabe Y, Takakura K, Kurotani R, Abe H, Atanabe YUW, Akakura KEIT, Urotani REK (2015) Optical coherence tomography imaging for analysis of follicular development in ovarian tissue. App Opt 54(19):6111
Sawyer TW, Rice PF, Sawyer DM, Koevary JW, Barton JK (2018) Evaluation of segmentation algorithms for optical coherence tomography images of ovarian tissue. Diagn Treat Dis Breast Reprod Syst IV 10472:1047204
Alakwaa W, Nassef M, Badr A (2017) Lung cancer detection and classification with 3d convolutional neural network (3d-cnn). Lung Cancer 8(8):409
S. Xingjian, Z. Chen, H. Wang, D.-Y. Yeung, W.-K. Wong, and W.-c. Woo (2015) “Convolutional lstm network: A machine learning approach for precipitation nowcasting,” In Advances in neural information processing systems, 802–810
Gossage KW, Tkaczyk TS, Rodriguez JJ, Barton JK (2003) Texture analysis of optical coherence tomography images: feasibility for tissue classification. J Biomed Opt 8(3):570–575
Miller P, Astley S (1992) Classification of breast tissue by texture analysis. Image Vis Comput 10(5):277–282
Mostaço-Guidolin LB, Ko AC-T, Wang F, Xiang B, Hewko M, Tian G, Major A, Shiomi M, Sowa MG (2013) Collagen morphology and texture analysis: from statistics to classification. Sci Rep 3(1):2190
Ran AR, Tham CC, Chan PP, Cheng C-Y, Tham Y-C, Rim TH, Cheung CY (2020) “Deep learning in glaucoma with optical coherence tomography: a review,” Eye
Burgansky-Eliash Z, Wollstein G, Chu T, Ramsey JD, Glymour C, Noecker RJ, Ishikawa H, Schuman JS (2005) Optical coherence tomography machine learning classifiers for glaucoma detection: a preliminary study. Invest Ophthalmol Vis Sci 46(11):4147–52
Yanagihara RT, Lee CS, Ting DSW, Lee AY (2020) Methodological challenges of deep learning in optical coherence tomography for retinal diseases: a review. Trans Vision Sci Technol 9:11–2
Rahimy E (2018) Deep learning applications in ophthalmology. Current Opin Ophthalmol 29(3):254–260
Ditzler G, Bouaynaya N, Fathallah Shaykh HM (2019) Sparse kalman filtering for time-varying networks. BMC BioData Min 12:1–14
Ditzler G, Bouaynaya N, Shterenberg R (2018) AKRON: an algorithm for approximating sparse kernel reconstruction. Signal Process 144:265–270
Johri A, Tripathi A (2019) et al., “Parkinson disease detection using deep neural networks,” In 2019 Twelfth International Conference on Contemporary Computing (IC3), pp. 1–4, IEEE
Yasir R, Rahman MA, Ahmed N (2014) “Dermatological disease detection using image processing and artificial neural network,” In 8th International Conference on Electrical and Computer Engineering, pp. 687–690, IEEE
Lee J, Prabhu D, Kolluru C, Gharaibeh Y, Zimin VN, Bezerra HG, Wilson DL (2019) Automated plaque characterization using deep learning on coronary intravascular optical coherence tomographic images. Biomed Opt Express 10:6497–6515, 11
Lee J, Prabhu D, Kolluru C, Gharaibeh Y, Zimin VN, Dallan LAP, Bezerra HG, Wilson DL (2020) Fully automated plaque characterization in intravascular OCT images using hybrid convolutional and lumen morphology features. Sci Rep 10:2596
He C, Li Z, Wang J, Huang Y, Yin Y, Li Z (2020) “Atherosclerotic Plaque Tissue Characterization: An OCT-Based Machine Learning Algorithm With ex vivo Validation ”
Nour M, Cömert Z, Polat K (2020) A novel medical diagnosis model for covid-19 infection detection based on deep features and bayesian optimization. Appl Soft Comput 97:106580
Weiss K, Khoshgoftaar TM, Wang D (2016) A survey of transfer learning. J Big Data 3(1):1–40
Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) Imagenet large scale visual recognition challenge. Int J Comput Vision 115(3):211–252
Connolly DC, Bao R, Nikitin AY, Stephens KC, Poole TW, Hua X, Harris SS, Vanderhyden BC, Hamilton TC (2003) Female mice chimeric for expression of the simian virus 40 TAg under control of the MISIIR promoter develop epithelial ovarian cancer. Cancer Res. 63(6):1389–1397
Quinn BA, Xiao F, Bickel L, Martin L, Hua X, Klein-Szanto A, Connolly DC (2010) Development of a syngeneic mouse model of epithelial ovarian cancer. J Ovarian Res 3(1):24
Watson JM, Rice PF, Marion SL, Bentley DL, Brewer MA, Utzinger U, Hoyer PB, Barton JK (2011) Multi-modality optical imaging of ovarian cancer in a post-menopausal mouse model. In: Advanced biomedical and clinical diagnostic systems IX, vol 7890. International Society for Optics and Photonics, p 78900W
Sawyer T, Koevary J, Rice F, Howard C, Austin O, Connolly D, Cai K, Barton J (2019) Quantification of multiphoton and fluorescence images of reproductive tissues from a mouse ovarian cancer model shows promise for early disease detection. J Biomed Opt 24(9):096010
LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324
Jaworek-Korjakowska J, Kleczek P, Gorgon M (2019) “Melanoma thickness prediction based on convolutional neural network with vgg-19 model transfer learning,” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 0–0
Simonyan K, Zisserman A (2014) “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv:1409.1556
Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) “Imagenet: A large-scale hierarchical image database,” In 2009 IEEE conference on computer vision and pattern recognition, pp. 248–255, Ieee
Xiang EW, Cao B, Hu DH, Yang Q (2010) Bridging domains using world wide knowledge for transfer learning. IEEE Trans Knowl Data Eng 22(6):770–783
Pan S, Tsang I, Kwok J, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210
Schweikert G, Widmer C, Schölkopf B, Rätsch G (2008) An empirical analysis of domain adaptation algorithms for genomic sequence analysis. In: NIPS, vol 8. Citeseer, pp 1433–1440
Ahmed A, Yu K, Xu W, Gong Y, Xing E (2008) “Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks,” In European Conference on Computer Vision, pp. 69–82
Guo J, Liang Z, Scribner E, Ditzler G, Bouaynaya N, Fathallah-Shaykh H (2018) “Nonlinear brain tumor model estimation with long short-term memory neural networks,” In IEEE/INNS International Joint Conference on Neural Networks
Zhang Z, Sabuncu M (2018) “Generalized cross entropy loss for training deep neural networks with noisy labels,” In Advances in neural information processing systems, pp. 8778–8788
Wang Y, Ma X, Chen Z, Luo Y, Yi J, Bailey J (2019) “Symmetric cross entropy for robust learning with noisy labels,” In Proceedings of the IEEE International Conference on Computer Vision, pp. 322–330
Gers FA, Schmidhuber J, Cummins F (1999) “Learning to forget: Continual prediction with lstm,” 1999 Ninth International Conference on Artificial Neural Networks ICANN 99. (Conf. Publ. No. 470)
Luo W, Liu W, Gao S (2017) “Remembering history with convolutional lstm for anomaly detection,” In 2017 IEEE International Conference on Multimedia and Expo (ICME), pp. 439–444, IEEE
Graves A, Fernández S, Schmidhuber J (2005) “Bidirectional lstm networks for improved phoneme classification and recognition,” In International Conference on Artificial Neural Networks, pp. 799–804, Springer
Clevert D-A, Unterthiner T, Hochreiter S (2015) “Fast and accurate deep network learning by exponential linear units (elus),” arXiv preprint arXiv:1511.07289
Mehta D, Rhodin H, Casas D, Fua P, Sotnychenko O, Xu W, Theobalt C (2017) “Monocular 3d human pose estimation in the wild using improved cnn supervision,” In 2017 international conference on 3D vision (3DV), pp. 506–516, IEEE
Ren X, Xiang L, Nie D, Shao Y, Zhang H, Shen D, Wang Q (2018) Interleaved 3d-cnn s for joint segmentation of small-volume structures in head and neck ct images. Med Phys 45(5):2063–2075
Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958
Dozat T (2016) “Incorporating nesterov momentum into adam,” International Conference on Learning Representations (ICLR)
Santurkar S, Tsipras D, Ilyas A, Madry A (2018) “How does batch normalization help optimization,” In Advances in Neural Information Processing Systems, pp. 2483–2493
Zeile MD (2012) “Adadelta: an adaptive learning rate method,” arXiv preprint arXiv:1212.5701
Ruder S (2016) “An overview of gradient descent optimization algorithms,” arXiv preprint arXiv:1609.04747
Grossberg S (1988) Nonlinear neural networks: principles, mechanisms, and architectures. Neural Netw 1(1):17–61
Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27:861–874
Sawyer TW, Koevary JW, Howard CC, Austin OJ, Rice PF, Hutchens GV, Chambers SK, Connolly DC, Barton JK (2020) Fluorescence and multiphoton imaging for tissue characterization of a model of postmenopausal ovarian cancer. Lasers Surg Med 52(10):993–1009
Sawyer TW, Rice FF, Koevary JW, Connolly DC, Cai KQ, Barton JK (2019) In vivo multiphoton imaging of an ovarian cancer mouse model. Dis Breast Reprod Syst V 10856:1085605
Sawyer TW, Chandra S, Rice PF, Koevary JW, Barton JK (2018) Three-dimensional texture analysis of optical coherence tomography images of ovarian tissue. Phys Med Biol 63(23):235020
Nandy S, Sanders M, Zhu Q (2016) Classification and analysis of human ovarian tissue using full field optical coherence tomography. Biomed Opt Express 7(12):5182–5187
Zhang Z, Bast RC, Yu Y, Li J, Sokoll LJ, Rai AJ, Rosenzweig JM, Cameron B, Wang YY, Meng X-Y et al (2004) Three biomarkers identified from serum proteomic analysis for the detection of early stage ovarian cancer. Cancer Res 64(16):5882–5890
Funding
This material is based upon work supported by the National Science Foundation (NSF) Graduate Research Fellowship Program under Grant No. DGE-1143953; NSF CAREER #1943552; Department of Energy #DE-NA0003946; National Institutes of Health under National Cancer Institute #1R01CA195723; and the shared resources of the University of Arizona Cancer Center #3P30CA023074. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the sponsors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors have no conflicts of interest to report.
Ethical approval
All experiments were performed per NIH guidelines, and protocols were approved by the University of Arizona Institutional Animal Care and Use Committee under protocol 06-183.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Schwartz, D., Sawyer, T.W., Thurston, N. et al. Ovarian cancer detection using optical coherence tomography and convolutional neural networks. Neural Comput & Applic 34, 8977–8987 (2022). https://doi.org/10.1007/s00521-022-06920-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-06920-3