Abstract
Endoscopy is a standard method for the diagnosis and detection of colorectal lesions. As a method to enhance the detectability of lesions, the effectiveness of pancolonic chromoendoscopy with indigocarmine has been reported. On the other hand, computer-aided diagnosis (CAD) has attracted attention. However, existing CAD systems are mainly for white light imaging (WLI) endoscopy, and the effect of the combination of CAD and indigocarmine dye spraying is not clear. Besides, it is difficult to gather a lot of indigocarmine dye-sprayed (IC) images for training. Here, we propose image-to-image translation from WLI to virtual indigocarmine dye-sprayed (VIC) images based on unpaired cycle-consistent Generative Adversarial Networks. Using this generator as preprocess part, we constructed detection models to evaluate the effectiveness of VIC translation for localization and classification of lesions. We also compared the localization and classification performance with and without image augmentation by using generated VIC images. Our results show that the model trained on IC and VIC images had the highest performance in both localization and classification. Therefore, VIC images are useful for the augmentation of IC images.
A. Fukuda and T. Miyamoto—Contributed equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adler, A., Pohl, H., Papanikolaou, I.S., et al: A prospective randomized study on narrow-band imaging versus conventional colonoscopy for adenoma detection: does NBI induce a learning effect? Gut 57 (2008)
Ahn, S.B., Han, D.S., Bae, J.H., et al.: The miss rate for colorectal adenoma determined by quality-adjusted, back-to-back colonoscopies. Gut Liver 6, 64–70 (2012)
Brooker, J.C., Saunders, B.P., Shah, S.G., et al.: Total colonic dye-spray increases the detection of diminutive adenomas during routine colonoscopy: a randomized controlled trial. Gastrointest. Endosc. 56, 333–338 (2002)
Corley, D., Jensen, C., Marks, A., et al.: Adenoma detection rate and risk of colorectal cancer and death. N. Engl. J. Med. 370, 2541 (2014)
Engelhardt, S., De Simone, R., Full, P.M., et al.: Improving surgical training phantoms by hyperrealism: deep unpaired image-to-image translation from real surgeries. arXiv pre-prints arXiv:1806.03627 (2018)
Isola, P., Zhu, J., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. arXiv preprint arXiv:1611.07004 (2016)
Kaminski, M., Regula, J., Kraszewska, E., et al: Quality indicators for colonoscopy and the risk of interval cancer. N. Engl. J. Med. 362 (2010)
Ki Min, J., Kwak, M., Myung Cha, J.: Overview of deep learning in gastrointestinal endoscopy. Gut Liver 13(4), 388–393 (2019)
Kumar, S., Thosani, N., Ladabaum, U., et al.: Adenoma miss rates associated with a 3-minute versus 6-minute colonoscopy withdrawal time: a prospective, randomized trial. Gastrointest. Endosc. 85, 1273–1280 (2017)
Mori, Y., Kudo, S.E., Berzin, T.M., et al.: Computer-aided diagnosis for colonoscopy. Endoscopy 49, 813–819 (2017)
Pohl, J., Lotterer, E., Balzer, C., et al.: Computed virtual chromoendoscopy versus standard colonoscopy with targeted indigocarmine chromoscopy: a randomised multicentre trial. Gut 58, 73–78 (2009)
Pohl, J., Schneider, A., Vogell, H., et al.: Pancolonic chromoendoscopy with indigo carmine versus standard colonoscopy for detection of neoplastic lesions: a randomised two-centre trial. Gut 60, 485–490 (2011)
Redmon, J., Farhadi, A.: YoLov3: an incremental improvement. arXiv preprint arXiv:1804.02767 (2018)
Repici, A., Wallace, M.B., East, J.E., et al.: Efficacy of per-oral methylene blue formulation for screening colonoscopy\(^{\rm a}\). Gastroenterology S0016–5085(19), 2198–2207 (2019)
Rex, D.K., Helbig, C.C.: High yields of small and flat adenomas with high-definition colonoscopes using either white light or narrow band imaging. Gastroenterology 133, 42–47 (2007)
Urban, G., Tripathi, P., Alkayali, T., et al.: Deep learning localizes and identifies polyps in real time with 96% accuracy in screening colonoscopy. Gastroenterology 155, 1069–1078 (2018)
Wang, P., Xiao, X., Glissen Brown, J.R., et al.: Development and validation of a deep-learning algorithm for the detection of polyps during colonoscopy. Nat. Biomed. Eng. 2, 741–748 (2018)
Yi, Z., Zhang, H., Tan, P., et al.: DualGAN: unsupervised dual learning for image-to-image translation. arXiv preprint arXiv:1704.02510 (2017)
Zhong, Z., Zheng, L., Kang, G., et al.: Random erasing data augmentation. arXiv preprint arXiv:1708.04896 (2017)
Zhu, J., Park, T., Isola, P., et al.: Unpaired image-to-image translation using cycle-consistent adversarial networks. arXiv preprint arXiv:1703.10593 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Fukuda, A., Miyamoto, T., Kamba, S., Sumiyama, K. (2019). Generating Virtual Chromoendoscopic Images and Improving Detectability and Classification Performance of Endoscopic Lesions. In: Wang, Q., et al. Domain Adaptation and Representation Transfer and Medical Image Learning with Less Labels and Imperfect Data. DART MIL3ID 2019 2019. Lecture Notes in Computer Science(), vol 11795. Springer, Cham. https://doi.org/10.1007/978-3-030-33391-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-33391-1_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33390-4
Online ISBN: 978-3-030-33391-1
eBook Packages: Computer ScienceComputer Science (R0)
