Abstract
Wireless Capsule Endoscopy (WCE) is an imaging technology for diseases related to Gastrointestinal (GI) track. However, due to limited hardware, the spatial resolution of acquired images is usually coarser leading to poor diagnostic quality. To enhance high-frequency details associated to edges, object boundaries, corners, etc., which are required for detection and recognition tasks, High-Resolution (HR) images are usually constructed through software-driven Super-Resolution (SR) techniques. Deep learning-based SR approaches has been frequently explored in the computer-vision community recently to increase the SR picture’s quality. However, the prime barrier associated with the presently available deep learning SR approaches is the usage of supervised training where, LR images are simulated by using known deterioration (for instance, bicubic downsampling) from the acquired HR images. It is apparent that the deep models trained on such LR-HR pair exhibits poor generalization on the real LR observation. On the other hand, it is challenging to collect large clinical datasets consisting of true LR-HR pair for supervised learning. To circumvent this problem, we propose a computationally efficient unsupervised approach for SR task using Generative Adversarial Network (GAN) for WCE images (referred as COMPUSR). The proposed model avoids LR-HR pair and is trained using unsupervised strategy to learn the degradation of LR observation. It is validated on a derivative dataset of the original Kvasir dataset consisting of 10, 000 training samples and reveals considerable improvement over the other state-of-the-art methods on subjective and quantitative evaluations. Remarkably, the proposed approach needs significantly less number of learnable parameters (i.e., 2.4M) and a number of GFLOPS (i.e., 91.56G) than that of other approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Rueda, A., Malpica, N., Romero, E.: Single-image super-resolution of brain MR images using overcomplete dictionaries. Med. Image Anal. 17, 43–63 (2013)
Ahn, N., Yoo, J., Sohn, K.A.: SimUSR: a simple but strong baseline for unsupervised image super-resolution. In: Proceedings of the IEEE/CVF Conference on CVPR Workshop, pp. 474–475 (2020)
Dong, C., Loy, C.C., Tang, X.: Accelerating the super-resolution convolutional neural network. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 391–407. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_25
Gatys, L.A., Ecker, A.S., Bethge, M.: Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks. CoRR abs/1505.07376 (2015). http://arxiv.org/abs/1505.07376
Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on CVPR, pp. 1125–1134 (2017)
Kim, J., Lee, J.K., Lee, K.M.: Accurate image super-resolution using very deep convolutional networks. In: Proceedings of the IEEE Conference on CVPR, pp. 1646–1654 (2016)
Kim, J., Lee, J.K., Lee, K.M.: Deeply-recursive convolutional network for image super-resolution. In: Proceedings of the IEEE Conference on CVPR, pp. 1637–1645 (2016)
Lim, B., Son, S., Kim, H., Nah, S., Mu Lee, K.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on CVPR Workshops, pp. 136–144 (2017)
Liu, Z.S., Siu, W.C., Wang, L.W., Li, C.T., Cani, M.P.: Unsupervised real image super-resolution via generative variational autoencoder. In: Proceedings of the IEEE/CVF CVPR Workshops, pp. 442–443 (2020)
Lu, Z., Liu, H., Li, J., Zhang, L.: Efficient transformer for single image super-resolution. CoRR abs/2108.11084 (2021). https://arxiv.org/abs/2108.11084
Lugmayr, A., Danelljan, M., Timofte, R.: NTIRE 2020 challenge on real-world image super-resolution: methods and results. In: Proceedings of the IEEE/CVF Conference on CVPR Workshops, pp. 494–495 (2020)
Fritsche, M., Gu, S., Timofte, R.: Frequency separation for real-world super-resolution. In: Proceedings of the IEEE/CVF ICCVW, vol. 14, pp. 3599–3608 (2019)
Häfner, M., M.L., Uhl, A.: POCS-based super-resolution for HD endoscopy video frames. In: Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems (2013). IEEE
Mahapatra, D., Bozorgtabar, B.: Image super-resolution using progressive generative adversarial networks for medical image analysis. Comput. Med. Imaging Graph. 71 (2018)
Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., Smolley, S.P.: Least squares generative adversarial networks. In: 2017 IEEE-ICCV, pp. 2813–2821 (2017)
Mittal, A., Moorthy, A.K., Bovik, A.C.: Blind/referenceless image spatial quality evaluator. In: 2011 Conference Record of the Forty Fifth ASILOMAR, pp. 723–727 (2011)
Prajapati, K., et al.: Direct unsupervised super-resolution using generative adversarial network (DUS-GAN) for real-world data. IEEE TIP 30, 8251–8264 (2021)
Prajapati, K., et al.: Unsupervised single image super-resolution network (USISResNet) for real-world data using generative adversarial network. In: Proceedings of the IEEE/CVF Conference on CVPR Workshops, pp. 464–465 (2020)
Tong, T., Li, G., Liu, X., Gao, Q.: Image super-resolution using dense skip connections. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 4809–4817 (2017). https://doi.org/10.1109/ICCV.2017.514
Umer, R.M., Foresti, G.L., Micheloni, C.: Deep generative adversarial residual convolutional networks for real-world super-resolution. In: Proceedings of the IEEE/CVF Conference on CVPR Workshops, pp. 438–439 (2020)
Venkatanath, N., Praneeth, D., Bh, M.C., Channappayya, S.S., Medasani, S.S.: Blind image quality evaluation using perception based features. In: 2015 Twenty First NCC. pp. 1–6 (2015)
Wang, L., Wang, Y., Dong, X., Xu, Q., Yang, J., An, W., Guo, Y.: Unsupervised degradation representation learning for blind super-resolution. In: Proceedings of the IEEE/CVF Conference on CVPR. pp. 10581–10590 (2021)
Acknowledgment
Authors are thankful to Research Council of Norway (RCN) for International Network for Capsule Imaging in Endoscopy (CapsNetwork) project managed by Department of computer science, Norwegian University of Science and technology (NTNU), Norway for providing support for this research work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Saha, N., Sarvaiya, A., Upla, K., Raja, K., Pedersen, M. (2024). COMPUSR: Computationally Efficient Unsupervised Super-Resolution Approach for Wireless Capsule Endoscopy. In: Kaur, H., Jakhetiya, V., Goyal, P., Khanna, P., Raman, B., Kumar, S. (eds) Computer Vision and Image Processing. CVIP 2023. Communications in Computer and Information Science, vol 2010. Springer, Cham. https://doi.org/10.1007/978-3-031-58174-8_38
Download citation
DOI: https://doi.org/10.1007/978-3-031-58174-8_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-58173-1
Online ISBN: 978-3-031-58174-8
eBook Packages: Computer ScienceComputer Science (R0)