Yufeng Xia
ABSTRACT
Iris images under the surveillance scenario are often low-quality, which makes the iris recognition challenging. Recently, deep learning-based methods are adopted to enhance the quality of iris images and achieve remarkable performance. However, these methods ignore the characteristics of the iris texture, which is important for iris recognition. In order to restore richer texture details, we propose a super-resolution network based on Wavelet with Transformer and Residual Attention Network (WTRAN). Specifically, we treat the low-resolution images as the low-frequency wavelet coefficients after wavelet decomposition and predict the corresponding high-frequency wavelet coefficients sequence. In order to extract detailed local features, we adopt both channel and spatial attention, and propose a Residual Dense Attention Block (RDAB). Furthermore, we propose a Convolutional Transformer Attention Module (CTAM) to integrate transformer and CNN to extract both the global topology and local texture details. In addition to constraining the quality of image generation, effective identity preserving constraints are also used to ensure the consistency of the super-resolution images in the high-level semantic space. Extensive experiments show that the proposed method has achieved competitive iris image super resolution results compared with the most advanced super-resolution method.
- Dong, C.; Loy, C. C.; He, K.; and Tang, X. 2015. Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence, 38(2): 295–307.Google Scholar
- Kim, J.; Lee, J. K.; and Lee, K. M. 2016. Accurate Image Super-Resolution Using Very Deep Convolutional Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)Google Scholar
- Lim, B.; Son, S.; Kim, H.; Nah, S.; and Mu Lee, K. 2017. Enhanced Deep Residual Networks for Single Image Super-Resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.Google ScholarCross Ref
- Zhang, Y.; Li, K.; Li, K.; Wang, L.; Zhong, B.; and Fu, Y. 2018b. Image super-resolution using very deep residual channel attention networks. In Proceedings of the European conference on computer vision (ECCV), 286–301.Google Scholar
- Dai, T.; Cai, J.; Zhang, Y.; Xia, S.-T.; and Zhang, L. 2019. Second-Order Attention Network for Single Image Super-Resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)Google Scholar
- Anwar, S.; and Barnes, N. 2020. Densely residual Laplacian super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence.Google Scholar
- Niu, B.; Wen, W.; Ren, W.; Zhang, X.; Yang, L.; Wang, S.; Zhang, K.; Cao, X.; and Shen, H. 2020. Single image super-resolution via a holistic attention network. In Proceedings of the European conference on computer vision (ECCV), 191–207. Springer.Google Scholar
- Huang, H.; He, R.; Sun, Z.; and Tan, T. 2017. Wavelet-srnet: A wavelet-based cnn for multi-scale face super resolution. In Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1689–1697.Google Scholar
- Alonso-Fernandez, F.; Farrugia, R. A.; and Bigun, J. 2016. Very low-resolution iris recognition via Eigen-patch super-resolution and matcher fusion. In 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS), 1–8. IEEE.Google Scholar
- Alonso-Fernandez, F.; Farrugia, R. A.; and Bigun, J. 2017. Iris super-resolution using iterative neighbor embedding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 153–161.Google Scholar
- Aljadaany, R.; Luu, K.; Venugopalan, S.; and Savvides, M. 2015. Iris super-resolution via nonparametric over-complete dictionary learning. In 2015 IEEE International Conference on Image Processing (ICIP), 3856–3860. IEEE.Google Scholar
- Zhang, Q.; Li, H.; He, Z.; and Sun, Z. 2016. Image super-resolution for mobile iris recognition. In Chinese Conference on Biometric Recognition, 399–406. SpringerGoogle Scholar
- Ribeiro, E.; Uhl, A.; Alonso-Fernandez, F.; and Farrugia, R. A.2017. Exploring deep learning image super-resolution for iris recognition. In 2017 25th European Signal Processing Conference (EUSIPCO), 2176–2180. IEEE.Google Scholar
- Ribeiro, E.; and Uhl, A. 2017. Exploring texture transfer learning via convolutional neural networks for iris super resolution. In 2017 International Conference of the Biometrics Special Interest Group (BIOSIG), 1–5. IEEE.Google Scholar
- Guo, Y.; Wang, Q.; Huang, H.; Zheng, X.; and He, Z. 2019. Adversarial iris super resolution. In 2019 International Conference on Biometrics (ICB), 1–8. IEEE.Google Scholar
- Wang, X.; Zhang, H.; Liu, J.; Xiao, L.; He, Z.; Liu, L.; and Duan ,P. 2019. Iris Image Super Resolution Based on GANs with Adversarial Triplets. In Chinese Conference on Biometric Recognition,346–353. Springer.Google Scholar
- Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.;Gomez, A. N.; Kaiser, Ł.; and Polosukhin, I. 2017. Attention is all you need. In Advances in neural information processing systems, 5998–6008.Google Scholar
- Parmar, N.; Vaswani, A.; Uszkoreit, J.; Kaiser, L.; Shazeer, N.; Ku,A.; and Tran, D. 2018. Image transformer. In International Conference on Machine Learning, 4055–4064. PMLR.Google Scholar
- Dosovitskiy, A.; Beyer, L.; Kolesnikov, A.; Weissenborn, D.;Zhai, X.; Unterthiner, T.; Dehghani, M.; Minderer, M.; Heigold, G.; Gelly, S.; 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929.Google Scholar
- Yang, F.; Yang, H.; Fu, J.; Lu, H.; and Guo, B. 2020. Learning texture transformer network for image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 5791–5800.Google Scholar
- Chen, H.; Wang, Y.; Guo, T.; Xu, C.; Deng, Y.; Liu, Z.; Ma, S.; Xu, C.; Xu, C.; and Gao, W. 2021. Pre-trained image processing transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 12299–12310.Google Scholar
- Wu, H.; Xiao, B.; Codella, N.; Liu, M.; Dai, X.; Yuan, L.; and Zhang, L. 2021. Cvt: Introducing convolutions to vision transformers. arXiv preprint arXiv:2103.15808.Google Scholar
- Peng, Z.; Huang, W.; Gu, S.; Xie, L.; Wang, Y.; Jiao, J.; and Ye, Q. 2021. Conformer: Local Features Coupling Global Representations for Visual Recognition. arXiv preprint arXiv:2105.03889.Google Scholar
- Zhang, Y.; Tian, Y.; Kong, Y.; Zhong, B.; and Fu, Y. 2018c. Residual dense network for image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2472–2481.Google Scholar
- Shi, W.; Caballero, J.; Huszar, F.; Totz, J.; Aitken, A. P.; Bishop, ´R.; Rueckert, D.; and Wang, Z. 2016. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1874–1883.Google Scholar
- Zhang, X.; Zhou, X.; Lin, M.; and Sun, J. 2018a. Shufflenet: An extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE conference on computer vision and pattern recognition, 6848–6856.Google Scholar
- Hu, J.; Shen, L.; Albanie, S.; Sun, G.; and Wu, E. 2019. Squeezeand-Excitation Networks. arXiv:1709.01507.Google Scholar
- Kashihara, K. 2020. Iris recognition for biometrics based on CNN with super-resolution GAN. In 2020 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS), 1–6. IEEE.Google ScholarCross Ref
- Zhao, H.; Gallo, O.; Frosio, I.; and Kautz, J. 2015. Loss functions for neural networks for image processing. arXiv preprint arXiv:1511.08861.Google Scholar
- Deng, J.; Guo, J.; Xue, N.; and Zafeiriou, S. 2019. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4690–4699.Google Scholar
- Othman, N.; Dorizzi, B.; and Garcia-Salicetti, S. 2016. OSIRIS:An open source iris recognition software. Pattern Recognition Letters, 82: 124–131.Google ScholarDigital Library
- Wei, Z.; Tan, T.; Sun, Z.; and Cui, J. 2006. Robust and fast assessment of iris image quality. In International Conference on Biometrics, 464–471. Springer.Google Scholar
- Li, X.; Sun, Z.; and Tan, T. 2011. Comprehensive assessment of iris image quality. In 2011 18th IEEE International Conference on Image Processing, 3117–3120. IEEE.Google Scholar
- Paszke, A.; Gross, S.; Massa, F.; Lerer, A.; Bradbury, J.; Chanan,G.; Killeen, T.; Lin, Z.; Gimelshein, N.; Antiga, L.; 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32:8026–8037Google Scholar
- Chinese Academy of Sciences Institute of Automation, CASIA iris image database, http://biometrics.idealtest.org/, 2014.Google Scholar
- Hierarchical Iris Image Super Resolution based on Wavelet Transform
Recommendations
Super-Resolution Image Reconstruction Using Wavelet Based Patch and Discrete Wavelet Transform
This paper proposes a novel method that combines the discrete wavelet transform (DWT) and example-based technique to reconstruct a high-resolution from a low-resolution image. Although previous interpolation- and example-based methods consider the ...
Image Resolution Enhancement Using Lifting Wavelet and Stationary Wavelet Transform
ICESC '14: Proceedings of the 2014 International Conference on Electronic Systems, Signal Processing and Computing TechnologiesThis paper presents a technique for enhancing resolution of images by interpolating high frequency sub-bands generated using lifting wavelet transform (LWT) and spatial information of input low resolution (LR) image. Stationary wavelet transform (SWT) ...
Feature-domain super-resolution for iris recognition
Uncooperative iris identification systems at a distance suffer from poor resolution of the acquired iris images, which significantly degrades iris recognition performance. Super-resolution techniques have been employed to enhance the resolution of iris ...
Comments