Abstract
Fingerprint recognition is one of the most popular biometric technologies. Touchless fingerprint systems do not require contact of the finger with the surface of a capture device. For this reason, they provide an increased level of hygiene, usability, and user acceptance compared to touch-based capturing technologies. Most processing steps of the recognition workflow of touchless recognition systems differ in comparison to touch-based biometric techniques. Especially the segmentation of the fingerprint areas in a 2D capturing process is a crucial and more challenging task.
In this work a proposal of a fingertip segmentation using deep learning techniques is presented. The proposed system allows to submit the segmented fingertip areas from a finger image directly to the processing pipeline. To this end, we adapt the deep learning model DeepLabv3+ to the requirements of fingertip segmentation and trained it on the database for hand gesture recognition (HGR) by extending it with a fingertip ground truth. Our system is benchmarked against a well-established color-based baseline approach and shows more accurate hand segmentation results especially on challenging images. Further, the segmentation performance on fingertips is evaluated in detail. The gestures provided in the database are separated into three categories by their relevance for the use case of touchless fingerprint recognition. The segmentation performance in terms of Intersection over Union (IoU) of up to 68.03% on the fingertips (overall: 86.13%) in the most relevant category confirms the soundness of the presented approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Birajadar, P., et al.: Touch-less fingerphoto feature extraction, analysis and matching using monogenic wavelets. In: 2016 International Conference on Signal and Information Processing (IConSIP), pp. 1–6, October 2016
Chen, L.C., Papandreou, G., Schroff, F., Adam, H.: Rethinking Atrous convolution for semantic image segmentation. arXiv preprint arXiv:1706.05587 (2017)
Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with Atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)
Everingham, M., Eslami, S.A., Van Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The Pascal visual object classes challenge: a retrospective. Int. J. Comput. Vis. 111(1), 98–136 (2015)
Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., Martinez-Gonzalez, P., Garcia-Rodriguez, J.: A survey on deep learning techniques for image and video semantic segmentation. Appl. Soft Comput. 70, 41–65 (2018)
Ghosh, S., Das, N., Das, I., Maulik, U.: Understanding deep learning techniques for image segmentation. ACM Comput. Surv. (CSUR) 52(4), 1–35 (2019)
Grzejszczak, T., Kawulok, M., Galuszka, A.: Hand landmarks detection and localization in color images. Multimed. Tools Appl. 75(23), 16363–16387 (2016)
Hiew, B.Y., Teoh, A.B.J., Ngo, D.C.L.: Automatic digital camera based fingerprint image preprocessing. In: International Conference on Computer Graphics, Imaging and Visualisation (CGIV 2006), pp. 182–189, July 2006
Jain, A.K., Flynn, P., Ross, A.A.: Handbook of Biometrics. Springer, July 2007. https://doi.org/10.1007/978-0-387-71041-9
Jonietz, C., Monari, E., Widak, H., Qu, C.: Towards mobile and touchless fingerprint verification. In: 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6, August 2015
Kawulok, M., Kawulok, J., Nalepa, J., Smolka, B.: Self-adaptive algorithm for segmenting skin regions. EURASIP J. Adv. Signal Process. 2014(170), 1–22 (2014)
Khalil, M.S., Wan, F.K.: A review of fingerprint pre-processing using a mobile phone. In: 2012 International Conference on Wavelet Analysis and Pattern Recognition, pp. 152–157. IEEE (2012)
Lee, C., Lee, S., Kim, J., Kim, S.-J.: Preprocessing of a fingerprint image captured with a mobile camera. In: Zhang, D., Jain, A.K. (eds.) ICB 2006. LNCS, vol. 3832, pp. 348–355. Springer, Heidelberg (2005). https://doi.org/10.1007/11608288_47
Lee, D., Choi, K., Choi, H., Kim, J.: Recognizable-image selection for fingerprint recognition with a mobile-device camera. IEEE Trans. Syst. Man Cybern. Part B (Cybern. ) 38(1), 233–243 (2008)
Malhotra, A., Sankaran, A., Mittal, A., Vatsa, M., Singh, R.: Chapter 6 - fingerphoto authentication using smartphone camera captured under varying environmental conditions. In: Human Recognition in Unconstrained Environments, pp. 119–144. Academic Press (2017)
Maltoni, D., Maio, D., Jain, A., Prabhakar, S.: Handbook of Fingerprint Recognition, 1st (edn.). Springer-Verlag (2009). https://doi.org/10.1007/978-1-84882-254-2
Mil’shtein, S., Pillai, A.: Perspectives and limitations of touchless fingerprints. In: 2017 IEEE International Symposium on Technologies for Homeland Security (HST), pp. 1–6, April 2017
Minaee, S., Boykov, Y., Porikli, F., Plaza, A., Kehtarnavaz, N., Terzopoulos, D.: Image segmentation using deep learning: a survey. arXiv preprint arXiv:2001.05566 (2020)
Nalepa, J., Kawulok, M.: Fast and accurate hand shape classification. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2014. CCIS, vol. 424, pp. 364–373. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-06932-6_35
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 1345–1359 (2010)
Priesnitz, J., Rathgeb, C., Buchmann, N., Busch, C.: Touchless Fingerprint Sample Quality: Prerequisites for the Applicability of NFIQ2.0. In: Proceedings of International Conference of the Biometrics Special Interest Group (BIOSIG) (2020)
Raghavendra, R., Busch, C., Yang, B.: Scaling-robust fingerprint verification with smartphone camera in real-life scenarios. In: 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), pp. 1–8, September 2013
Sisodia, D.S., Vandana, T., Choudhary, M.: A conglomerate technique for finger print recognition using phone camera captured images. In: 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI), pp. 2740–2746, September 2017
Wang, K., Cui, H., Cao, Y., Xing, X., Zhang, R.: A preprocessing algorithm for touchless fingerprint images. In: You, Z., et al. (eds.) CCBR 2016. LNCS, vol. 9967, pp. 224–234. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46654-5_25
Acknowledgments
The authors acknowledge the financial support by the Federal Ministry of Education and Research of Germany in the framework of MEDIAN (FKZ 13N14798).
This research work has been funded by the German Federal Ministry of Education and Research and the Hessian Ministry of Higher Education, Research, Science and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Priesnitz, J., Rathgeb, C., Buchmann, N., Busch, C. (2021). Deep Learning-Based Semantic Segmentation for Touchless Fingerprint Recognition. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12668. Springer, Cham. https://doi.org/10.1007/978-3-030-68793-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-68793-9_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68792-2
Online ISBN: 978-3-030-68793-9
eBook Packages: Computer ScienceComputer Science (R0)
