Abstract
This paper presents an intelligent application that runs on Android phones to extract important information from Vietnamese passports. Instead of processing information from the passport by manually entering important information into the computer, this application can scan and analyze to get the information fields on the passport automatically. The main algorithm flow includes five parts: 1) capture the passport by the camera, 2) preprocess the image, 3) recognize optical characters 4) extract important information, 5) linguistic processing. After all processing steps, the application will return to a screen with full information extracted. Information fields in cases that are extracted with low confidence will be highlighted for users to easily see and modify. The result has proved that our application has a definite advantage in recognizing the Vietnamese passport (being presented in bilingual English and Vietnamese) when compared to the existing commercial application on the Google Play store.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Liados, J., Lumbreras, F., Chapaprieta, V., et al.: ICAR-identity-card-automatic-reader. In: Proceedings of the Sixth International Conference on Document Analysis a Recognition, Spain, pp. 470–474 (2001)
Kim, T.J., Kwon, Y.B.: Crosscheck of passport information for personal identification. In: Liu, W., Lladós, J. (eds.) GREC 2005. LNCS, vol. 3926, pp. 162–172. Springer, Heidelberg (2006). https://doi.org/10.1007/11767978_15
Gu, Z., Ju, M., Zhang, D.: A novel retinex image enhancement approach via brightness channel prior and change of detail prior. Pattern Recognit. Image Anal. 27(2), 234–242 (2017)
Nikitenko, D., Wirth, M.: Applicability of white-balancing algorithms to restoring faded colour slides: an empirical evaluation. J. Multimedia 3(5), 9–18 (2008)
Winkler, J.R.: Singular projective transformation matrices. Appl. Math. Model. 20(10), 771–778 (1996)
Jirasuwankul, N.: Effect of text orientation to OCR error and anti-skew of text using projective transform technique. In: Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Budapest, Hungary, September, pp. 856–861 (2011)
Anaraki, A.T., Sheikh, U.U., Rahman, A.A.A., et al.: An alphabetic contour-based descriptor for shape-based image retrieval. In: Proceedings of the IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuching, Malaisia, pp. 145–148 (2017)
Lee, H., Kwak, N.: Character recognition for the machine reader zone of electronic identity cards. In: Proceedings of the IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada, pp. 387–391 (2015)
Brisinello, M., Grbić, R., Pul, M., et al.: Improving optical character recognition performance for low quality images. In: Proceedings of the 60th International Symposium ELMAR, Zadar, Croatia, pp. 167–171 (2017)
Mantoro, T., Sobri, A.M., Usino, W.: Optical Character Recognition (OCR) performance in server-based mobile environment. In: Proceedings of the International Conference on Advanced Computer Science Applications and Technologies (ACSAT), Kuching, Malaysia, pp. 423–428 (2013)
Vo, Q.N., Kim, S.H., Yang, S.H., et al.: Text line segmentation using a fully convolutional network in handwritten document images. IET Image Process. 12(3), 438–446 (2018)
Vil’kin, A.M., Safonov, I.V., Egorova, M.A.: Algorithm for segmentation of documents based on texture features. Pattern Recogn. Image Anal. 23(1), 153–159 (2013). https://doi.org/10.1134/S1054661813010136
Ertopçu, B., Kanburoğlu, A.B., Topsakal, O., et al.: A new approach for named entity recognition. In: Proceedings of the 2nd International Conference on Computer Science and Engineering (UBMK). Antalya, Turkey, pp. 474–479 (2017)
Li, Z., Chng, E.S., Li, H.: Named entity transliteration with sequence-to-sequence neural network. In: Proceedings of the International Conference on Asian Language Processing (IALP), Singapore, pp. 374–378 (2017)
Kasar, T., Kumar, J., Ramakrishnan, A.G.: Font and background color independent text binarization. In: Proceedings of the 2nd International Workshop Camera-Based Document Analysis and Recognition, pp. 3–9 (2007)
Ahmad, M., Ray, S.: Theoretical foundation of relevance frequency for text categorization. In: Proceedings of the International Conference on Intelligent Computing, Instrumentation and Control Technologies, India, pp. 112–125 (2017)
Urolagin, S., Nayak, J., Satish, L.: A method to generate text summary by accounting pronoun frequency for keywords weightage computation. In: Proceedings of the International Conference on Engineering and Technology (ICET), Antalya, pp. 1–4 (2017)
Majumder, A., Changder, S.: A Generalized model of text steganography by summary generation using frequency analysis. In: Proceedings of the 7th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions), Noida, India, pp. 599–605 (2018)
Zain, S.: Choose the Right On-Device Text Recognition (OCR) SDK on Android Using DeltaML (2018). https://heartbeat.fritz.ai/choose-the-right-on-device-text-recognition-sdk-on-android-using-deltaml-9b4b3e409b6e
Vietnam Cities Database (2019). https://simplemaps.com/data/vn-cities
Vietnamese Name DB (2019). https://github.com/duyetdev/vietnamese-namedb
Hung, P.D., Linh, D.Q.: Implementing an android application for automatic vietnamese business card recognition. Pattern Recognit. Image Anal. 29(1), 156–166 (2019). https://doi.org/10.1134/S1054661819010188
Nam, N.T., Hung, P.D.: Padding methods in convolutional sequence model: an application in japanese handwriting recognition. In: Proceedings of the 3rd International Conference on Machine Learning and Soft Computing. Association for Computing Machinery, New York, NY, USA, 138–142 (2019). https://doi.org/10.1145/3310986.3310998
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Hung, P.D., Loan, B.T. (2020). Automatic Vietnamese Passport Recognition on Android Phones. In: Dang, T.K., Küng, J., Takizawa, M., Chung, T.M. (eds) Future Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications. FDSE 2020. Communications in Computer and Information Science, vol 1306. Springer, Singapore. https://doi.org/10.1007/978-981-33-4370-2_36
Download citation
DOI: https://doi.org/10.1007/978-981-33-4370-2_36
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-33-4369-6
Online ISBN: 978-981-33-4370-2
eBook Packages: Computer ScienceComputer Science (R0)