Abstract
This paper describes an application of machine learning in a web browser feature called autofill. Automatic form fill or autofill is a time saving feature present in web browsers. This feature automatically fills text values in a new web form based on the text values filled by the user for the same or similar fields in other forms on the web, which are stored locally. This is dependent on the correct prediction of the labels of the form fields. In this paper, we describe an intelligent and secure solution for autofill. This includes fixing some security vulnerabilities related to hidden fields in a web form, resulting in a secure auto fill. Our solution also intelligently predicting the field labels in a form using machine learning. We describe the system architecture and some results for the accuracy of the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wahle, A., Prause, G.P.M., von Birgelen, C., Erbel, R., Sonka, M.: Fusion of angiography and intravascular ultrasound in vivo: establishing the absolute 3-D frame orientation. IEEE Trans. Biomed. Eng. 46, 1176–1180 (1999)
Microsoft Edge Support. Automatically fill info in Microsoft Edge. https://support.microsoft.com/en-us/microsoft-edge/automatically-fill-info-in-microsoft-edge-81da697c-9910-d9b8-d50a-1712d96f3db8
Goodman, J.T., Kadie, C.M., Chickering, D.M., Bradford, D.E., Glasgow, D.A.: Microsoft Corp, assignee. Intelligent autofill. United States patent US 7,660,779. 2010 Feb 9 (2010)
Liddle, S.W., Embley, D.W., Scott, D.T., Yau, S.H.: Extracting Data behind Web Forms. In: Olivé, A., Yoshikawa, M., Yu, E.S.K. (eds.) Advanced Conceptual Modeling Techniques. ER 2002. LNCS, vol. 2784. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-45275-1_35
Myers, B.A., Wolf, R., Potosnak, K., Graham, C.: Heuristics in real user interfaces. In: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems (CHI '93), pp. 304–307. Association for Computing Machinery, New York (1993). https://doi.org/10.1145/169059.169240
Kantorski, G.Z., Moreira, V.P., Heuser, C.A.: Automatic filling of hidden web forms: a survey. SIGMOD Rec. 44(1) (2015), 24–35 (2015). https://doi.org/10.1145/2783888.2783898
Winckler, M., Gaits, V., Vo, D.B., Sergio, F., Rossi, G.: An approach and tool support for assisting users to fill-in web forms with personal information. In: 29th ACM international conference on Design of communication (SIGDOC '11), pp. 195–202. ACM, New York (2011)
Hartmann, M., Muhlhauser, M.: Context-aware form filling for web applications. In: 2009 IEEE International Conference on Semantic Computing (ICSC '09). IEEE Computer Society, Washington, DC (2009)
Wang, S., Zou, Y., Upadhyaya, B., Ng, J.: An intelligent framework for auto-filling web forms from different web applications. In: IEEE Ninth World Congress on Services June 2013, pp. 175–179. IEEE Computer Society, Washington, DC (2013)
Troiano, L., Birtolo, C., Armenise, R.: (2017) Modeling and predicting the user next input by Bayesian reasoning. Soft. Comput. 21(6), 1583–1600 (March 2017)
Lin, X., Ilia, P., Polakis, J.: Fill in the blanks: empirical analysis of the privacy threats of browser form autofill. In: Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security (CCS '20), pp. 507–519. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3372297.3417271
Zhao, R., Yue, C.: All your browser-saved passwords could belong to us: a security analysis and a cloud-based new design. In: Proceedings of the third ACM conference on Data and application security and privacy (CODASPY '13), pp. 333–340. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2435349.2435397
Gutmann, A., Murdoch, S.J.: Taken out of context: security risks with security code AutoFill in iOS & macOS. In: USENIX Security Symposium 2019 (2019)
Oesch, S., Ruoti, S.: That was then, this is now: a security evaluation of password generation, storage, and autofill in browser-based password managers. In: Proceedings of USENIX Security Symposium 2020 (2020)
Azure Machine Learning: Microsoft Azure. https://azure.microsoft.com/en-in/services/machine-learning/
Microsoft Docs. Windows Machine Learning, 29 May 2020. https://docs.microsoft.com/en-us/windows/ai/windows-ml/
Allan, P.: Your Browser's Autofill Data Can Be Phished, Here's How to Stay Safe. Lifehacker (2017). https://lifehacker.com/your-browsers-autofill-data-can-be-phished-heres-how-t-1791084371
Coppock, M.: Your browser might be filling in hidden fields and giving away your secrets. Digital Trends (2017) https://www.digitaltrends.com/computing/browser-bug-can-fill-in-personal-information-in-hidden-fields/
Browser autofill phishing. https://anttiviljami.github.io/browser-autofill-phishing/
Bose, J.: A field label prediction for autofill in web browsers. Arxiv preprint (2019). https://arxiv.org/abs/1912.08809
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bose, J. (2021). Intelligent and Secure Autofill System in Web Browsers. In: Abraham, A., et al. Proceedings of the 12th International Conference on Soft Computing and Pattern Recognition (SoCPaR 2020). SoCPaR 2020. Advances in Intelligent Systems and Computing, vol 1383. Springer, Cham. https://doi.org/10.1007/978-3-030-73689-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-73689-7_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73688-0
Online ISBN: 978-3-030-73689-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)