Abstract
Cybersecurity has always been a major concern for internet applications and the demand for website protection is on the rise. Nowadays, Web Application Firewalls (WAFs) are commonly used and trusted by web owners, as they are convenient and provide protection against multiple types of attacks by filtering incoming network requests. WAFs are powered by rules written by security experts to halt attackers to penetrate the protected websites. However, these rules have high false-positive rates, which means they often block normal users’ requests, and require constant manual updates, as violating methods are always evolving. A feasible solution to concrete rule-based WAFs is applying machine learning approaches based on observing users’ behavior, but these models are enormous to deploy and time-consuming to run, although WAFs must handle each request in milliseconds. Therefore, we have developed a simple machine learning system to categorize the requests and support traditional WAFs. The module tries to categorize the network requests by their languages and determine whether each incoming request is abnormal (i.e. in a different language than the normal requests). The output of our model is combined with the result of a rule-based WAF (ModSecurity in our implementation) to conclude whether should the incoming request be blocked or not. Our proposed approach, called the machine learning-assisted method, combined the latest programming language categorizer with ModSecurity, a generic open-source WAF, returns good results with almost no false positive and acceptable detective rates in our experiments.








Similar content being viewed by others
Notes
Available at https://github.com/SpiderLabs/ModSecurity.
Available at https://www.isi.csic.es/dataset.
Available at http://www.lirmm.fr/pkdd2007-challenge.
Available at https://www.omg.org/spec/ASTM/1.0.
Available at https://github.com/yoeo/guesslang.
References
Betarte G, Giménez E, Martinez R, Pardo Á. Improving web application firewalls through anomaly detection. In: 17th IEEE International Conference on machine learning and applications, ICMLA, 2018; pp. 779–784. IEEE, Orlando, FL, USA. https://doi.org/10.1109/ICMLA.2018.00124.
Nguyen T, Le-Nguyen M, Le D, Nguyen V, Tôn L, Nguyen-An K. Improving modsecurity WAF using a structured-language classifier. In: Future Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications. Communications in Computer and Information Science, 2021; vol. 1500, pp. 89–104. Springer, Ho Chi Minh City, Vietnam. https://doi.org/10.1007/978-981-16-8062-5_6.
Boukhtouta A, Lakhdari N, Mokhov S.A, Debbabi M. Towards fingerprinting malicious traffic. In: Proceedings of the 4th International Conference on ambient systems, networks and technologies—ANT, the 3rd International Conference on sustainable energy information technology (SEIT). Procedia Computer Science, 2013; vol. 19, pp. 548–555. Elsevier, Halifax, Nova Scotia, Canada. https://doi.org/10.1016/j.procs.2013.06.073.
Gao M, Ma L, Liu H, Zhang Z, Ning Z, Xu J. Malicious network traffic detection based on deep neural networks and association analysis. Sensors. 2020;20(5):1452. https://doi.org/10.3390/s20051452.
Shinomiya K, Goto S. Detecting malicious traffic through two-phase machine learning. Proc Asia-Pac Adv Netw. 2015;40:34. https://doi.org/10.7125/40.6.
Radford BJ, Apolonio LM, Trias AJ, Simpson JA. Network traffic anomaly detection using recurrent neural networks. 2018. arXiv:1803.10769 [CoRR].
Marin G, Casas P, Capdehourat G. Deepmal—deep learning models for malware traffic detection and classification. 2020. arXiv:2003.04079 [CoRR].
Hwang R-H, Peng M-C, Nguyen V-L, Chang Y-L. An lstm-based deep learning approach for classifying malicious traffic at the packet level. Appl Sci. 2019;9:3414. https://doi.org/10.3390/app9163414.
Mikolov T, Yih W, Zweig G. Linguistic regularities in continuous space word representations. In: Human language technologies: Proceedings of the Conference of the North American Chapter, 2013; pp. 746–751. The Association for Computational Linguistics, ???.
Zhang M, Xu B, Bai S, Lu S, Lin Z. A deep learning method to detect web attacks using a specially designed CNN. In: Neural Information Processing—24th International Conference, ICONIP, Part V. Lecture Notes in Computer Science, 2017; vol. 10638, pp. 828–836. Springer, Guangzhou, China. https://doi.org/10.1007/978-3-319-70139-4_84.
Tran N, Nguyen V, Nguyen-Le T, Nguyen-An K. Improving modsecurity WAF with machine learning methods. In: Proceedings of Future Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications - 7th International Conference, FDSE. Communications in Computer and Information Science, 2020; vol. 1306, pp. 93–107. Springer, Quy Nhon, Vietnam. https://doi.org/10.1007/978-981-33-4370-2_7.
Pennington J, Socher R, Manning CD. Glove: global vectors for word representation. In: Proceedings of the Conference on empirical methods in natural language processing, 2014; pp. 1532–1543. ACL, Doha, Qatar. https://doi.org/10.3115/v1/d14-1162.
Kingma DP, Ba J. Adam: a method for stochastic optimization. In: Proceedings of the 3rd International Conference on learning representations—ICLR 2015; pp. 1–15.
Acknowledgements
We acknowledge the support of time and facilities from Ho Chi Minh City University of Technology (HCMUT), VNU-HCM, for this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article is part of the topical collection “Future Data and Security Engineering 2021" guest edited by Tran Khanh Dang.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Nguyen, TCH., Le-Nguyen, MK., Le, DT. et al. Improving Web Application Firewalls with Automatic Language Detection. SN COMPUT. SCI. 3, 446 (2022). https://doi.org/10.1007/s42979-022-01327-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-022-01327-2