Abstract
The presence of recommendation systems within the current era is not controlled or even managed like before, for providing the optimum services to users. For that reason, these services need to be in an ideal and complete state since the real-world data is often not that much perfect. That optimum state could not be achieved without the interaction of preprocessing method. Preprocessing can offer a lot of insights about the data and its structure and quality. Preprocessing techniques ensure that the dataset has complete, consistent and integrant properties for further analysis. Dimensionality reduction is this paper is discussed as one of the preprocessing stages using the most popular matrix factorization methods. We have also made an experiment to show how the dimensionality reduction algorithms can overcome any constrained computational resources and prove better performance and efficiency for such demanding recommendation systems.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
https://grouplens.org/datasets/movielens/. Accessed 18 Oct 2019
https://movielens.org/. Accessed 18 Oct 2019
Harper, F.M., Konstan, J.A.: The MovieLens datasets: history and context. ACM Trans. Interact. Intell. Syst. 5(4), 19:1–19:19 (2015)
https://www.analyticsvidhya.com/blog/2018/08/dimensionality-reduction-techniques-python/. Accessed 20 Oct 2019
Al-Garadi, M.A., Mohamed, A., Al-Ali, A., Du, X., Guizani, M.: A survey of machine and deep learning methods for Internet of Things (IoT) security. arXiv preprint (2018)
Vozalis, M.G., Konstantinos, G.M.: A recommender system using principal component analysis. In: Published in 11th Panhellenic Conference in Informatics, pp. 271–283. Citeseer (2007)
Juvonen, A., Sipola, T., Hämäläinen, T.: Online anomaly detection using dimensionality reduction techniques for HTTP log analysis. Comput. Netw. 91, 46–56 (2015)
Lee, Y.J., Yeh, Y.R., Wang, Y.C.F.: Anomaly detection via online oversampling principal component analysis. IEEE Trans. Knowl. Data Eng. 25(7), 1460–1470 (2013)
Bokde, D., Girase, S., Mukhopadhyay, D.: Matrix factorization model in collaborative filtering algorithms: a survey. In: Proceedings of 4th International Conference on Advances in Computing, Communication and Control, pp. 136–146 (2015)
Zhou, X., He, J., Huang, G., Zhang, Y.: SVD-based incremental approaches for recommender systems. J. Comput. Syst. Sci. 81(4), 717–733 (2014)
Zarzour, H., Al-Sharif, Z., Al-Ayyoub, M., Jararweh, Y.: A new collaborative filtering recommendation algorithm based on dimensionality reduction and clustering techniques. In: 9th International Conference on Information and Communication Systems (ICICS), Irbid, pp. 102–106 (2018)
Yang, H., Wang, Y.X., Xia, J.J., Zhang, Y.: China GDP prediction on traffic and transportation by PCA. In: Proceeding of the 24th International Conference on Industrial Engineering and Engineering Management, Singapore, pp. 388–394 (2018)
Vasan, K., Surendiran, B.: Dimensionality reduction using principal component analysis for network intrusion detection. Perspect. Sci. 8, 510–512 (2016)
Nilashi, M., Ibrahim, O., Bagherifard, K.: A recommender system based on collaborative filtering using ontology and dimensionality reduction techniques. Expert Syst. Appl. 92, 507–520 (2018)
Deldjoo, Y., Constantin, M.G., Eghbal-Zadeh, H., Ionescu, B., Schedl, M., Cremonesi, P.: Audiovisual encoding of multimedia content for enhancing movie recommendations. In: Proceedings of the 12th ACM Conference on Recommender Systems, RecSys 2018, Vancouver, BC, Canada, 2–7 October 2018, pp. 455–459 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
ElFiky, H., Hussein, W., El Gohary, R. (2020). Improving the Data Quality of the MovieLens Dataset Using Dimensionality Reduction Techniques. In: Hassanien, AE., Azar, A., Gaber, T., Oliva, D., Tolba, F. (eds) Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2020). AICV 2020. Advances in Intelligent Systems and Computing, vol 1153. Springer, Cham. https://doi.org/10.1007/978-3-030-44289-7_51
Download citation
DOI: https://doi.org/10.1007/978-3-030-44289-7_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-44288-0
Online ISBN: 978-3-030-44289-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)