Abstract
The Recommender Systems (RSs) based on the performance of Collaborative filtering (CF) depends on similarities among users or items obtained by a user-item rating matrix. The conventional measures such as the Pearson correlation coefficient (PCC), cosine (COS), and Jaccard (JACC) provide a varied and dissimilar value when the ratings between the users lie in the positive and negative side of the rating scale. These measures are also not very effective when there is sparsity in the rating matrix of the user-item. These problems are addressed by the Proximity-Impact-Popularity (PIP) similarity measure. Even though the PIP method provides an improved solution for this problem, the range of values for each component in PIP is very high. To address this issue and to improve the performance of a CF-based RS, a modified proximity-impact-popularity (MPIP) similarity measure is introduced. The expression is designed to get PIP values within the range of 0 to 1. A modified prediction expression is proposed to predict the available and unavailable ratings by combining user- and item-related components. The proposed method is tested by using various benchmark datasets. The size of the user-item sparse matrix varies to compare the performance of the methods in terms of mean absolute error, root mean squared error, precision, recall, and F1-measure. The performance of the proposed method is statistically tested through the Friedman and McNemer test. The results obtained by using the evaluation criteria indicate that the proposed method provides a better solution than the conventional methods. The statistical analysis reveals that the proposed method provides minimum MAE and RMSE values. Similarly, it also provides a maximum F1-measure for all the sub-problems.
Similar content being viewed by others
References
Baker T, Mackay M, Randles M, Taleb-Bendiab A (2013) Intention-oriented programming support for runtime adaptive autonomic cloud-based applications. Comput Electr Eng 39:2400–2412. https://doi.org/10.1016/j.compeleceng.2013.04.019
Karam Y, Baker T, Taleb-Bendiab A (2012) Intention-oriented modelling support for socio-technical driven elastic cloud applications. In: 2012 international conference on innovations in information technology, IIT 2012
Baker T, Taleb-Bendiab A, Randles M (2009) Auditable intention-oriented web applications using PAA auditing/accounting paradigm. Front Artif Intell Appl. https://doi.org/10.3233/978-1-60750-052-0-61
Ozsoy MG, Polat F, Alhajj R (2016) Making recommendations by integrating information from multiple social networks. Appl Intell 45:1047–1065. https://doi.org/10.1007/s10489-016-0803-1
Zhang J, Lin Y, Lin M, Liu J (2016) An effective collaborative filtering algorithm based on user preference clustering. Appl Intell 45:230–240. https://doi.org/10.1007/s10489-015-0756-9
Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowledge-Based Syst. 46:109–132. https://doi.org/10.1016/j.knosys.2013.03.012
Jiang S, Fang SC, An Q, Lavery JE (2019) A sub-one quasi-norm-based similarity measure for collaborative filtering in recommender systems. Inf Sci (Ny) 487:142–155. https://doi.org/10.1016/j.ins.2019.03.011
Hwangbo H, Kim YS, Cha KJ (2018) Recommendation system development for fashion retail e-commerce. Electron Commer Res Appl 28:94–101. https://doi.org/10.1016/j.elerap.2018.01.012
Shi X, Luo X, Shang M, Gu L (2017) Long-term performance of collaborative filtering based recommenders in temporally evolving systems. Neurocomputing. 267:635–643. https://doi.org/10.1016/j.neucom.2017.06.026
Li Y, Lu L, Xuefeng L (2004) A hybrid collaborative filtering method for multiple-interests and multiple-content recommendation in E-commerce. Expert Syst Appl 28:67–77. https://doi.org/10.1016/j.eswa.2004.08.013
Cohen WW, Fan W (2000) Web-collaborative filtering: recommending music by crawling the web. Comput Netw 33:685–698. https://doi.org/10.1016/S1389-1286(00)00057-8
Wang Y, Deng J, Gao J, Zhang P (2017) A hybrid user similarity model for collaborative filtering. Inf Sci (Ny). 418-419:102–118. https://doi.org/10.1016/j.ins.2017.08.008
Bellogín A, Sánchez P (2017) Collaborative filtering based on subsequence matching: a new approach. Inf Sci (Ny). 418-419:432–446. https://doi.org/10.1016/j.ins.2017.08.016
Resnick P, Iacovou N, Suchak M, et al (1994) GroupLens: An open architecture for collaborative filtering of Netnews. In: CSCW
Shardanand U, Maes P (1995) Social information filtering: algorithms for automating ``word of mouth”. In: CHI ‘95: proceedings of the SIGCHI conference on human factors in computing systems
Bobadilla J, Hernando A, Ortega F, Gutiérrez A (2012) Collaborative filtering based on significances. Inf Sci (Ny) 185:1–17. https://doi.org/10.1016/j.ins.2011.09.014
Patra BK, Launonen R, Ollikainen V, Nandi S (2015) A new similarity measure using Bhattacharyya coefficient for collaborative filtering in sparse data. Knowledge-Based Syst. 82:163–177. https://doi.org/10.1016/j.knosys.2015.03.001
Ahn HJ (2008) A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Inf Sci (Ny) 178:37–51. https://doi.org/10.1016/j.ins.2007.07.024
Basu C, Hirsh H, Cohen W (1998) Recommendation as classification: using social and content-based information in recommendation. In Recommender Systems. Papers from 1998 Workshop. Technical Report WS-98-08. AAAI Press
Krulwich B, Burkey C (1996) Learning user information interests through the extraction of semantically significant phrases. In: Proceedings of the AAAI spring symposium on machine learning in information access
Lang K (1995) NewsWeeder : Learning to Filter Netnews ( To appear in ML 95 ). Proc 12th Int Mach Learn Conf
Sheugh L, Alizadeh SH (2015) A note on Pearson correlation coefficient as a metric of similarity in recommender system. In: 2015 AI and robotics, IRANOPEN 2015 - 5th conference on artificial intelligence and robotics
Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. Proc 10th …. https://doi.org/10.1145/371920.372071
Huang Z, Chen H, Zeng D (2004) Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering. ACM Trans Inf Syst 22:116–142. https://doi.org/10.1145/963770.963775
Papagelis M, Plexousakis D, Kutsuras T (2005) Alleviating the Sparsity problem of collaborative filtering using trust inferences
Liu H, Hu Z, Mian A, Tian H, Zhu X (2014) A new user similarity model to improve the accuracy of collaborative filtering. Knowledge-Based Syst 56:156–166. https://doi.org/10.1016/j.knosys.2013.11.006
Kurdija AS, Silic M, Vladimir K, Delac G (2018) Efficient global correlation measures for a collaborative filtering dataset. Knowledge-Based Syst. 147:36–42. https://doi.org/10.1016/j.knosys.2018.02.013
Yu K, Schwaighofer A, Tresp V et al (2004) Probabilistic memory-based collaborative filtering. IEEE Trans Knowl Data Eng 16:56–69. https://doi.org/10.1109/TKDE.2004.1264822
Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17:734–749
Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009:1–19. https://doi.org/10.1155/2009/421425
Bag S, Kumar SK, Tiwari MK (2019) An efficient recommendation generation using relevant Jaccard similarity. Inf Sci (Ny) 483:53–64. https://doi.org/10.1016/j.ins.2019.01.023
Guo G, Zhang J, Yorke-Smith N (2013) A novel bayesian similarity measure for recommender systems. In: IJCAI International Joint Conference on Artificial Intelligence
Luo X, Xia Y, Zhu Q (2012) Incremental collaborative filtering recommender based on regularized matrix factorization. Knowledge-Based Syst 27:271–280. https://doi.org/10.1016/j.knosys.2011.09.006
Bobadilla J, Serradilla F (2009) The effect of Sparsity on collaborative filtering metrics. In: Conferences in Research and Practice in Information Technology Series
Herlocker JL, Konstan JA, Terveen LG, Riedl JT (2004) Evaluating collaborative filtering recommender systems. ACM Trans Inf Syst 22:5–53. https://doi.org/10.1145/963770.963772
Tan Z, He L (2017) An efficient similarity measure for user-based collaborative filtering recommender systems inspired by the physical resonance principle. IEEE Access 5:27211–27228. https://doi.org/10.1109/ACCESS.2017.2778424
Abualigah LMQ, Khader AT (2017) Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering. J Supercomput 73:4773–4795. https://doi.org/10.1007/s11227-017-2046-2
Abualigah L. M. Q (2019) Feature selection and enhanced krill herd algorithm for text document Clusteringitle, studies in. Springer International Publishing, Switzerland AG
Abualigah LMQ, Hanandeh SE (2015) Applying genetic algorithms to information retrieval using vector space model. Int J Comput Sci Eng Appl 5:19–28. https://doi.org/10.5121/ijcsea.2015.5102
Saranya KG, Sudha Sadasivam G (2017) Modified heuristic similarity measure for personalization using collaborative filtering technique. Appl Math Inf Sci 11:307–315. https://doi.org/10.18576/amis/110137
Konstan JA, Miller BN, Maltz D, Herlocker JL, Gordon LR, Riedl J (1997) GroupLens: applying collaborative filtering to Usenet news. Commun ACM 40:77–87. https://doi.org/10.1145/245108.245126
Sarwar BM, Karypis G, Konstan J, Riedl J (2002) Recommender systems for large-scale e-commerce: Scalable neighborhood formation using clustering. In Proceedings of the fifth international conference on computer and information technology (Vol. 1, pp. 291–324)
Jamalzehi S, Menhaj MB (2016) A new similarity measure based on item proximity and closeness for collaborative filtering recommendation. In: 2016 4th international conference on control, instrumentation, and automation, ICCIA 2016
Ma H, King I, Lyu MR (2008) Effective missing data prediction for collaborative filtering
Chen Y, Wu C, Xie M, Guo X (2011) Solving the sparsity problem in recommender systems using association retrieval. J Comput https://doi.org/10.4304/jcp.6.9.1896-1902, 6
Singh S, Bag S, Jenamani M (2016) Relative similarity based approach for improving aggregate recommendation diversity. In: 12th IEEE international conference electronics, energy, environment, communication, computer, control: (E3-C3), INDICON 2015
Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701. https://doi.org/10.1080/01621459.1937.10503522
Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1:3–18. https://doi.org/10.1016/j.swevo.2011.02.002
Luo J, Liu Z (2020) Novel grey wolf optimization based on modified differential evolution for numerical function optimization. Appl Intell 50:468–486. https://doi.org/10.1007/s10489-019-01521-5
Roggo Y, Duponchel L, Huvenne JP (2003) Comparison of supervised pattern recognition methods with McNemar’s statistical test: application to qualitative analysis of sugar beet by near-infrared spectroscopy. Anal Chim Acta 477:187–200. https://doi.org/10.1016/S0003-2670(02)01422-8
Roggo Y, Duponchel L, Ruckebusch C, Huvenne JP (2003) Statistical tests for comparison of quantitative and qualitative models developed with near infrared spectral data. J Mol Struct 654:253–262. https://doi.org/10.1016/S0022-2860(03)00248-5
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Manochandar, S., Punniyamoorthy, M. A new user similarity measure in a new prediction model for collaborative filtering. Appl Intell 51, 586–615 (2021). https://doi.org/10.1007/s10489-020-01811-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-020-01811-3