Skip to main content
Log in

A new user similarity measure in a new prediction model for collaborative filtering

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The Recommender Systems (RSs) based on the performance of Collaborative filtering (CF) depends on similarities among users or items obtained by a user-item rating matrix. The conventional measures such as the Pearson correlation coefficient (PCC), cosine (COS), and Jaccard (JACC) provide a varied and dissimilar value when the ratings between the users lie in the positive and negative side of the rating scale. These measures are also not very effective when there is sparsity in the rating matrix of the user-item. These problems are addressed by the Proximity-Impact-Popularity (PIP) similarity measure. Even though the PIP method provides an improved solution for this problem, the range of values for each component in PIP is very high. To address this issue and to improve the performance of a CF-based RS, a modified proximity-impact-popularity (MPIP) similarity measure is introduced. The expression is designed to get PIP values within the range of 0 to 1. A modified prediction expression is proposed to predict the available and unavailable ratings by combining user- and item-related components. The proposed method is tested by using various benchmark datasets. The size of the user-item sparse matrix varies to compare the performance of the methods in terms of mean absolute error, root mean squared error, precision, recall, and F1-measure. The performance of the proposed method is statistically tested through the Friedman and McNemer test. The results obtained by using the evaluation criteria indicate that the proposed method provides a better solution than the conventional methods. The statistical analysis reveals that the proposed method provides minimum MAE and RMSE values. Similarly, it also provides a maximum F1-measure for all the sub-problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Baker T, Mackay M, Randles M, Taleb-Bendiab A (2013) Intention-oriented programming support for runtime adaptive autonomic cloud-based applications. Comput Electr Eng 39:2400–2412. https://doi.org/10.1016/j.compeleceng.2013.04.019

  2. Karam Y, Baker T, Taleb-Bendiab A (2012) Intention-oriented modelling support for socio-technical driven elastic cloud applications. In: 2012 international conference on innovations in information technology, IIT 2012

  3. Baker T, Taleb-Bendiab A, Randles M (2009) Auditable intention-oriented web applications using PAA auditing/accounting paradigm. Front Artif Intell Appl. https://doi.org/10.3233/978-1-60750-052-0-61

  4. Ozsoy MG, Polat F, Alhajj R (2016) Making recommendations by integrating information from multiple social networks. Appl Intell 45:1047–1065. https://doi.org/10.1007/s10489-016-0803-1

  5. Zhang J, Lin Y, Lin M, Liu J (2016) An effective collaborative filtering algorithm based on user preference clustering. Appl Intell 45:230–240. https://doi.org/10.1007/s10489-015-0756-9

  6. Bobadilla J, Ortega F, Hernando A, Gutiérrez A (2013) Recommender systems survey. Knowledge-Based Syst. 46:109–132. https://doi.org/10.1016/j.knosys.2013.03.012

  7. Jiang S, Fang SC, An Q, Lavery JE (2019) A sub-one quasi-norm-based similarity measure for collaborative filtering in recommender systems. Inf Sci (Ny) 487:142–155. https://doi.org/10.1016/j.ins.2019.03.011

  8. Hwangbo H, Kim YS, Cha KJ (2018) Recommendation system development for fashion retail e-commerce. Electron Commer Res Appl 28:94–101. https://doi.org/10.1016/j.elerap.2018.01.012

  9. Shi X, Luo X, Shang M, Gu L (2017) Long-term performance of collaborative filtering based recommenders in temporally evolving systems. Neurocomputing. 267:635–643. https://doi.org/10.1016/j.neucom.2017.06.026

  10. Li Y, Lu L, Xuefeng L (2004) A hybrid collaborative filtering method for multiple-interests and multiple-content recommendation in E-commerce. Expert Syst Appl 28:67–77. https://doi.org/10.1016/j.eswa.2004.08.013

  11. Cohen WW, Fan W (2000) Web-collaborative filtering: recommending music by crawling the web. Comput Netw 33:685–698. https://doi.org/10.1016/S1389-1286(00)00057-8

  12. Wang Y, Deng J, Gao J, Zhang P (2017) A hybrid user similarity model for collaborative filtering. Inf Sci (Ny). 418-419:102–118. https://doi.org/10.1016/j.ins.2017.08.008

  13. Bellogín A, Sánchez P (2017) Collaborative filtering based on subsequence matching: a new approach. Inf Sci (Ny). 418-419:432–446. https://doi.org/10.1016/j.ins.2017.08.016

  14. Resnick P, Iacovou N, Suchak M, et al (1994) GroupLens: An open architecture for collaborative filtering of Netnews. In: CSCW

  15. Shardanand U, Maes P (1995) Social information filtering: algorithms for automating ``word of mouth”. In: CHI ‘95: proceedings of the SIGCHI conference on human factors in computing systems

  16. Bobadilla J, Hernando A, Ortega F, Gutiérrez A (2012) Collaborative filtering based on significances. Inf Sci (Ny) 185:1–17. https://doi.org/10.1016/j.ins.2011.09.014

  17. Patra BK, Launonen R, Ollikainen V, Nandi S (2015) A new similarity measure using Bhattacharyya coefficient for collaborative filtering in sparse data. Knowledge-Based Syst. 82:163–177. https://doi.org/10.1016/j.knosys.2015.03.001

  18. Ahn HJ (2008) A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Inf Sci (Ny) 178:37–51. https://doi.org/10.1016/j.ins.2007.07.024

  19. Basu C, Hirsh H, Cohen W (1998) Recommendation as classification: using social and content-based information in recommendation. In Recommender Systems. Papers from 1998 Workshop. Technical Report WS-98-08. AAAI Press

  20. Krulwich B, Burkey C (1996) Learning user information interests through the extraction of semantically significant phrases. In: Proceedings of the AAAI spring symposium on machine learning in information access

  21. Lang K (1995) NewsWeeder : Learning to Filter Netnews ( To appear in ML 95 ). Proc 12th Int Mach Learn Conf

  22. Sheugh L, Alizadeh SH (2015) A note on Pearson correlation coefficient as a metric of similarity in recommender system. In: 2015 AI and robotics, IRANOPEN 2015 - 5th conference on artificial intelligence and robotics

  23. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. Proc 10th …. https://doi.org/10.1145/371920.372071

  24. Huang Z, Chen H, Zeng D (2004) Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering. ACM Trans Inf Syst 22:116–142. https://doi.org/10.1145/963770.963775

  25. Papagelis M, Plexousakis D, Kutsuras T (2005) Alleviating the Sparsity problem of collaborative filtering using trust inferences

  26. Liu H, Hu Z, Mian A, Tian H, Zhu X (2014) A new user similarity model to improve the accuracy of collaborative filtering. Knowledge-Based Syst 56:156–166. https://doi.org/10.1016/j.knosys.2013.11.006

  27. Kurdija AS, Silic M, Vladimir K, Delac G (2018) Efficient global correlation measures for a collaborative filtering dataset. Knowledge-Based Syst. 147:36–42. https://doi.org/10.1016/j.knosys.2018.02.013

  28. Yu K, Schwaighofer A, Tresp V et al (2004) Probabilistic memory-based collaborative filtering. IEEE Trans Knowl Data Eng 16:56–69. https://doi.org/10.1109/TKDE.2004.1264822

  29. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17:734–749

    Article  Google Scholar 

  30. Su X, Khoshgoftaar TM (2009) A survey of collaborative filtering techniques. Adv Artif Intell 2009:1–19. https://doi.org/10.1155/2009/421425

  31. Bag S, Kumar SK, Tiwari MK (2019) An efficient recommendation generation using relevant Jaccard similarity. Inf Sci (Ny) 483:53–64. https://doi.org/10.1016/j.ins.2019.01.023

  32. Guo G, Zhang J, Yorke-Smith N (2013) A novel bayesian similarity measure for recommender systems. In: IJCAI International Joint Conference on Artificial Intelligence

  33. Luo X, Xia Y, Zhu Q (2012) Incremental collaborative filtering recommender based on regularized matrix factorization. Knowledge-Based Syst 27:271–280. https://doi.org/10.1016/j.knosys.2011.09.006

  34. Bobadilla J, Serradilla F (2009) The effect of Sparsity on collaborative filtering metrics. In: Conferences in Research and Practice in Information Technology Series

  35. Herlocker JL, Konstan JA, Terveen LG, Riedl JT (2004) Evaluating collaborative filtering recommender systems. ACM Trans Inf Syst 22:5–53. https://doi.org/10.1145/963770.963772

  36. Tan Z, He L (2017) An efficient similarity measure for user-based collaborative filtering recommender systems inspired by the physical resonance principle. IEEE Access 5:27211–27228. https://doi.org/10.1109/ACCESS.2017.2778424

  37. Abualigah LMQ, Khader AT (2017) Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering. J Supercomput 73:4773–4795. https://doi.org/10.1007/s11227-017-2046-2

  38. Abualigah L. M. Q (2019) Feature selection and enhanced krill herd algorithm for text document Clusteringitle, studies in. Springer International Publishing, Switzerland AG

  39. Abualigah LMQ, Hanandeh SE (2015) Applying genetic algorithms to information retrieval using vector space model. Int J Comput Sci Eng Appl 5:19–28. https://doi.org/10.5121/ijcsea.2015.5102

  40. Saranya KG, Sudha Sadasivam G (2017) Modified heuristic similarity measure for personalization using collaborative filtering technique. Appl Math Inf Sci 11:307–315. https://doi.org/10.18576/amis/110137

  41. Konstan JA, Miller BN, Maltz D, Herlocker JL, Gordon LR, Riedl J (1997) GroupLens: applying collaborative filtering to Usenet news. Commun ACM 40:77–87. https://doi.org/10.1145/245108.245126

  42. Sarwar BM, Karypis G, Konstan J, Riedl J (2002) Recommender systems for large-scale e-commerce: Scalable neighborhood formation using clustering. In Proceedings of the fifth international conference on computer and information technology (Vol. 1, pp. 291–324)

  43. Jamalzehi S, Menhaj MB (2016) A new similarity measure based on item proximity and closeness for collaborative filtering recommendation. In: 2016 4th international conference on control, instrumentation, and automation, ICCIA 2016

  44. Ma H, King I, Lyu MR (2008) Effective missing data prediction for collaborative filtering

  45. Chen Y, Wu C, Xie M, Guo X (2011) Solving the sparsity problem in recommender systems using association retrieval. J Comput https://doi.org/10.4304/jcp.6.9.1896-1902, 6

  46. Singh S, Bag S, Jenamani M (2016) Relative similarity based approach for improving aggregate recommendation diversity. In: 12th IEEE international conference electronics, energy, environment, communication, computer, control: (E3-C3), INDICON 2015

  47. Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32:675–701. https://doi.org/10.1080/01621459.1937.10503522

  48. Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1:3–18. https://doi.org/10.1016/j.swevo.2011.02.002

  49. Luo J, Liu Z (2020) Novel grey wolf optimization based on modified differential evolution for numerical function optimization. Appl Intell 50:468–486. https://doi.org/10.1007/s10489-019-01521-5

  50. Roggo Y, Duponchel L, Huvenne JP (2003) Comparison of supervised pattern recognition methods with McNemar’s statistical test: application to qualitative analysis of sugar beet by near-infrared spectroscopy. Anal Chim Acta 477:187–200. https://doi.org/10.1016/S0003-2670(02)01422-8

  51. Roggo Y, Duponchel L, Ruckebusch C, Huvenne JP (2003) Statistical tests for comparison of quantitative and qualitative models developed with near infrared spectral data. J Mol Struct 654:253–262. https://doi.org/10.1016/S0022-2860(03)00248-5

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Punniyamoorthy.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Manochandar, S., Punniyamoorthy, M. A new user similarity measure in a new prediction model for collaborative filtering. Appl Intell 51, 586–615 (2021). https://doi.org/10.1007/s10489-020-01811-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01811-3

Keywords

Navigation