Skip to main content
Log in

A collaborative filtering algorithm based on correlation coefficient

  • Machine Learning - Applications & Techniques in Cyber Intelligence
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Due to the concise design concept and the superior computing performance, collaborative filtering algorithm has become a hot research field in recommendation systems. Firstly, this paper summarizes the relevant research achievements of collaborative filtering algorithms in recent years. By analyzing data sparsity and scalability problem in collaborative filtering algorithm, a novel collaborative filtering algorithm based on correlation coefficient (COR based) is proposed. The key functional parts of COR-based CF algorithm are the calculation of semantic similarity and the acquirement of similarity–term frequency weight. The main performance metric of COR-based CF algorithm includes means absolute error and hit ratio. The experimental results demonstrate that the COR-based CF algorithm outperforms the traditional collaborative filtering algorithms which are user-based CF algorithm and item-based CF algorithm. In the proposed COR-based CF algorithm, the sparsity and scalability problems among collaborative filtering algorithms have been effectively relieved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Deerwester S, Dumais S, Furnas G et al (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 40(6):391–407

    Article  Google Scholar 

  2. Liu RR, Jia CX, Zhou T et al (2009) Personal recommendation via modified collaborative filtering. Phys A 388(4):462–468

    Article  Google Scholar 

  3. Adomavicius G, Tuzhilin A (2005) Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans Knowl Data Eng 17(6):734–749

    Article  Google Scholar 

  4. Breese JS, Heckerman D, Kadie C (1998) Empirical analysis of predictive algorithms for collaborative filtering. In: Process of the 14th conference on uncertainty in artificial intelligence, pp 43–52

  5. Resnick P, Iakovou N (1994) Sushak Metal.GroupLens: an open architecture for collaborative filtering of netnews. In Process of the 1994 computer supported cooperative work conference, pp 175–186

  6. Sarwar B, Karypis G, Konstan J (2001) Item-based collaborative filtering recommendation algorithms. In Process of the 10th international conference on world wide web, pp 285-295

  7. Goldberg D, Nichols D, Oki BM et al (1992) Using collaborative filtering to weave an information tapestry. Commun ACM 35(12):61–70

    Article  Google Scholar 

  8. Goldberg K, Roeder T, Gupta D, Perkins C (2001) Eigentaste: a constant time collaborative filtering algorithm. Inf Retrieval 4(2):133–151

    Article  Google Scholar 

  9. Pearson KLIII (1901) On lines and planes of closest fit to systems of points in space. Lond Edinb Dublin Philos Mag J Sci 2(11):559–572

    Article  Google Scholar 

  10. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: The 10th process world wide web conference, pp 285–295

  11. Sarwar B, Karypis G, Konstan J et al. (2002) Incremental singular value decomposition algorithms for highly scalable recommender systems. In: Proceedings of fifth international conference on computer and information science.Citeseer, pp 27–28

  12. Linden G, Smith B, York J (2003) Amazon.com recommendations: item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80

    Article  Google Scholar 

  13. Su X, Khoshgoflaar TM (2006) Collaborative filtering for multi-class data using belief nets algorithms. In: Proceedings of ICTAr06. 18th IEEE international conference on tools with artificial intelligence. IEEE, pp 497–504

  14. MacQueen J et al. (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, pp 1-14

  15. Talhofer V, Hošková-Mayerová Š, Hofmann A (2018 Quality of spatial data in command and control system (ISBN 978-3-319-94561-3)

  16. Gao M, Wu Z, Jiang F (2011) Userrank for item-based collaborative filtering recommendation. Inf Process Lett 111(9):440–446

    Article  MathSciNet  Google Scholar 

  17. Prabhu Y, Kag A, Gopinath S et al. (2018) Extreme multi-label learning with label features for warm-start tagging, ranking and recommendation. In: Proceedings of the eleventh ACM international conference on web search and data mining. ACM, Cambridge, pp 441–449

  18. Wang CD, Deng ZH, Lai JH et al (2018) Serendipitous recommendation in E-commerce using innovator-based collaborative filtering. IEEE Trans Cybernet 99:1–15

    Google Scholar 

  19. Qu Z, Yao J, Wang X et al. (2018) Attribute weighting and samples sampling for collaborative filtering. In: IEEE International Conference on big data and smart computing (BigComp), pp 235–241

  20. Kluver D, Ekstrand MD, Konstan JA (2018) Rating-based collaborative filtering: algorithms and evaluation. Social information access. Springer, Cham, pp 344–390

    Google Scholar 

  21. Geuens S, Coussement K, De Bock KW (2018) A framework for configuring collaborative filtering-based recommendations derived from purchase data. Eur J Oper Res 265(1):208–218

    Article  Google Scholar 

  22. Insall JN, Dorr LD, Scott RD, Scott WN (1989) Rationale of the knee society clinical rating system. Clin Orthop Relat Res 248:1–13

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Industrial research project of Science and Technology Department and the office of Education of Shaanxi Province (Grant Nos. 2016KTZDGY4-09, 17JZ004).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bo Hong.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hong, B., Yu, M. A collaborative filtering algorithm based on correlation coefficient. Neural Comput & Applic 31, 8317–8326 (2019). https://doi.org/10.1007/s00521-018-3857-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-018-3857-7

Keywords

Navigation