Skip to main content
Log in

Collaborative filtering and kNN based recommendation to overcome cold start and sparsity issues: A comparative analysis

  • 1179: Multimedia Software Engineering: Challenges and Opportunities
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Collaborative Filtering (CF) has intrigued several researchers whose goal is to enhance Recommender System’s performance by mitigating their drawbacks. CF’s common idea is to recognize user’s preferences by considering their ratings given to the items. The best-known limitations of recommender systems are the cpld start and data sparsity. In this paper, we analyse the CF-based recommendation approaches used to overcome the 2 issues, viz. cold start and data sparsity. This work attempts to implement the recommendation systems by 1) Generating a user-item similarity matrix and prediction matrix by performing collaborative filtering using memory-based CF approaches viz. KNNBasic, KNNBaseline, KNNWithMeans, SVD, and SVD++. 2) Generating a user-item similarity matrix and prediction matrix by performing collaborative filtering using model-based CF approach viz. Co-Clustering. The results reveal that the CF implemented using the K-NNBaseline approach decreased error rate when applied to MovieTrust datasets using cross-validation (CV = 5, 10, and 15). This approach is proved to address the cold start, sparsity issues and provide more relevant items as a recommendation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. z
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Al Sabaawi A, Karacan H, Yenice Y (2021) Two models based on social relations and svd++ method for recommendation system

  2. Alhijawi B, Al-Naymat G, Obeid N, Awajan A (2021) Novel predictive model to improve the accuracy of collaborative filtering recommender systems. Inf Syst 96:101670

    Article  Google Scholar 

  3. Anwar T, Uma V (2019) Cd-spm: Cross-domain book recommendation using sequential pattern mining and rule mining. Journal of King Saud University-Computer and Information Sciences

  4. Anwar T, Uma V (2019) Mrec-crm: Movie recommendation based on collaborative filtering and rule mining approach. In: 2019 International conference on smart structures and systems (ICSSS), IEEE, pp 1–5

  5. Anwar T, Uma V (2019) A review of recommender system and related dimensions. In: Data, engineering and applications, Springer, pp 3–10

  6. Anwar T, Uma V (2020) A study and analysis of issues and attacks related to recommender system. In: Convergence of ICT and smart devices for emerging applications, Springer, pp 137–157

  7. Anwar T, Uma V (2021) Comparative study of recommender system approaches and movie recommendation using collaborative filtering. International Journal of System Assurance Engineering and Management 12(3):426–436

    Google Scholar 

  8. Anwar T, Uma V, Hussain MI (2020) Challenges and applications of recommender systems in e-commerce. In: Challenges and applications of data analytics in social perspectives, IGI global, pp 175–188

  9. Anwar T, Uma V, Srivastava G (2021) Rec-cfsvd++: Implementing recommendation system using collaborative filtering and singular value decomposition (svd)++. International Journal of Information Technology & Decision Making, pp 1–19

  10. Anwar T, Uma V, et al. (2020) Book recommendation for elearning using collaborative filtering and sequential pattern mining. In: 2020 International conference on data analytics for business and industry: Way towards a sustainable economy (ICDABI), IEEE, pp 1–6

  11. Bathla G, Aggarwal H, Rani R (2020) Autotrustrec: Recommender system with social trust and deep learning using autoencoder. Multimedia Tools and Applications 79(29):20845–20860

    Article  Google Scholar 

  12. Burke R (2007) Hybrid web recommender systems. In: The adaptive web, Springer, pp 377–408

  13. Chae DK, Lee SC, Lee SY, Kim SW (2018) On identifying k-nearest neighbors in neighborhood models for efficient and effective collaborative filtering. Neurocomputing 278:134–143

    Article  Google Scholar 

  14. Choi K, Yoo D, Kim G, Suh Y (2012) A hybrid online-product recommendation system: Combining implicit rating-based collaborative filtering and sequential pattern analysis. Electronic Commerce Research and Applications 11(4):309–317

    Article  Google Scholar 

  15. Feng L, Zhao Q, Zhou C (2020) Improving performances of top-n recommendations with co-clustering method. Expert Syst Appl 143:113078

    Article  Google Scholar 

  16. Forouzandeh S, Berahmand K, Rostami M (2020) Presentation of a recommender system with ensemble learning and graph embedding: a case on movielens. Multimedia Tools and Applications, pp 1–28

  17. Hassan T, McCrickard DS (2019) Trust and trustworthiness in social recommender systems. arXiv:1903.01780

  18. Huang L, Wang CD, Chao HY, Lai JH, Philip SY (2019) A score prediction approach for optional course recommendation via cross-user-domain collaborative filtering. IEEE Access 7:19550–19563

    Article  Google Scholar 

  19. Jazi SY, Kaedi M, Fatemi A (2021) An emotion-aware music recommender system: bridging the user’s interaction and music recommendation. Multimedia Tools and Applications, pp 1–16

  20. Kant S, Mahara T (2018) Merging user and item based collaborative filtering to alleviate data sparsity. International Journal of System Assurance Engineering and Management 9(1):173–179

    Google Scholar 

  21. Kant S, Mahara T, Jain VK, Jain DK (2019) Fuzzy logic based similarity measure for multimedia contents recommendation. Multimedia Tools and Applications 78(4):4107–4130

    Article  Google Scholar 

  22. Karabadji NEI, Beldjoudi S, Seridi H, Aridhi S, Dhifli W (2018) Improving memory-based user collaborative filtering with evolutionary multi-objective optimization. Expert Syst Appl 98:153–165

    Article  Google Scholar 

  23. Kim M, Park SO (2013) Group affinity based social trust model for an intelligent movie recommender system. Multimedia Tools and Applications 64(2):505–516

    Article  Google Scholar 

  24. Kluver D, Ekstrand MD, Konstan JA (2018) Rating-based collaborative filtering: algorithms and evaluation. In: Social information access, Springer, pp 344–390

  25. Kumar P, Kumar V, Thakur RS (2018) A new approach for rating prediction system using collaborative filtering. Iran Journal of Computer Science, pp 1–7

  26. Kumar P, Thakur RS (2018) Recommendation system techniques and related issues: a survey. Int J Inf Technol 10(4):495–501

    Google Scholar 

  27. Kumar V (2020) Evaluation of computationally intelligent techniques for breast cancer diagnosis. Neural Computing and Applications, pp 1–14

  28. Kumar V, Thakur RS (2017) Jaccard similarity based mining for high utility webpage sets from weblog database. Int J Intell Eng Syst 10(6):211–220

    MathSciNet  Google Scholar 

  29. Li M, Wen L, Chen F (2021) A novel collaborative filtering recommendation approach based on soft co-clustering. Physica A: Statistical Mechanics and its Applications 561:125140

    Article  MathSciNet  Google Scholar 

  30. Li Y, Liu J, Ren J, Chang Y (2020) A novel implicit trust recommendation approach for rating prediction. IEEE Access 8:98305–98315

    Article  Google Scholar 

  31. Lin W, Zhao Y, Philip SY, Deng B (2014) An effective approach on overlapping structures discovery for co-clustering. In: Asia-pacific web conference, Springer, pp 56–67

  32. Ricci F, Rokach L, Shapira B (2011) Introduction to recommender systems handbook. In: Recommender systems handbook, Springer, pp 1–35

  33. Sharma M, Ahuja L, Kumar V (2019) A hybrid filtering approach for an improved context-aware recommender system. Recent Patents on Engineering 13 (1):39–47

    Article  Google Scholar 

  34. Subramaniyaswamy V, Logesh R (2017) Adaptive knn based recommender system through mining of user preferences. Wirel Pers Commun 97(2):2229–2247

    Article  Google Scholar 

  35. Tahmasebi F, Meghdadi M, Ahmadian S, Valiallahi K (2020) A hybrid recommendation system based on profile expansion technique to alleviate cold start problem. Multimedia Tools and Applications, pp 1–16

  36. Walek B, Fojtik V (2020) A hybrid recommender system for recommending relevant movies using an expert system. Expert Syst Appl 158:113452

    Article  Google Scholar 

  37. Zahir A, Yuan Y, Moniz K (2019) Agreereltrust—a simple implicit trust inference model for memory-based collaborative filtering recommendation systems. Electronics 8(4):427

    Article  Google Scholar 

  38. Zhang C, Yu L, Wang Y, Shah C, Zhang X (2017) Collaborative user network embedding for social recommender systems. In: Proceedings of the 2017 SIAM international conference on data mining, SIAM, pp 381–389

  39. Zhou X, Shu W, Lin F, Wang B (2018) Confidence-weighted bias model for online collaborative filtering. Appl Soft Comput 70:1042–1053

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Taushif Anwar.

Ethics declarations

Conflict of Interests

The authors declare no conflicts of interest regarding this article’s publication.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Anwar, T., Uma, V., Hussain, M.I. et al. Collaborative filtering and kNN based recommendation to overcome cold start and sparsity issues: A comparative analysis. Multimed Tools Appl 81, 35693–35711 (2022). https://doi.org/10.1007/s11042-021-11883-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11883-z

Keywords

Navigation