Skip to main content
Springer Nature Link
Log in

Enhancing recommendation accuracy of item-based collaborative filtering using Bhattacharyya coefficient and most similar item

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The item-based collaborative filtering technique recommends an item to the user from the rating of k-nearest items. Generally, a random value of k is considered to find nearest neighbor from item-item similarity matrix. However, consideration of a random value for k intuitively is not a rational approach, as different items may have different value of k nearest neighbor. Sparsity in the data set is another challenge in collaborative filtering, as number of co-rated items’ may be few or zero. Due to the above two reasons, collaborative filtering provides inaccurate recommendations, because the predicted rating may tend towards the Mean. The objective of the proposed work is to improve the accuracy by mitigating the above issues. Instead of using a random value of k, we use the most similar neighbor for each target item so as to predict the target item, since finding k for different target item is computationally expensive. Bhattacharyya Coefficient is used as a similarity measure to handle sparsity in the dataset. The performance of the proposed algorithm is tested the datasets of MovieLens and Film Trust, and experimental results reveal better prediction accuracy than the best of the prevalent prediction approaches exist in literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Recommender systems. http://www.cs.carleton.edu/cs_comps/0607/recommend/recommender/modelbased.htmlhttp://www.cs.carleton.edu/cs_comps/0607/recommend/recommender/modelbased.html, [Online; accessed 17-August-2019]

  2. Choi K, Suh Y (2013) A new similarity function for selecting neighbors for each target item in collaborative filtering. Knowl-Based Syst 37:146–153

    Article  Google Scholar 

  3. Karypis G (2001) Evaluation of item-based top-n recommendation algorithms. In: Proceedings of the Tenth international conference on information and knowledge management, CIKM ’01, pp 247–254

  4. Liu H, Hu Z, Mian AU, Tian H, Zhu X (2014) A new user similarity model to improve the accuracy of collaborative filtering. Knowl-Based Syst 56:156–166

    Article  Google Scholar 

  5. Collaborative filtering. https://en.wikipedia.org/wiki/Collaborative_filteringhttps://en.wikipedia.org/wiki/Collaborative_filtering, [Online; accessed 12-November-2017]

  6. Comparison of user-based and item-based collaborative filtering. [Online; accessed 17-August-2019]. https://medium.com/@wwwbbb8510/comparison-of-user-based-and-item-based/-collaborative-filtering-f58a1c8a3f1dhttps://medium.com/@wwwbbb8510/comparison-of-user-based-and-item-based/-collaborative-filtering-f58a1c8a3f1dhttps://medium.com/@wwwbbb8510/comparison-of-user-based-and-item-based/-collaborative-filtering-f58a1c8a3f1d

  7. Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, ACM, pp 285–295

  8. Yang Z, Wu B, Zheng K, Wang X, Lei L (2016) A survey of collaborative filtering-based recommender systems for mobile internet applications. IEEE Access 4:3273–3287

    Article  Google Scholar 

  9. Linden G, Jacobi J, Benson E (2001) Collaborative recommendations using item-to-item similarity mappings. [Google Patents]

  10. Deshpande M, Karypis G (2004) Item-based top-n recommendation algorithms. ACM Trans Inf Syst 22(1):143–177

    Article  Google Scholar 

  11. Patra BK, Launonen R, Ollikainen V, Nandi S (2015) A new similarity measure using bhattacharyya coefficient for collaborative filtering in sparse data. Knowl-Based Syst 82:163–177

    Article  Google Scholar 

  12. Li D, Miao C, Chu S, Mallen J, Yoshioka T, Srivastava P (2018) Stable Matrix Approximation for Top-N Recommendation on Implicit Feedback Data

  13. Xu J, Man H (2011) Dictionary learning based on laplacian score in sparse coding. In: Machine learning and data mining in pattern recognition - 7th international conference, pp 253–264

  14. Bobadilla J, Hernando A, Ortega F, Gutiérrez A (2012) Collaborative filtering based on significances. Inf Sci 185(1):1–17

    Article  Google Scholar 

  15. Ricci F, Rokach L, Shapira B, Kantor PB (2010) Recommender systems handbook, 1st edn. Springer, New York

    MATH  Google Scholar 

  16. Lu J, Yue J, Zhu L, Li G (2019) Variational mode decomposition denoising combined with improved bhattacharyya distance. Measurement 151:107283

    Article  Google Scholar 

  17. Wu J, Chen L, Feng Y, Zheng Z, Zhou M, Wu Z (2013) Predicting quality of service for selection by neighborhood-based collaborative filtering. IEEE Trans Systems, Man, and Cybernetics: Systems 43 (2):428–439

    Article  Google Scholar 

  18. Herlocker J, Konstan JA, Riedl J (2002) An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. Inf Retr 5:287–310

    Article  Google Scholar 

  19. Herlocker JL, Konstan JA, Borchers A, Riedl J (1999) An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval, pp 230–237

  20. Kim H-N, Ji A-T., Kim H-J, Jo G-S (2007) Error-Based collaborative filtering algorithm for Top-N recommendation

  21. Ahn HJ (2008) A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem. Inf Sci 178(1):37–51

    Article  Google Scholar 

  22. i Mansilla AT, de la Rosa i Esteva JL (2012) Asknext: an agent protocol for social search. Inf Sci 190:144–161

    Article  Google Scholar 

  23. Shen K, Liu Y, Zhang Z, Lu W (2017) Modified similarity algorithm for collaborative filtering. In: Uden L, Ting I-H (eds) Knowledge management in organizations. Springer International Publishing, pp 378–385

  24. Palak R, Nguyen NT (2017) An effective collaborative filtering based method for movie recommendation, pp 149–159

  25. Boratto L, Carta S, Fenu G (2017) Investigating the role of the rating prediction task in granularity-based group recommender systems and big data scenarios. Inf Sci 378:424–443

    Article  Google Scholar 

  26. Koohi H, Kiani K (2017) A new method to find neighbor users that improves the performance of collaborative filtering. Expert Syst Appl 83:30–39

    Article  Google Scholar 

  27. Stephen SC, Xie H, Rai S (2017) Measures of similarity in memory-based collaborative filtering recommender system: A comparison. In: Proceedings of the 4th Multidisciplinary International Social Networks Conference, ACM, pp 32:1–32:8

  28. Liu Y, Feng J, Lu J (2017) Collaborative filtering algorithm based on rating distance. In: Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication, ACM, pp 66:1–66:7

  29. Ai J, Li L, Su Z, Wu C (2017) Online-rating prediction based on an improved opinion spreading approach. In: 29Th chinese control and decision conference

  30. Birtolo C, Ronca D (2013) Advances in clustering collaborative filtering by means of fuzzy c-means and trust. Expert Syst Appl 40(17):6997–7009

    Article  Google Scholar 

  31. Ghazarian S, Nematbakhsh MA (2015) Enhancing memory-based collaborative filtering for group recommender systems. Expert Syst Appl 42(7):3801–3812

    Article  Google Scholar 

  32. Guo G (2013) Integrating trust and similarity to ameliorate the data sparsity and cold start for recommender systems. In: Seventh ACM conference on recommender systems, RecSys ’13, pp 451–454

  33. Guo G, Zhang J, Thalmann D (2014) Merging trust in collaborative filtering to alleviate data sparsity and cold start. Knowl-Based Syst 57:57–68

    Article  Google Scholar 

  34. Sun D, Luo Z, Zhang F (2011) A novel approach for collaborative filtering to alleviate the new item cold-start problem. In: 11th International Symposium on Communications and Information Technologies, ISCIT, pp 402–406

  35. Jorge AM, Vinagre J, Domingues M, Gama J, Soares C, Matuszyk P, Spiliopoulou M (2017) Scalable online Top-N recommender systems. Springer International Publishing

  36. Geuens S, Coussement K, De Bock KW (2018) A framework for configuring collaborative filtering-based recommendations derived from purchase data. Eur J Oper Res 265(1):208–218

    Article  MATH  Google Scholar 

  37. Adamopoulos P (2013) Notes on recommender systesm: a survey of state-of-the-art algorithms, beyond rating prediction accuracy approaches and business value perspectives

  38. Lohr SL (2009) Sampling: Design and Analysis. 2nd Edn, Cengage Learning

  39. Bobadilla J, Ortega F, Hernando A (2012) A collaborative filtering similarity measure based on singularities. Inform Process Manage 48(2):204–217

    Article  Google Scholar 

  40. Liu Y, Feng J, Lu J (2017) Collaborative filtering algorithm based on rating distance. In: Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication, pp 1–7

  41. Cacheda F, Carneiro V, Fernández D, Formoso V (2011) Comparison of collaborative filtering algorithms: Limitations of current techniques and proposals for scalable, high-performance recommender systems. ACM Trans Web 5(1):2:1–2:33

    Article  Google Scholar 

  42. Bilge A, Kaleli C (2014) A multi-criteria item-based collaborative filtering framework. In: 11th international joint conference on computer science and software engineering (JCSSE), pp 18– 22

  43. Hui S, Pengyu L, Kai Z (2011) Improving item-based collaborative filtering recommendation system with tag. In: 2nd International Conference on Artificial Intelligence, Management Science and Electronic Commerce (AIMSEC), pp 2142–2145

  44. Wen J, Zhou W (2012) An improved item-based collaborative filtering algorithm based on clustering method. J Compute Inform Syst, pp 571–578

  45. Koohi H, Kiani K, new method to find neighbor users A (2017) That improves the performance of collaborative filtering. Expert Syst Appl 83:30–39

  46. Ye F, Zhang H (2016) A collaborative filtering recommendation based on users’ interest and correlation of items. In: International conference on audio, language and image processing (ICALIP), pp 515–520

  47. Suryakant T, Mahara A (2016) New similarity measure based on mean measure of divergence for collaborative filtering in sparse environment. Procedia Computer Science 89:450–456

    Article  Google Scholar 

  48. Ayub M, Ghazanfar MA, Maqsood M, Saleem A (2018) A jaccard base similarity measure to improve performance of cf based recommender systems. In: International conference on information networking (ICOIN), IEEE, pp 1–6

  49. Al-Bashiri H, Abdulgabber MA, Romli A, Kahtan H An improved memory-based collaborative filtering method based on the topsis technique, PloS One 13 (10)

  50. Ding Y, Li X (2005) Time weight collaborative filtering. In: Proceedings of the 14th ACM international conference on Information and knowledge management, ACM, pp 485–49

  51. Zhang Z-P, Kudo Y, Murai T, Ren Y-G (2019) Enhancing recommendation accuracy of item-based collaborative filtering via item-variance weighting. Appl Sci 9(9):1928

    Article  Google Scholar 

  52. Gao M, Wu Z, Jiang F (2011) Userrank for item-based collaborative filtering recommendation. Inf Process Lett 111(9):440– 446

    Article  MathSciNet  MATH  Google Scholar 

  53. Jain A, Singh P, Dhar J (2019) Multi-objective item evaluation for diverse as well as novel item recommendations. Expert Systems with Applications 139:112857

    Article  Google Scholar 

  54. Linden G, Smith B, York J (2003) Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Computing 7(1):76–80

    Article  Google Scholar 

  55. Paterek A (2007) Improving regularized singular value decomposition for collaborative filtering. In: Proceedings of KDD cup and workshop, vol 2007, pp 5–8

  56. Lin D (1998) An information-theoretic definition of similarity. In: Proceedings of the Fifteenth international conference on machine learning, pp 296–304

  57. Alqadah F, Reddy CK, Hu J, Alqadah HF (2015) Biclustering neighborhood-based collaborative filtering method for top-n recommender systems. Knowl Inf Syst 44(2):475–491

    Article  Google Scholar 

  58. Gunawardana A, Shani G (2009) A survey of accuracy evaluation metrics of recommendation tasks. J Mach Learn Res 10:2935–2962

    MathSciNet  MATH  Google Scholar 

  59. Venables WN, Ripley BD (2002) Modern applied statistics with S, 4th edn. Springer, New York

    Book  MATH  Google Scholar 

  60. Givens GH, Hoeting JA (2005) Computational Statistics. 2nd Edn, Wiley

  61. Martinez WL, Martinez AR (2007) Computational statistics handbook with MATLAB. 2nd Edn, Chapman and Hall/CRC

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, National Institute of Technology, Durgapur, India

    Pradeep Kumar Singh, Suvrojit Das & Prasenjit Choudhury

  2. Department of Computer Science and Engineering, Kamla Nehru Institute of Technology, Sultanpur, India

    Pradeep Kumar Singh

  3. Department of Humanities and Social Sciences, National Institute of Technology, Durgapur, India

    Madhabendra Sinha

Authors
  1. Pradeep Kumar Singh
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Madhabendra Sinha
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Suvrojit Das
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Prasenjit Choudhury
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Prasenjit Choudhury.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Singh, P.K., Sinha, M., Das, S. et al. Enhancing recommendation accuracy of item-based collaborative filtering using Bhattacharyya coefficient and most similar item. Appl Intell 50, 4708–4731 (2020). https://doi.org/10.1007/s10489-020-01775-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-020-01775-4

Keywords