Skip to main content
Springer Nature Link
Log in

A systematic literature review on the state of research and practice of collaborative filtering technique and implicit feedback

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

User profiles in collaborative filtering (CF) recommendation technique are built based on ratings given by users on a set of items. The most eminent shortcoming of the CF technique is the sparsity problem. This problem refers to the low ratio of rated items by users to the total number of available items; hence the quality of recommendation will be affected. Most researchers use implicit data as a solution for sparsity problem, to decrease the dependency of CF technique on the user’s rating and this term is more common in this field. The aim of this research is to aggregate evidence on state of research and practice of CF and implicit data applying systematic literature review (SLR) which is a method for evidence-based software engineering (EBSE). EBSE has the potential value for synthesizing evidence and make this evidence available to practitioners and researchers with providing the best references and appropriate software engineering solutions for sparsity problem. We executed the standard systematic literature review method using a manual search in 5 prestigious databases and 38 studies were finally included for analyzing. This paper follows manifestation of Kitchenham’s SLR guidelines and describes in a great detail the process of selecting and analyzing research papers. This paper is first academic systematic literature review of CF technique along with implicit data from user behaviors and activities to aggregate existing evidence as a synthesis of best quality scientific studies. The 38 research papers are categorized into eleven application fields (movie, shopping, books, Social systems, music and others) and six data mining techniques (dimensionality reduction, association rule, heuristic methods and other). According to the review results, neighborhood formation is a relevant aspect of CF and it can be improved with the use of user-item preference matrix as implicit feedback mechanism, the most common domains of CF are in e-commerce and movie software applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. http://portal.acm.org.

  2. http://ieeexplore.ieee.org.

  3. http://link.springer.com.

  4. http://www.sciencedirect.com/science.

  5. http://online.sagepub.com.

References

  • Abdullah N, Xu Y, Geva S, Chen J (2010) Infrequent purchased product recommendation making based on user behaviour and opinions in E-commerce sites. In: IEEE international conference on data mining (ICDMW), pp 1084–1091

  • Acilar AM, Arslan A (2009) A collaborative filtering method based on artificial immune network. Expert Syst Appl 36(4):8324–8332

    Article  Google Scholar 

  • Aiolli F (2013) Efficient top-n recommendation for very large scale binary rated datasets. In: Proceedings of the 7th ACM conference on Recommender systems pp 273–280

  • Albadvi A, Shahbazi M (2009) A hybrid recommendation technique based on product category attributes. Expert Syst Appl 36(9):11480–11488

    Article  Google Scholar 

  • Bae JK, Kim J (2010) Integration of heterogeneous models to predict consumer behavior. Expert Syst Appl 37(3):1821–1826

  • Bai X, Wu J, Wang H, Zhang J, Yin W, Dong J (2011) Recommendation algorithms for implicit information. In: 2011 IEEE international conference on service operations, logistics, and informatics (SOLI), pp 202–207

  • Biolchini J, Gomes M, Cruz N, Horta T (2005) Systematic review in software engineering. Technical report RT-ES679/05, Software Engineering and Computer Science Department

  • Brereton P, Kitchenham B, Budgen D, Turner M, Khalil M (2007) Lessons from applying the systematic literature review process within the software engineering domain. J Syst Softw 80(4):571–583

    Article  Google Scholar 

  • Bu M, Luo SH, He J (2009) A fast collaborative filtering algorithm for implicit binary data. In: 10th international conference on the computer-aided industrial design and conceptual design, CAID and CD, pp 973–976

  • Cai Y, Li Q (2010) Personalized search by tag-based user profile and resource profile in collaborative tagging systems. In: Proceedings of the 19th ACM international conference on information and knowledge management, pp 969–978

  • Cao L, Guo M (2008) Consistent music recommendation in heterogeneous pervasive environment. In: ISPA ’08. International symposium on the parallel and distributed processing with applications, pp 495–501

  • Choi K, Yoo D, Kim G, Suh Y (2012) A hybrid online-product recommendation system: combining implicit rating-based collaborative filtering and sequential pattern analysis. Electron Commer Res Appl 11(4):309–317

    Article  Google Scholar 

  • Chunshan M, Huaying Sh (2011) User activity-based CF algorithm in value-added services. In: International conference on the management science and industrial engineering (MSIE), pp 793–798

  • Cui Y, Song Sh, He L, Guorong L (2012) A collaborative filtering algorithm based on user activity level. Paper In: Presented at international conference on the business intelligence and financial engineering (BIFE), pp 80–83

  • García-Borgoñon L, Barcelona MA, García-García JA, Alba M, Escalona MJ (2014) Software process modeling languages: a systematic literature review. Inf Softw Technol 56(2):103–116

    Article  Google Scholar 

  • Gotardo RA, Teixeira CAC, Zorzo SD (2008) An approach to recommender system applying usage mining to predict users interests. In: IWSSIP. 15th international conference on signals and image processing

  • Go G, Yang J, Park H, Han S (2010) Using online media sharing behavior as implicit feedback for collaborative filtering. In: IEEE second international conference on t the social computing (SocialCom), pp 439–445

  • Guy I, Zwerdling N, Ronen I, Carmel D, Uziel E (2010) Social media recommendation based on people and tags. In: Proceedings of the 33rd international ACM SIGIR conference on research and development in information retrieval, pp 194–201

  • Hang Y, Guiran C, Xingwei W (2009) A cold-start recommendation algorithm based on new user’s implicit information and multi-attribute rating matrix. In: HIS ’09. Ninth international conference on hybrid intelligent systems

  • He L, Wu F (2009) A time-context-based collaborative filtering algorithm. IEEE international conference on granular computing, 2009, GRC’09, pp 209–213

  • Hu Y, Koren Y, Volinsky C (2008) Collaborative filtering for implicit feedback datasets. In: Presented at the proceedings of the eighth IEEE international conference on data mining, pp 263–272

  • Kardan AA, Ebrahimi M (2013) A novel approach to hybrid recommendation systems based on association rules mining for content recommendation in asynchronous discussion groups. Inf Sci 219:93–110

    Article  Google Scholar 

  • Kim YS, Yum B-J, Song J, Kim SM (2005) Development of a recommender system based on navigational and behavioral patterns of customers in e-commerce sites. Expert Syst Appl 28(2):381–393

    Article  Google Scholar 

  • Kim HN, Ji AT, Ha I, Jo GS (2010) Collaborative filtering based on collaborative tagging for enhancing the quality of recommendation. Electron Commer Res Appl 9(1):73–83

    Article  Google Scholar 

  • Kim YS, Yum B (2011) Recommender system based on click stream data using association rule mining. Expert Syst Appl 38(10):13320–13327

    Article  Google Scholar 

  • Kitchenham B (2004) Procedures for performing systematic reviews, software engineering group; National ICT Australia Ltd., Keele; Eversleigh, Technical report Keele University technical report TR/SE-0401; NICTA Technical report 0400011T.1

  • Kitchenham B, Brereton P, Budgen D, Turner M, Bailey J, Linkman S (2009) Systematic literature reviews in software engineering—a systematic literature review. Inf Softw Technol 51(1):7–15

    Article  Google Scholar 

  • Kitchenham B, Brereton P (2013) A systematic review of systematic review process research in software engineering. Inf Softw Technol 55(12):2049–2075

    Article  Google Scholar 

  • Kitchenham B, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering version 2.3, Keele University and University of Durham, Technical report EBSE-2007-01

  • Lee TQ, Park Y, Park YT (2007) A similarity measure for collaborative filtering with implicit feedback. In: Huang DS (ed) Advanced intelligent computing theories and applications. With aspects of artificial intelligence. Springer, Berlin, pp 385–397

  • Lee TQ, Park Y, Park YT (2008) A time-based approach to effective recommender systems using implicit feedback. Expert Syst Appl 34(4):3055–3062

    Article  Google Scholar 

  • Lee TQ, Park Y, Park YT (2009) An empirical study on effectiveness of temporal information as implicit ratings. Expert Syst Appl 36(2, Part 1):1315–1321

    Article  Google Scholar 

  • Lee S, Cho Y, Kim S (2010) Collaborative filtering with ordinal scale-based implicit ratings for mobile music recommendations. Inf Sci 180(11):2142–2155

    Article  Google Scholar 

  • Liang H, Faqing W (2009) A time-context-based collaborative filtering algorithm. IEEE International Conference on Granular Computing, pp 209–213

  • Liang H, Xu Y, Li Y, Nayak R (2008) Collaborative filtering recommender systems using tag information. In: WI-IAT ’08. IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology

  • Liang H, Xu Y, Li Y, Nayak R (2009) Tag based collaborative filtering for recommender systems. In: Wen P (ed) Rough sets and knowledge technology. Springer, Berlin, pp 666–673

  • Li Y, Hu J, Zhai C, Chen Y (2010) Improving one-class collaborative filtering by incorporating rich user information. In: Proceedings of the 19th ACM international conference on Information and knowledge management, pp 959–968

  • Movahedian H, Khayyambashi MR (2014) Folksonomy-based user interest and disinterest profiling for improved recommendations: an ontological approach. J Inf Sci 40(5):594–610

    Article  Google Scholar 

  • Park DH, Kim Hk, Choi Y, Kim K (2012) A literature review and classification of recommender systems research. Expert Syst Appl 39(11):10059–10072

    Article  Google Scholar 

  • Qinjiao M, Boqin F, Shanliang P (2012) A study of Top-N recommendation on user behavior data. IEEE International Conference on Computer Science and Automation Engineering, vol 2, pp 582–586

  • Rafeh R, Bahrehmand A (2012) An adaptive approach to dealing with unstable behaviour of users in collaborative filtering systems. J Inf Sci 38(3):205–221

    Article  Google Scholar 

  • Rafter R, Bradley K, Smyth B (2000) Automated collaborative filtering applications for online recruitment services. In: Brusilovsky P (ed) Adaptive hypermedia and adaptive web-based systems. Springer, Berlin, pp 363–368

  • Renaud-Deputter S, Xiong T, Wang Sh (2013) Combining collaborative filtering and clustering for implicit recommender system. In: IEEE 27th international conference on the advanced information networking and applications (AINA), pp 748–755

  • Resnick P, Iakovou N, Sushak M, Bergstrom P, Riedl J (1994) GroupLens: an open architecture for collaborative filtering of netnews. ACM conference on Computer supported cooperative work, pp 175–186

  • Santos Junior, EB, Manzato MG, Goularte R (2013) Hybrid recommenders: incorporating metadata awareness into latent factor models. In: Proceedings of the 19th Brazilian symposium on multimedia and the web, pp 317–324

  • Shi Y, Karatzoglou A, Baltrunas L, Larson M, Hanjalic A, Oliver N (2012) TFMAP: optimizing MAP for top-n context-aware recommendation. In: Proceedings of the 35th international ACM SIGIR conference on research and development in information retrieval, pp 155–164

  • Shyu M, Haruechaiyasak C, Chen Sh, Zhao N (2005) Collaborative filtering by mining association rules from user access sequences. In: WIRI ’05. Paper presented at the web information retrieval and integration, pp 128 – 135

  • Sopchoke S, Kijsirikul B (2011) A step towards high quality one-class collaborative filtering using online social relationships. In: 2011 International conference on advanced computer science and information system (ICACSIS), pp 243–248

  • Strickroth S, Pinkwart N (2012) High quality recommendations for small communities: the case of a regional parent network. In: Proceedings of the sixth ACM conference on recommender systems, pp 107–114

  • Su JH, Chang WY, Tseng V (2013) Personalized music recommendation by mining social media tags. Procedia Comput Sci 22:303–312

    Article  Google Scholar 

  • Wang B, Rahimi M, Zhou D, Wang X (2012) Expectation-maximization collaborative filtering with explicit and implicit feedback. In: Brusilovsky P (ed) Advances in knowledge discovery and data mining. Springer, Berlin, pp 604–616

  • Wang Y, Uzun A, Bareth U, Küpper A (2013) Tracommender–exploiting continuous background tracking information on smartphones for location-based recommendations. In: Borcea C (ed) Mobile wireless middleware, operating systems, and applications. Springer, Berlin, pp 250–263

  • You Z, Sun Y, Chen Y, Zhang Y, Zhu Y (2006) The intelligent recommendation system based on amended rating matrix in TTP. In: Paper presented at the intelligent control and automation. WCICA , pp 4302–4306

  • Zanardi V, Capra L (2008) Social ranking: uncovering relevant content using tag-based recommender systems. In: Proceedings of the ACM conference on recommender systems

  • Zhang L, Meng XW, Chen JL, Xiong SC, Duan K (2009) Alleviating cold-start problem by using implicit feedback. In: Huang R (ed) Advanced data mining and applications. Springer, Berlin, pp 763–771

  • Zhao S, Du N, Nauerz A, Zhang X, Yuan Q, Fu R (2008) Improved recommendation based on collaborative tagging behaviors. In: Proceedings of the 13th international conference on Intelligent user interfaces pp 413–416

  • Zhao J, Ordóñez de Pablos P (2011) Regional knowledge management: the perspective of management theory. Behav Inform Technol 30(1):39–49

  • Zheng N, Li Q (2011) A recommender system based on tag and time information for social tagging systems. Expert Syst Appl 38(4):4575–4587

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Advanced Informatics School (AIS), Universiti Technologi Malaysia (UTM), Kuala Lumpur, Malaysia

    Maryam Khanian Najafabadi & Mohd Naz’ri Mahrin

Authors
  1. Maryam Khanian Najafabadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohd Naz’ri Mahrin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maryam Khanian Najafabadi.

Appendix 1: Table of the systematic review results

Appendix 1: Table of the systematic review results

See Table 9.

Table 9 Data extraction
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Najafabadi, M.K., Mahrin, M.N. A systematic literature review on the state of research and practice of collaborative filtering technique and implicit feedback. Artif Intell Rev 45, 167–201 (2016). https://doi.org/10.1007/s10462-015-9443-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-015-9443-9

Keywords

Search

Navigation