skip to main content
10.1145/1864708.1864726acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
research-article

Fast als-based matrix factorization for explicit and implicit feedback datasets

Published: 26 September 2010 Publication History

Abstract

Alternating least squares (ALS) is a powerful matrix factorization (MF) algorithm for both explicit and implicit feedback based recommender systems. As shown in many articles, increasing the number of latent factors (denoted by K) boosts the prediction accuracy of MF based recommender systems, including ALS as well. The price of the better accuracy is paid by the increased running time: the running time of the original version of ALS is proportional to K3. Yet, the running time of model building can be important in recommendation systems; if the model cannot keep up with the changing item portfolio and/or user profile, the prediction accuracy can be degraded.
In this paper we present novel and fast ALS variants both for the implicit and explicit feedback datasets, which offers better trade-off between running time and accuracy. Due to the significantly lower computational complexity of the algorithm - linear in terms of K - the model being generated under the same amount of time is more accurate, since the faster training enables to build model with more latent factors. We demonstrate the efficiency of our ALS variants on two datasets using two performance measures, RMSE and average relative position (ARP), and show that either a significantly more accurate model can be generated under the same amount of time or a model with similar prediction accuracy can be created faster; for explicit feedback the speed-up factor can be even 5-10.

Supplementary Material

JPG File (recsys2010-28092010-05-01.jpg)
MOV File (recsys2010-28092010-05-01.mov)

References

[1]
}}R. Bell, Y. Koren, and C. Volinsky. Modeling relationships at multiple scales to improve accuracy of large recommender systems. In KDD-07, 13th ACM Int. Conf. on Knowledge Discovery and Data Mining, pages 95--104, New York, NY, USA, 2007. ACM.
[2]
}}R. M. Bell and Y. Koren. Scalable collaborative filtering with jointly derived neighborhood interpolation weights. In ICDM-07, 7th IEEE Int. Conf. on Data Mining, pages 43--52, Omaha, Nebraska, USA, 2007.
[3]
}}R. M. Bell, Y. Koren, and C. Volinsky. The BellKor solution to the Netflix Prize. Technical Report, AT&T Labs Research, 2007.
[4]
}}J. Bennett and S. Lanning. The Netflix Prize. In KDD Cup Workshop at KDD-07, 13th ACM Int. Conf. on Knowledge Discovery and Data Mining, pages 3--6, San Jose, California, USA, 2007.
[5]
}}S. Funk. Netflix update: Try this at home, 2006. http://sifter.org/~simon/journal/20061211.html.
[6]
}}J. Herlocker, J. A. Konstan, and J. Riedl. An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. Inf. Retr., 5(4):287--310, 2002.
[7]
}}Y. Hu, Y. Koren, and C. Volinsky. Collaborative filtering for implicit feedback datasets. In ICDM-08, 8th IEEE Int. Conf. on Data Mining, pages 263--272, Pisa, Italy, 2008.
[8]
}}Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD-08: 13th ACM Int. Conf. on Knowledge Discovery and Data Mining, pages 426--434, New York, NY, USA, 2008.
[9]
}}A. Paterek. Improving regularized singular value decomposition for collaborative filtering. In KDD Cup Workshop at KDD-07, 13th ACM Int. Conf. on Knowledge Discovery and Data Mining, pages 39--42, San Jose, California, USA, 2007.
[10]
}}I. Pilászy and D. Tikk. Computational complexity reduction for factorization-based collaborative filtering algorithms. In EC-Web-09: 10th Int. Conf. on Electronic Commerce and Web Technologies, pages 229--239, 2009.
[11]
}}G. Takács, I. Pilászy, B. Németh, and D. Tikk. Scalable collaborative filtering approaches for large recommender systems. Journal of Machine Learning Research, 10:623--656, 2009.
[12]
}}G. Takács, I. Pilászy, B. Németh, and D. Tikk. Investigation of various matrix factorization methods for large recommender systems. In 2nd Netflix-KDD Workshop at KDD-08: 14th ACM Int. Conf. on Knowledge Discovery and Data Mining, Las Vegas, NV, USA, August 24, 2008.
[13]
}}Y. Zhou, D. Wilkinson, R. Schreiber, and R. Pan. Large-scale parallel collaborative filtering for the Netflix Prize. In AAIM-08: 4th Int. Conf. on Algorithmic Aspects in Information and Management, pages 337--348, Berlin, Heidelberg, 2008. Springer-Verlag.

Cited By

View all
  • (2025)An introduction to collaborative filtering through the lens of the Netflix PrizeKnowledge and Information Systems10.1007/s10115-024-02315-zOnline publication date: 10-Jan-2025
  • (2024)Safe Collaborative FilteringSSRN Electronic Journal10.2139/ssrn.4767721Online publication date: 2024
  • (2024)The Role of Unknown Interactions in Implicit Matrix Factorization — A Probabilistic ViewProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688100(219-227)Online publication date: 8-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '10: Proceedings of the fourth ACM conference on Recommender systems
September 2010
402 pages
ISBN:9781605589060
DOI:10.1145/1864708
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. alternating least squares
  2. collaborative filtering
  3. computational complexity
  4. implicit and explicit feedback
  5. matrix factorization
  6. ridge regression

Qualifiers

  • Research-article

Conference

RecSys '10
Sponsor:
RecSys '10: Fourth ACM Conference on Recommender Systems
September 26 - 30, 2010
Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)44
  • Downloads (Last 6 weeks)5
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)An introduction to collaborative filtering through the lens of the Netflix PrizeKnowledge and Information Systems10.1007/s10115-024-02315-zOnline publication date: 10-Jan-2025
  • (2024)Safe Collaborative FilteringSSRN Electronic Journal10.2139/ssrn.4767721Online publication date: 2024
  • (2024)The Role of Unknown Interactions in Implicit Matrix Factorization — A Probabilistic ViewProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688100(219-227)Online publication date: 8-Oct-2024
  • (2024)Stochastic Gradient Descent for matrix completionKnowledge-Based Systems10.1016/j.knosys.2023.111176283:COnline publication date: 11-Jan-2024
  • (2024)Automated recommendation model using ordinal probit regression factorization machinesInternational Journal of Data Science and Analytics10.1007/s41060-024-00623-9Online publication date: 14-Aug-2024
  • (2024)A Comprehensive Survey of Evaluation Techniques for Recommendation SystemsComputation of Artificial Intelligence and Machine Learning10.1007/978-3-031-71484-9_25(281-304)Online publication date: 25-Sep-2024
  • (2023)Matrix Factorization Techniques in Machine Learning, Signal Processing, and StatisticsMathematics10.3390/math1112267411:12(2674)Online publication date: 12-Jun-2023
  • (2023)Widespread Flaws in Offline Evaluation of Recommender SystemsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608839(848-855)Online publication date: 14-Sep-2023
  • (2023)Curse of "Low" Dimensionality in Recommender SystemsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591659(537-547)Online publication date: 19-Jul-2023
  • (2022)Revisiting the Performance of iALS on Item Recommendation BenchmarksProceedings of the 16th ACM Conference on Recommender Systems10.1145/3523227.3548486(427-435)Online publication date: 12-Sep-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media