research-article

RecStore: an extensible and adaptive framework for online recommender queries inside the database engine

Authors:

Justin J. Levandoski,

Mohamed Sarwat,

Mohamed F. Mokbel,

Michael D. EkstrandAuthors Info & Claims

EDBT '12: Proceedings of the 15th International Conference on Extending Database Technology

Pages 86 - 96

https://doi.org/10.1145/2247596.2247608

Published: 27 March 2012 Publication History

Abstract

Most recommendation methods (e.g., collaborative filtering) consist of (1) a computationally intense offline phase that computes a recommender model based on users' opinions of items, and (2) an online phase consisting of SQL-based queries that use the model (generated offline) to derive user preferences and provide recommendations for interesting items. Current application usage trends require a completely online recommender process, meaning the recommender model must update in real time as new opinions enter the system. To tackle this problem, we propose RecStore, a DBMS storage engine module capable of efficient online model maintenance. Externally, models managed by RecStore behave as relational tables, thus existing SQL-based recommendation queries remain unchanged while gaining online model support. RecStore maintains internal statistics and data structures aimed at providing efficient incremental updates to the recommender model, while employing an adaptive strategy for internal maintenance and load shedding to realize a balance between efficiency in updates or query processing based on system workloads. RecStore is also extensible, supporting a declarative syntax for defining recommender models. The efficacy of RecStore is demonstrated by providing the implementation details of three state-of-the-art collaborative filtering models. We provide an extensive experimental evaluation of a prototype of RecStore, built inside the storage engine of PostgreSQL, using a real-life recommender system workload.

References

[1]

G. Adomavicius and A. Tuzhilin. Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions. TKDE, 17(6), 2005.

Digital Library

[2]

G. Adomavicius et al. Incorporating Contextual Information in Recommender Systems Using a Multidimensional Approach. TOIS, 23(1), 2005.

Digital Library

[3]

J. S. Breese, D. Heckerman, and C. Kadie. Epirical Analysis of Predictive Algorithms for Collaborative Filtering. In UAI, 1998.

Digital Library

[4]

R. Burke. Hybrid Recommender Systems: Survey and Experiments. User Modeling and User-Adapted Interaction, 12(4), 1997.

Digital Library

[5]

CoFE Recommender System: http://eecs.oregonstate.edu/iis/CoFE.

[6]

A. Das et al. Google News Personalization: Scalable Online Collaborative Filtering. In WWW, 2007.

Digital Library

[7]

S. Debnath, N. Ganguly, and P. Mitra. Feature Weighting in Content Based Recommendation System Using Social Network Analysis. In WWW, 2008.

Digital Library

[8]

Digg: http://digg.com.

[9]

Facebook: http://www.facebook.com.

[10]

Facebook turns on its 'Like' button: http://news.cnet.com/8301-1023_3-10160112-93.html.

[11]

G. H. Golub and C. F. V. Loan. Matrix Computations. Johns Hopkins, 1989.

[12]

Google Reader: www.google.com/reader.

[13]

A. Gupta and I. S. Mumick. Materialized Views: Techniques, Implementations, and Applications. MIT Press, 1999.

Digital Library

[14]

J. L. Herlocker, J. A. Konstan, A. Borchers, and J. Riedl. An Algorithmic Framework for Performing Collaborative Filtering. In SIGIR, 1999.

Digital Library

[15]

J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl. Evaluating Collaborative Filtering Recommender Systems. TOIS, 22(1), 2004.

Digital Library

[16]

Y. E. Ioannidis and G. Koutrika. Personalized Systems: Models and Methods from an IR and DB Perspective. In VLDB, 2005.

Digital Library

[17]

G. Karypis. Evaluation of Item-Based Top-N Recommendation Algorithms. In CIKM, 2001.

Digital Library

[18]

J. A. Konstan, B. N. Miller, D. Maltz, J. L. Herlocker, L. R. Gordon, and J. Riedl. GroupLens: Applying Collaborative Filtering to Usenet News. Commun. ACM, 40(3), 1997.

Digital Library

[19]

G. Koutrika, B. Bercovitz, and H. Garcia-Molina. FlexRecs: Expressing and Combining Flexible Recommendations. In SIGMOD, 2009.

Digital Library

[20]

B. Krulwich. Lifestyle Finder: Intelligent User Profiling Using Large-Scale Demographic Data. Artificial Intelligence Magazing, 18(2), 1997.

[21]

G. Linden, B. Smith, and J. York. Amazon.com Recommendations: Item-to-Item Collaborative Filtering. IEEE Internet Computing, 7(1), 2003.

Digital Library

[22]

S. M. McNee, J. Riedl, and J. A. Konstan. Making recommendations better: an analytic model for human-recommender interaction. In CHI, 2006.

Digital Library

[23]

B. N. Miller, I. Alber, S. K. Lam, J. A. Konstan, and J. Riedl. MovieLens Unplugged: Experiences with an Occasionally Connected Recommender System. In IUI, 2002.

Digital Library

[24]

B. N. Miller, J. A. Konstan, and J. Riedl. PocketLens: Toward a Personal Recommender System. TOIS, 22(3), 2004.

Digital Library

[25]

B. Mobasher et al. Toward trustworthy recommender systems: An analysis of attack models and algorithm robustness. ACM TOIT, 7(4), 2007.

Digital Library

[26]

MovieLens: http://www.movielens.org.

[27]

Movielens Datasets: http://www.grouplens.org/node/73.

[28]

PostgreSQL: http://www.postgresql.org.

[29]

P. Resnick, N. Iacovou, M. Suchak, P. Bergstrom, and J. Riedl. GroupLens: An Open Architecture for Collaborative Filtering of Netnews. In CSWC, 1994.

Digital Library

[30]

P. Resnick and H. R. Varian. Recommender Systems. Commun. ACM, 40(3), 1997.

Digital Library

[31]

B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-Based Collaborative Filtering Recommendation Algorithms. In WWW, 2001.

Digital Library

[32]

G. Shani, R. I. Brafman, and D. Heckerman. An MDP-Based Recommender System. In UAI, 2002.

Digital Library

[33]

A. Thor and E. Rahm. AWESOME - A Data Warehouse-based System for Adaptive Website Recommendations. In VLDB, 2004.

Digital Library

Cited By

Kersbergen BSprangers OSchelter SIves ZBonifati AEl Abbadi A(2022)Serenade - Low-Latency Session-Based Recommendation in e-Commerce at ScaleProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3517901(150-159)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3517901
Sarwat MSun Y(2022)Spatio-social DataEncyclopedia of Big Data Technologies10.1007/978-3-319-63962-8_69-2(1-5)Online publication date: 24-May-2022
https://doi.org/10.1007/978-3-319-63962-8_69-2
Kersbergen BSchelter S(2021)Learnings from a Retail Recommendation System on Billions of Interactions at bol.com2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00277(2447-2452)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00277
Show More Cited By

Recommendations

RecStore: Recommending Stores for Shopping Mall Customers
WebMedia '17: Proceedings of the 23rd Brazillian Symposium on Multimedia and the Web

Today, mobility is a key feature in the new generation of Internet, which provides a set of custom services through numerous terminals. Smartphones, for example, are a tendency and almost mandatory to anyone living in an urban and modern context. Most ...
User preference representation based on psychometric models
ADC '11: Proceedings of the Twenty-Second Australasian Database Conference - Volume 115

Neighbourhood-based collaborative filtering is one of the most popular recommendation techniques, and has been applied successfully in various fields. User ratings are often used by neighbourhood-based collaborative filtering to compute the similarity ...
A novel user-based collaborative filtering method by inferring tag ratings

User-based collaborative filtering is one of the most widely-used recommendation methods. It recommends items to a user based on her similar users' preferences. The essential part of user-based collaborative filtering is to infer users' similarities. A ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EDBT '12: Proceedings of the 15th International Conference on Extending Database Technology

March 2012

643 pages

ISBN:9781450307901

DOI:10.1145/2247596

Editors:
Elke Rundensteiner
Worcester Polytechnic Institute
,
Volker Markl
Technische Universität Berlin, Germany
,
Ioana Manolescu
INRIA, France
,
Sihem Amer-Yahia
QCRI, Doha, Qatar
,
Felix Naumann
Hasso Plattner Institute, Potsdam, Germany
,
Ismail Ari
Ozyegin University, Turkey

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Conference

EDBT '12

EDBT '12: 15th International Conference on Extending Database Technology

March 27 - 30, 2012

Berlin, Germany

Acceptance Rates

Overall Acceptance Rate 7 of 10 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
195
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kersbergen BSprangers OSchelter SIves ZBonifati AEl Abbadi A(2022)Serenade - Low-Latency Session-Based Recommendation in e-Commerce at ScaleProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3517901(150-159)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3517901
Sarwat MSun Y(2022)Spatio-social DataEncyclopedia of Big Data Technologies10.1007/978-3-319-63962-8_69-2(1-5)Online publication date: 24-May-2022
https://doi.org/10.1007/978-3-319-63962-8_69-2
Kersbergen BSchelter S(2021)Learnings from a Retail Recommendation System on Billions of Interactions at bol.com2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00277(2447-2452)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00277
Schelter SCelebi UDunning TMaltzahn CMalik T(2019)Efficient Incremental Cooccurrence Analysis for Item-Based Collaborative FilteringProceedings of the 31st International Conference on Scientific and Statistical Database Management10.1145/3335783.3335784(61-72)Online publication date: 23-Jul-2019
https://dl.acm.org/doi/10.1145/3335783.3335784
Magdy AAbdelhafeez LKang YOng EMokbel M(2019)Microblogs data management: a surveyThe VLDB Journal10.1007/s00778-019-00569-6Online publication date: 18-Sep-2019
https://doi.org/10.1007/s00778-019-00569-6
Sarwat MSun Y(2019)Spatio-social DataEncyclopedia of Big Data Technologies10.1007/978-3-319-77525-8_69(1569-1573)Online publication date: 20-Feb-2019
https://doi.org/10.1007/978-3-319-77525-8_69
Shafi JWaheed AVenkata Krishna PKrishna PGurumoorthy SObaidat M(2018)Investigating Recommender Systems in OSNsSocial Network Forensics, Cyber Security, and Machine Learning10.1007/978-981-13-1456-8_3(29-44)Online publication date: 30-Dec-2018
https://doi.org/10.1007/978-981-13-1456-8_3
Sarwat MSun Y(2018)Spatio-Social DataEncyclopedia of Big Data Technologies10.1007/978-3-319-63962-8_69-1(1-5)Online publication date: 8-Mar-2018
https://doi.org/10.1007/978-3-319-63962-8_69-1
Sarwat MMokbel M(2018)Collaborative FilteringEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_80733(509-513)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_80733
Sarwat MMokbel M(2018)Recommender SystemsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_80732(3124-3128)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_80732
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten