research-article

Teaching recommender systems at large scale: evaluation and lessons learned from a hybrid MOOC

Authors:

Joseph A. Konstan,

J.D. Walker,

D. Christopher Brooks,

Keith Brown,

Michael D. EkstrandAuthors Info & Claims

L@S '14: Proceedings of the first ACM conference on Learning @ scale conference

Pages 61 - 70

https://doi.org/10.1145/2556325.2566244

Published: 04 March 2014 Publication History

Get Access

Abstract

In Fall 2013 we offered an open online Introduction to Recommender Systems through Coursera, while simultaneously offering a for-credit version of the course on-campus using the Coursera platform and a flipped classroom instruction model. As the goal of offering this course was to experiment with this type of instruction, we performed extensive evaluation including surveys of demographics, self-assessed skills, and learning intent; we also designed a knowledge-assessment tool specifically for the subject matter in this course, administering it before and after the course to measure learning. We also tracked students through the course, including separating out students enrolled for credit from those enrolled only for the free, open course. This article reports on our findings.

References

[1]

M.D. Ekstrand, M. Ludwig, J.A. Konstan, and J.T. Riedl. 201 Rethinking the recommender research ecosystem: reproducibility, openness, and LensKit. In Proceedings of the Fifth ACM Conference on Recommender Systems (RecSys '11). ACM, New York, NY, USA, 133--140.

Digital Library

Google Scholar

[2]

D.A. McConnell, D.N. Steer, K.D. Owens, C. Knight, 2005. How students think: Implications for learning in introductory geoscience courses. Journal of Geoscience Education, Vol. 53, No. 4, 462--470.

Crossref

Google Scholar

[3]

B. Means, Y. Toyama, R. Murphy, M. Bakia, and K. Jones, 2010. Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. Washington, DC: Center for Technology in Learning, U.S. Department of Education.

Google Scholar

Cited By

View all

Wu LLi JLiu QHe LYang WZhang YCheng Y(2021)Information Measures of Knowledge Contribution: A New Method to Measure Knowledge Contribution in Collaborative Knowledge Building: An Information Theory PerspectiveJournal of Educational Computing Research10.1177/073563312199493959:7(1319-1342)Online publication date: 11-Feb-2021
https://doi.org/10.1177/0735633121994939
Johanes P(2019)Start of a ScienceProceedings of the Sixth (2019) ACM Conference on Learning @ Scale10.1145/3330430.3333631(1-10)Online publication date: 24-Jun-2019
https://dl.acm.org/doi/10.1145/3330430.3333631
Kross SGuo PLuckin RKlemmer SKoedinger K(2018)Students, systems, and interactionsProceedings of the Fifth Annual ACM Conference on Learning at Scale10.1145/3231644.3231662(1-10)Online publication date: 26-Jun-2018
https://dl.acm.org/doi/10.1145/3231644.3231662
Show More Cited By

Index Terms

Teaching recommender systems at large scale: evaluation and lessons learned from a hybrid MOOC
1. Applied computing
  1. Education

Recommendations

Teaching Recommender Systems at Large Scale: Evaluation and Lessons Learned from a Hybrid MOOC
Special Issue on Online Learning at Scale

In the fall of 2013, we offered an open online Introduction to Recommender Systems through Coursera, while simultaneously offering a for-credit version of the course on-campus using the Coursera platform and a flipped classroom instruction model. As the ...
Teaching and learning with MOOCs: computing academics' perspectives and engagement
ITiCSE '14: Proceedings of the 2014 conference on Innovation & technology in computer science education

During the past two years, Massive Open Online Courses (MOOCs) have created wide interest in the academic world raising both enthusiasm for new opportunities for universities and many concerns for the future of university education. The discussion has ...
MOOCs and their impact on academics
Koli Calling '14: Proceedings of the 14th Koli Calling International Conference on Computing Education Research

Massive Open Online Courses (MOOCs) have recently become a hot topic in the academic world, launching a wide ranging discussion on a number of issues. In this research, we surveyed academics' awareness, attitudes, perceptions, and experiences of MOOCs. ...

Comments

Information & Contributors

Information

Published In

L@S '14: Proceedings of the first ACM conference on Learning @ scale conference

March 2014

234 pages

ISBN:9781450326698

DOI:10.1145/2556325

General Chair:
Mehran Sahami
Stanford University, USA
,
Program Chairs:
Armando Fox
University of California, Berkeley, USA
,
Marti A. Hearst
University of California, Berkeley, USA
,
Michelene T.H. Chi
Arizona State University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

L@S 2014

Sponsor:

ACM Ed Board

L@S 2014: First (2014) ACM Conference on Learning @ Scale

March 4 - 5, 2014

Georgia, Atlanta, USA

Acceptance Rates

L@S '14 Paper Acceptance Rate 14 of 38 submissions, 37%;

Overall Acceptance Rate 117 of 440 submissions, 27%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
913
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Wu LLi JLiu QHe LYang WZhang YCheng Y(2021)Information Measures of Knowledge Contribution: A New Method to Measure Knowledge Contribution in Collaborative Knowledge Building: An Information Theory PerspectiveJournal of Educational Computing Research10.1177/073563312199493959:7(1319-1342)Online publication date: 11-Feb-2021
https://doi.org/10.1177/0735633121994939
Johanes P(2019)Start of a ScienceProceedings of the Sixth (2019) ACM Conference on Learning @ Scale10.1145/3330430.3333631(1-10)Online publication date: 24-Jun-2019
https://dl.acm.org/doi/10.1145/3330430.3333631
Kross SGuo PLuckin RKlemmer SKoedinger K(2018)Students, systems, and interactionsProceedings of the Fifth Annual ACM Conference on Learning at Scale10.1145/3231644.3231662(1-10)Online publication date: 26-Jun-2018
https://dl.acm.org/doi/10.1145/3231644.3231662
Cedillo PBermeo ABeltran PRodriguez-Ch PSerrano F(2018)A Method for Building Massive Open Online Courses for Elderly People MOOCEP: From the User Perceptions2018 IEEE Frontiers in Education Conference (FIE)10.1109/FIE.2018.8658587(1-7)Online publication date: Oct-2018
https://doi.org/10.1109/FIE.2018.8658587
Wongthongtham PChan KPotdar VAbu-Salih BGaikwad SJain P(2018)State-of-the-Art Ontology Annotation for Personalised Teaching and Learning and Prospects for Smart Learning Recommender Based on Multiple Intelligence and Fuzzy OntologyInternational Journal of Fuzzy Systems10.1007/s40815-018-0467-620:4(1357-1372)Online publication date: 27-Feb-2018
https://doi.org/10.1007/s40815-018-0467-6
Zhang MZhu JLui JWang XWolf ALiu YHu C(2017)A data-driven analysis of student efforts and improvements on a SPOC experimentProceedings of the ACM Turing 50th Celebration Conference - China10.1145/3063955.3063956(1-6)Online publication date: 12-May-2017
https://dl.acm.org/doi/10.1145/3063955.3063956
Sinclair JBoyatt RFoss JRocks C(2016)A study of user participation across different delivery modes of a massive open online courseInternational Journal of Learning Technology10.1504/IJLT.2016.07752211:2(93-113)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1504/IJLT.2016.077522
Lubis FRosmansyah YSupangkat S(2016)Experience in learners review to determine attribute relation for course completion2016 International Conference on ICT For Smart Society (ICISS)10.1109/ICTSS.2016.7792865(32-36)Online publication date: Jul-2016
https://doi.org/10.1109/ICTSS.2016.7792865
Kulkarni CKotturi YBernstein MKlemmer S(2016)Designing Scalable and Sustainable Peer Interactions OnlineDesign Thinking Research10.1007/978-3-319-40382-3_14(237-273)Online publication date: 10-Aug-2016
https://doi.org/10.1007/978-3-319-40382-3_14
Kulkarni CCambre JKotturi YBernstein MKlemmer S(2016)Talkabout: Making Distance Matter with Small Groups in Massive ClassesDesign Thinking Research10.1007/978-3-319-19641-1_6(67-92)Online publication date: 2016
https://doi.org/10.1007/978-3-319-19641-1_6
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations