Ryan Hardt
ABSTRACT
While recent research has explored how to keep learners engaged in massive open online courses (MOOCs), motivating sustained engagement in small private online courses (SPOCs) has received less attention. The recent rise in SPOC offerings by academic institutions significantly increases the need to better understand how best to motivate and support learners in these communities, which can be differentiated from those in MOOCs by their smaller size, fixed timeframe, instructor presence, and more predictable learning paths. This paper describes a system, “Small Private Online Course Keeper” (SPOCK), designed to support communities of learners in SPOCs and presents an experience report detailing its usage in five SPOCs taught over two semesters. This report focuses on the ability of SPOCK to motivate sustained lecture video engagement through two primary features: 1) a credit and reward system, and 2) timeline-anchored, “pseudo-anonymous” comments and replies. The credit and reward feature motivated system usage by 77% of survey respondents, and its pseudo-anonymity feature motivated system usage by 63% of respondents. Usage data reflects these reported levels of motivation, with 82% of students earning more than the minimum number of credits expected and over 63% of students voluntarily submitting comments or replies, 72% of which were posted anonymously. Further analysis showed that students earned credits steadily throughout the semesters through a variety of means, and their posts were found to be positive in tone and on-topic.
- Dorine C. Andrews. 2002. Audience-Specific Online Community Design. Commun. ACM 45, 4 (apr 2002), 64–68. https://doi.org/10.1145/505248.505275Google Scholar
Digital Library
- D. Bargeron, A. Gupta, J. Grudin, E. Sanocki, and F. Li. 2001. Asynchronous collaboration around multimedia and its application to on-demand training. In Proceedings of the 34th Annual Hawaii International Conference on System Sciences. 10 pp.–. https://doi.org/10.1109/HICSS.2001.926509Google ScholarCross Ref
- Tony Bergstrom, Andrew Harris, and Karrie Karahalios. 2011. Encouraging Initiative in the Classroom with Anonymous Feedback. In Human-Computer Interaction – INTERACT 2011, Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 627–642.Google ScholarCross Ref
- Fernanda Cesar Bonafini, Chungil Chae, Eunsung Park, and Kathryn Weed Jablokow. 2017. How much does student engagement with videos and forums in a MOOC affect their achievement?Online Learning Journal 21, 4 (Dec. 2017), 223–240. https://doi.org/10.24059/olj.v21i4.1270Google Scholar
- A. J. Bernheim Brush, David Bargeron, Jonathan Grudin, Alan Borning, and Anoop Gupta. 2002. Supporting Interaction Outside of Class: Anchored Discussions vs. Discussion Boards. In Proceedings of the Conference on Computer Support for Collaborative Learning: Foundations for a CSCL Community (Boulder, Colorado) (CSCL ’02). International Society of the Learning Sciences, 425–434.Google Scholar
- Janet Burge, Armando Fox, Dan Grossman, Gerald Roth, and Joe Warren. 2015. SPOCs: What, Why, and How. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education (Kansas City, Missouri, USA) (SIGCSE ’15). Association for Computing Machinery, New York, NY, USA, 595–596. https://doi.org/10.1145/2676723.2677331Google ScholarDigital Library
- Sarah M. Davis. 2007. Impact of Anonymity of Input in Next-Generation Classroom Networks. In Proceedings of the 8th Iternational Conference on Computer Supported Collaborative Learning (New Brunswick, New Jersey, USA) (CSCL’07). International Society of the Learning Sciences, 165–167.Google ScholarDigital Library
- Erhan Delen, Jeffrey Liew, and Victor Willson. 2014. Effects of interactivity and instructional scaffolding on learning: Self-regulation in online video-based environments. Computers & Education 78 (2014), 312–320. https://doi.org/10.1016/j.compedu.2014.06.018Google ScholarDigital Library
- Honglu Du, Mary Beth Rosson, and John M. Carroll. 2012. Augmenting Classroom Participation through Public Digital Backchannels. In Proceedings of the 17th ACM International Conference on Supporting Group Work (Sanibel Island, Florida, USA) (GROUP ’12). Association for Computing Machinery, New York, NY, USA, 155–164. https://doi.org/10.1145/2389176.2389201Google ScholarDigital Library
- Renée M Filius, Renske AM de Kleijn, Sabine G Uijl, Frans J Prins, Harold VM van Rijen, and Diederick E Grobbee. 2018. Strengthening dialogic peer feedback aiming for deep learning in SPOCs. Computers & Education 125 (2018), 86–100.Google ScholarDigital Library
- Armando Fox. 2013. From MOOCs to SPOCs. Commun. ACM 56, 12 (dec 2013), 38–40. https://doi.org/10.1145/2535918Google ScholarDigital Library
- Elena L. Glassman, Juho Kim, Andrés Monroy-Hernández, and Meredith Ringel Morris. 2015. Mudslide: A Spatially Anchored Census of Student Confusion for Online Lecture Videos. Association for Computing Machinery, New York, NY, USA, 1555–1564. https://doi.org/10.1145/2702123.2702304Google ScholarDigital Library
- Sherif Halawa, Derek Pang, Ngai-Man Cheung, and Bernd Girod. 2011. ClassX: An Open Source Interactive Lecture StreamingSystem. In Proceedings of the 19th ACM International Conference on Multimedia (Scottsdale, Arizona, USA) (MM ’11). Association for Computing Machinery, New York, NY, USA, 719–722. https://doi.org/10.1145/2072298.2072428Google ScholarDigital Library
- Markus Ketterl, Johannes Emden, and Oliver Vornberger. 2010. Using Social Navigation for Multimedia Content Suggestion. In 2010 IEEE Fourth International Conference on Semantic Computing. 448–449. https://doi.org/10.1109/ICSC.2010.99Google ScholarDigital Library
- Juho Kim, Elena L. Glassman, Andrés Monroy-Hernández, and Meredith Ringel Morris. 2015. RIMES: Embedding Interactive Multimedia Exercises in Lecture Videos. Association for Computing Machinery, New York, NY, USA, 1535–1544. https://doi.org/10.1145/2702123.2702186Google ScholarDigital Library
- Juho Kim, Philip J. Guo, Carrie J. Cai, Shang-Wen (Daniel) Li, Krzysztof Z. Gajos, and Robert C. Miller. 2014. Data-Driven Interaction Techniques for Improving Navigation of Educational Videos. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology(Honolulu, Hawaii, USA) (UIST ’14). Association for Computing Machinery, New York, NY, USA, 563–572. https://doi.org/10.1145/2642918.2647389Google ScholarDigital Library
- Yi-Chieh Lee, Wen-Chieh Lin, Fu-Yin Cherng, Hao-Chuan Wang, Ching-Ying Sung, and Jung-Tai King. 2015. Using Time-Anchored Peer Comments to Enhance Social Interaction in Online Educational Videos. Association for Computing Machinery, New York, NY, USA, 689–698. https://doi.org/10.1145/2702123.2702349Google ScholarDigital Library
- Zhicong Lu, Seongkook Heo, and Daniel J. Wigdor. 2018. StreamWiki: Enabling Viewers of Knowledge Sharing Live Streams to Collaboratively Generate Archival Documentation for Effective In-Stream and Post Hoc Learning. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 112 (nov 2018), 26 pages. https://doi.org/10.1145/3274381Google ScholarDigital Library
- Xiaojuan Ma and Nan Cao. 2017. Video-Based Evanescent, Anonymous, Asynchronous Social Interaction: Motivation and Adaption to Medium. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW ’17). Association for Computing Machinery, New York, NY, USA, 770–782. https://doi.org/10.1145/2998181.2998256Google ScholarDigital Library
- Tommy MacWilliam, R. J. Aquino, and David J. Malan. 2013. Engaging Students through Video: Integrating Assessment and Instrumentation. J. Comput. Sci. Coll. 28, 6 (June 2013), 169–178.Google Scholar
- Diogo S. Martins, Bruna C. R. Cunha, Cristiane A. Yaguinuma, Isabela Zaine, and Maria da Graça C. Pimentel. 2019. Effects of Interactive Video Annotations on Students’ Browsing Behavior and Perceived Workload. SIGAPP Appl. Comput. Rev. 19, 2 (Aug. 2019), 44–57. https://doi.org/10.1145/3357385.3357389Google ScholarDigital Library
- Toni-Jan Keith Palma Monserrat, Yawen Li, Shengdong Zhao, and Xiang Cao. 2014. L.IVE: An Integrated Interactive Video-Based Learning Environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3399–3402. https://doi.org/10.1145/2556288.2557368Google ScholarDigital Library
- Michael Moore. 1989. Three Types of Interaction. American Journal of Distance Education 3 (01 1989), 1–7. https://doi.org/10.1080/08923648909526659Google Scholar
- Matti Nelimarkka, Kai Kuikkaniemi, and Giulio Jacucci. 2014. A Field Trial of an Anonymous Backchannel Among Primary School Pupils. In Proceedings of the 18th International Conference on Supporting Group Work (Sanibel Island, Florida, USA) (GROUP ’14). Association for Computing Machinery, New York, NY, USA, 238–242. https://doi.org/10.1145/2660398.2660399Google ScholarDigital Library
- Marco Piccioni, Christian Estler, and Bertrand Meyer. 2014. SPOC-Supported Introduction to Programming. In Proceedings of the 2014 Conference on Innovation & Technology in Computer Science Education (Uppsala, Sweden) (ITiCSE ’14). Association for Computing Machinery, New York, NY, USA, 3–8. https://doi.org/10.1145/2591708.2591759Google ScholarDigital Library
- Juan Ran, GuiYun Zhang, Tong Zheng, and Wenhui Wang. 2018. Logistic Regression Analysis on Learning Behavior and Learning Effect Based on SPOC Data. In 2018 13th International Conference on Computer Science Education (ICCSE). 1–5. https://doi.org/10.1109/ICCSE.2018.8468834Google Scholar
- Evan F. Risko, Tom Foulsham, Shane Dawson, and Alan Kingstone. 2013. The Collaborative Lecture Annotation System (CLAS): A New TOOL for Distributed Learning. IEEE Transactions on Learning Technologies 6, 1 (2013), 4–13. https://doi.org/10.1109/TLT.2012.15Google ScholarDigital Library
- Keng-Soon Soo and Curt J Bonk. 1998. Interaction: What Does It Mean in Online Distance Education?.(1998).Google Scholar
- Sabine Uijl, Renée Filius, and Olle Ten Cate. 2017. Student interaction in small private online courses. Medical Science Educator 27, 2 (2017), 237–242.Google ScholarCross Ref
- Qunfang Wu, Yisi Sang, and Yun Huang. 2019. Danmaku: A New Paradigm of Social Interaction via Online Videos. Trans. Soc. Comput. 2, 2, Article 7 (jun 2019), 24 pages. https://doi.org/10.1145/3329485Google ScholarDigital Library
- Ying Yang, Huaimin Li, and Shuying Liu. 2020. Exploring Cooperative Learning in Programming SPOC. In Proceedings of the 2020 4th International Conference on Deep Learning Technologies (ICDLT) (Beijing, China) (ICDLT 2020). Association for Computing Machinery, New York, NY, USA, 44–48. https://doi.org/10.1145/3417188.3417203Google ScholarDigital Library
- Yaxing Yao, Jennifer Bort, and Yun Huang. 2017. Understanding Danmaku’s Potential in Online Video Learning. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems(Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 3034–3040. https://doi.org/10.1145/3027063.3053258Google ScholarDigital Library
- Matin Yarmand, Srishti Palani, and Scott Klemmer. 2021. Adjacent Display of Relevant Discussion Helps Resolve Confusion. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 143 (apr 2021), 11 pages. https://doi.org/10.1145/3449217Google ScholarDigital Library
- Dongsong Zhang, Lina Zhou, Robert O Briggs, and Jay F Nunamaker Jr. 2006. Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & management 43, 1 (2006), 15–27.Google Scholar
- Muqiang Zheng, Chien-Chi Chu, Yenchun Jim Wu, and Wanxing Gou. 2018. The Mapping of On-Line Learning to Flipped Classroom: Small Private Online Course. Sustainability 10, 3 (2018). https://doi.org/10.3390/su10030748Google Scholar
- Saijing Zheng, Mary Beth Rosson, Patrick C. Shih, and John M. Carroll. 2015. Understanding Student Motivation, Behaviors and Perceptions in MOOCs. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing(Vancouver, BC, Canada) (CSCW ’15). Association for Computing Machinery, New York, NY, USA, 1882–1895. https://doi.org/10.1145/2675133.2675217Google ScholarDigital Library
Index Terms
- A System to Motivate Sustained Lecture Video Engagement in Small Private Online Courses
Recommendations
Student engagement in massive open online courses
Completion rates in massive open online courses MOOCs are disturbingly low. Existing analysis has focused on patterns of resource access and prediction of drop-out using learning analytics. In contrast, the effectiveness of teaching programs in ...
Supporting learners' self-regulated learning in Massive Open Online Courses
AbstractIn MOOCs, learners are typically presented with great autonomy over their learning process. Therefore, learners should engage in self-regulated learning (SRL) in order to successfully study in a MOOC. Learners however often struggle to self-...
Highlights- Learners struggle to regulate their learning in massive open online courses (MOOCs).
- A self-regulated learning (SRL) intervention was implemented in three MOOCs.
- Learners' SRL was measured with trace data variables.
- ...
Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses
Individuals with strong self-regulated learning (SRL) skills, characterized by the ability to plan, manage and control their learning process, can learn faster and outperform those with weaker SRL skills. SRL is critical in learning environments that ...
Comments