ABSTRACT
This study examines the impact of content-based network partitioning and tie definition on social network structures and interpretation for MOOC discussion forums. Using dynamic interrelated post and thread categorization [5] based on a previously developed natural language model [27], 817 threads containing 3124 discussion posts from 567 learners in a MOOC on the use of statistics in medicine were characterized as either related to the learning of course content or not. Content-related, non-content, and unpartitioned interaction networks were constructed based on five different tie definitions: Direct Reply, Star, Direct Reply+Star, Limited Copresence, and Total Copresence. Results showed content-related and non-content networks to have distinct characteristics at the network, community, and individual node levels, validating the usefulness of the content/non-content distinction as an analytic tool. Network properties were less sensitive to differences in tie definition with the exception of Total Copresence, which showed distinct characteristics presenting dangers for general use, but usefulness for detecting inflated social status due to "superthread" initiation.
- Agrawal, A., Venkatraman, J., Leonard, S., and Paepcke, A. 2015. YouEDU: addressing confusion in MOOC discussion forums by recommending instructional video clips. In Proceedings of the 8th International Conference on Education Data Mining (Madrid, Spain, June 26 -- 29, 2015). ACM, New York, NY, USA, 297--304.Google Scholar
- Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., and Seaton, D. T. 2013. Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice In Assessment, 8, 13--25.Google Scholar
- Cho, H., Gay, G., Davidson, B., and Ingraffea, A. 2007. Social networks, communication styles, and learning performance in a CSCL community. Computers and Education, 49, 2, 309--329. Google ScholarDigital Library
- Cui, Y., and Wise, A. F. 2015. Identifying content-related threads in MOOC discussion forums. In Proceedings of the 2nd ACM Conference on Learning @ scale (Vancouver, Canada, March 14--18, 2015). ACM, New York, NY, USA, 299--303. Google ScholarDigital Library
- Cui, Y., Wise, A. F., and Jin, W.Q. (in review). Humans and machines together: Improving characterization of large scale online discussions through dynamic interrelated post and thread categorization (DIPTiC).Google Scholar
- Dowell, N., Skrypnyk, O., Joksimović, S., Graesser, A. C., Dawson, S., Gašević, D., Vries, P. d., Hennis, T., and Kovanović, V. 2015. Modeling learners' social centrality and performance through language and discourse. In Proceedings of the 8th International Conference on Educational Data Mining (Madrid, Spain, June 26--29, 2015). ACM, New York, NY, USA, 250--257.Google Scholar
- Gillani, N., and Eynon, R. 2014. Communication patterns in massively open online courses. The Internet and Higher Education, 23, 18--26.Google ScholarCross Ref
- Gillani, N., Yasseri, T., Eynon, R., and Hjorth, I. 2014. Structural limitations of learning in a crowd: communication vulnerability and information diffusion in MOOCs. Nature Scientific Reports, 4.Google Scholar
- Gruzd, A.A., and Haythornthwaite, C. 2008. Automated discovery and analysis of social networks from threaded discussions. In Proceedings of the International Network of Social Network Analysts 2008, St. Pete Beach (St. Pete Beach, USA.2008). Retrieved Sep 28, 2016: http://hdl.handle.net/10150/105081.Google Scholar
- Hecking, T., Chounta, I. A., and Hoppe, H. U. 2016. Investigating social and semantic user roles in MOOC discussion forums. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 198--207. Google ScholarDigital Library
- Hew, K.F., and Cheung, W.S. 2014. Students' and instructors' use of massive open online courses (MOOCs): motivations and challenges. Educational Research Review, 12, 45--58.Google ScholarCross Ref
- Jiang, S., Fitzhugh, S. M., and Warschauer, M. 2014. Social positioning and performance in MOOCs. In Proceedings of Graph-Based Educational Data Mining Workshop at the 7th International Conference on Educational Data Mining (London, United Kingdom, 2014). CEUR-WS, 55--58.Google Scholar
- Jiang, Z., Zhang, Y., Liu, C., and Li, X. 2015. Influence analysis by heterogeneous network in MOOC forums: what can we discover? In Proceedings of the 8th International Conference on Education Data Mining (Madrid, Spain, June 26 -- 29, 2015). ACM, New York, NY, USA, 242--249.Google Scholar
- Joksimović, S., Manataki, A., Gašević, D., Dawson, S., Kovanović, V., & De Kereki, I. F. 2016. Translating network position into performance: importance of centrality in different network configurations. In Proceedings of the 6th International Conference on Learning Analytics & Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 314--323. Google ScholarDigital Library
- Kellogg, S., Booth, S., and Oliver, K. 2014. A social network perspective on peer supported learning in MOOCs for educators. The International Review of Research in Open and Distributed Learning, 15, 5.Google ScholarCross Ref
- Khalil, H., and Ebner, M. 2013. "How satisfied are you with your MOOC?" - a research study on interaction in huge online courses. In Proceedings of EdMedia 2013 (Victoria, Canada, June 24, 2013). AACE, 830--839.Google Scholar
- Kizilcec, R. F., Piech, C., and Schneider, E. 2013. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the 3rd International Conference on Learning Analytics and Knowledge (Leuven, Belgium, April 8 -- 12, 2013). ACM New York, NY, USA, 170--179. Google ScholarDigital Library
- Kuh, G. 2002. From promise to progress: how colleges and universities are using student engagement results to improve collegiate quality. National Survey of Student Engagement Annual Report. Bloomington, IN: Indiana University.Google Scholar
- McGuire, R. 2013. Building a sense of community in MOOCs. Campus Technology, 26, 12, 31--33.Google Scholar
- Poquet, L., and Dawson, S. 2016. Untangling MOOC learner networks. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 208--212. Google ScholarDigital Library
- Rosé, C. P., and Ferschke, O. 2016. Technology support for discussion based learning: from computer supported collaborative learning to the future of Massive Open Online Courses. International Journal of Artificial Intelligence in Education, 26, 2, 660--678.Google ScholarCross Ref
- Rossi, L.A., and Gnawali, O. 2014. Language independent analysis and classification of discussion threads in Coursera MOOC forums. In Proceedings of 2014 IEEE 15th International Conference on Information Reuse and Integration (San Francisco, USA, August 13 -- 14, 2014). IEEE, 654--661.Google Scholar
- Santos, J.L., Klerkx, J., Duval, E., Gago, D., and Rodríguez, L. 2014. Success, activity and drop-outs in MOOCs: an exploratory study on the UNED COMA courses. In Proceedings of the 4th International Conference on Learning Analytics and Knowledge (Indianapolis, USA, March 24--28, 2014). ACM New York, NY, USA, 98--102. Google ScholarDigital Library
- Stump, G. S., DeBoer, J., Whittinghill, J., and Breslow, L. 2013. Development of a framework to classify MOOC discussion forum posts: methodology and challenges. In Proceedings of NIPS 2013 Workshop on Data Driven Education (Lake Tahoe, United States, December 5 -- 8, 2013). NIPS Foundation, 1--20.Google Scholar
- Trentin, G. 2000. The quality-interactivity relationship in distance education. Educational Technology, 40, 1, 17--27.Google Scholar
- Wise, A. F., Chang, J., Duffy, T. M., and del Valle, R. 2004. The effects of teacher social presence on student satisfaction, engagement, and learning. Journal of Educational Computing Research, 31, 3, 247--271.Google ScholarCross Ref
- Wise, A. F., Cui, Y., Jin, W., and Vytasek, J. 2017. Mining for gold: identifying content-related MOOC discussion threads across domains through linguistic modeling. The Internet and Higher Education, 32, 11--28.Google ScholarCross Ref
- Wise, A. F., Cui, Y., and Vytasek, J. 2016. Bringing order to chaos in MOOC discussion forums with content-related thread identification. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 188--197. Google ScholarDigital Library
- Yusof, N., and Rahman, A. A. 2009. Students' interactions in online asynchronous discussion forum: a social network analysis. In Proceedings of 2009 International Conference on Education Technology and Computer (Singapore, Singapore, Apr 17 -- 20, 2009). IEEE, 25--29. Google ScholarDigital Library
- Zhu, M., Bergner, Y., Zhang, Y., Baker, R., Wang, Y., and Paquette, L. 2016. Longitudinal engagement, performance, and social connectivity: a MOOC case study using exponential random graph models. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016). ACM, New York, NY, USA, 223--230. Google ScholarDigital Library
Index Terms
- Honing in on social learning networks in MOOC forums: examining critical network definition decisions
Recommendations
Unpacking the relationship between discussion forum participation and learning in MOOCs: content is key
LAK '18: Proceedings of the 8th International Conference on Learning Analytics and KnowledgeThis study examined the relationship between discussion forum contributions and course assessment results in a statistics MOOC. An important feature of the study is that it distinguished between discussions that were related to the learning of course ...
Dynamics of MOOC discussion forums
LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge ConferenceIn this integrated study of dynamics in MOOCs discussion forums, we analyze the interplay of temporal patterns, discussion content, and the social structure emerging from the communication using mixed methods. A special focus is on the yet under-...
Exploring the relationship between social presence and learners’ prestige in MOOC discussion forums using automated content analysis and social network analysis
AbstractResearch has repeatedly proven the importance of social interactions in online learning contexts such as Massive Open Online Courses (MOOCs), where learners often reported isolation and a lack of peer support. Previous studies of ...
Highlights- Certain social presence predicts higher network prestige in MOOC discussion forum.
Comments