skip to main content
10.1145/3027385.3027446acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
research-article

Honing in on social learning networks in MOOC forums: examining critical network definition decisions

Published:13 March 2017Publication History

ABSTRACT

This study examines the impact of content-based network partitioning and tie definition on social network structures and interpretation for MOOC discussion forums. Using dynamic interrelated post and thread categorization [5] based on a previously developed natural language model [27], 817 threads containing 3124 discussion posts from 567 learners in a MOOC on the use of statistics in medicine were characterized as either related to the learning of course content or not. Content-related, non-content, and unpartitioned interaction networks were constructed based on five different tie definitions: Direct Reply, Star, Direct Reply+Star, Limited Copresence, and Total Copresence. Results showed content-related and non-content networks to have distinct characteristics at the network, community, and individual node levels, validating the usefulness of the content/non-content distinction as an analytic tool. Network properties were less sensitive to differences in tie definition with the exception of Total Copresence, which showed distinct characteristics presenting dangers for general use, but usefulness for detecting inflated social status due to "superthread" initiation.

References

  1. Agrawal, A., Venkatraman, J., Leonard, S., and Paepcke, A. 2015. YouEDU: addressing confusion in MOOC discussion forums by recommending instructional video clips. In Proceedings of the 8th International Conference on Education Data Mining (Madrid, Spain, June 26 -- 29, 2015). ACM, New York, NY, USA, 297--304.Google ScholarGoogle Scholar
  2. Breslow, L., Pritchard, D. E., DeBoer, J., Stump, G. S., Ho, A. D., and Seaton, D. T. 2013. Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice In Assessment, 8, 13--25.Google ScholarGoogle Scholar
  3. Cho, H., Gay, G., Davidson, B., and Ingraffea, A. 2007. Social networks, communication styles, and learning performance in a CSCL community. Computers and Education, 49, 2, 309--329. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cui, Y., and Wise, A. F. 2015. Identifying content-related threads in MOOC discussion forums. In Proceedings of the 2nd ACM Conference on Learning @ scale (Vancouver, Canada, March 14--18, 2015). ACM, New York, NY, USA, 299--303. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cui, Y., Wise, A. F., and Jin, W.Q. (in review). Humans and machines together: Improving characterization of large scale online discussions through dynamic interrelated post and thread categorization (DIPTiC).Google ScholarGoogle Scholar
  6. Dowell, N., Skrypnyk, O., Joksimović, S., Graesser, A. C., Dawson, S., Gašević, D., Vries, P. d., Hennis, T., and Kovanović, V. 2015. Modeling learners' social centrality and performance through language and discourse. In Proceedings of the 8th International Conference on Educational Data Mining (Madrid, Spain, June 26--29, 2015). ACM, New York, NY, USA, 250--257.Google ScholarGoogle Scholar
  7. Gillani, N., and Eynon, R. 2014. Communication patterns in massively open online courses. The Internet and Higher Education, 23, 18--26.Google ScholarGoogle ScholarCross RefCross Ref
  8. Gillani, N., Yasseri, T., Eynon, R., and Hjorth, I. 2014. Structural limitations of learning in a crowd: communication vulnerability and information diffusion in MOOCs. Nature Scientific Reports, 4.Google ScholarGoogle Scholar
  9. Gruzd, A.A., and Haythornthwaite, C. 2008. Automated discovery and analysis of social networks from threaded discussions. In Proceedings of the International Network of Social Network Analysts 2008, St. Pete Beach (St. Pete Beach, USA.2008). Retrieved Sep 28, 2016: http://hdl.handle.net/10150/105081.Google ScholarGoogle Scholar
  10. Hecking, T., Chounta, I. A., and Hoppe, H. U. 2016. Investigating social and semantic user roles in MOOC discussion forums. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 198--207. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Hew, K.F., and Cheung, W.S. 2014. Students' and instructors' use of massive open online courses (MOOCs): motivations and challenges. Educational Research Review, 12, 45--58.Google ScholarGoogle ScholarCross RefCross Ref
  12. Jiang, S., Fitzhugh, S. M., and Warschauer, M. 2014. Social positioning and performance in MOOCs. In Proceedings of Graph-Based Educational Data Mining Workshop at the 7th International Conference on Educational Data Mining (London, United Kingdom, 2014). CEUR-WS, 55--58.Google ScholarGoogle Scholar
  13. Jiang, Z., Zhang, Y., Liu, C., and Li, X. 2015. Influence analysis by heterogeneous network in MOOC forums: what can we discover? In Proceedings of the 8th International Conference on Education Data Mining (Madrid, Spain, June 26 -- 29, 2015). ACM, New York, NY, USA, 242--249.Google ScholarGoogle Scholar
  14. Joksimović, S., Manataki, A., Gašević, D., Dawson, S., Kovanović, V., & De Kereki, I. F. 2016. Translating network position into performance: importance of centrality in different network configurations. In Proceedings of the 6th International Conference on Learning Analytics & Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 314--323. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Kellogg, S., Booth, S., and Oliver, K. 2014. A social network perspective on peer supported learning in MOOCs for educators. The International Review of Research in Open and Distributed Learning, 15, 5.Google ScholarGoogle ScholarCross RefCross Ref
  16. Khalil, H., and Ebner, M. 2013. "How satisfied are you with your MOOC?" - a research study on interaction in huge online courses. In Proceedings of EdMedia 2013 (Victoria, Canada, June 24, 2013). AACE, 830--839.Google ScholarGoogle Scholar
  17. Kizilcec, R. F., Piech, C., and Schneider, E. 2013. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the 3rd International Conference on Learning Analytics and Knowledge (Leuven, Belgium, April 8 -- 12, 2013). ACM New York, NY, USA, 170--179. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Kuh, G. 2002. From promise to progress: how colleges and universities are using student engagement results to improve collegiate quality. National Survey of Student Engagement Annual Report. Bloomington, IN: Indiana University.Google ScholarGoogle Scholar
  19. McGuire, R. 2013. Building a sense of community in MOOCs. Campus Technology, 26, 12, 31--33.Google ScholarGoogle Scholar
  20. Poquet, L., and Dawson, S. 2016. Untangling MOOC learner networks. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 208--212. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Rosé, C. P., and Ferschke, O. 2016. Technology support for discussion based learning: from computer supported collaborative learning to the future of Massive Open Online Courses. International Journal of Artificial Intelligence in Education, 26, 2, 660--678.Google ScholarGoogle ScholarCross RefCross Ref
  22. Rossi, L.A., and Gnawali, O. 2014. Language independent analysis and classification of discussion threads in Coursera MOOC forums. In Proceedings of 2014 IEEE 15th International Conference on Information Reuse and Integration (San Francisco, USA, August 13 -- 14, 2014). IEEE, 654--661.Google ScholarGoogle Scholar
  23. Santos, J.L., Klerkx, J., Duval, E., Gago, D., and Rodríguez, L. 2014. Success, activity and drop-outs in MOOCs: an exploratory study on the UNED COMA courses. In Proceedings of the 4th International Conference on Learning Analytics and Knowledge (Indianapolis, USA, March 24--28, 2014). ACM New York, NY, USA, 98--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Stump, G. S., DeBoer, J., Whittinghill, J., and Breslow, L. 2013. Development of a framework to classify MOOC discussion forum posts: methodology and challenges. In Proceedings of NIPS 2013 Workshop on Data Driven Education (Lake Tahoe, United States, December 5 -- 8, 2013). NIPS Foundation, 1--20.Google ScholarGoogle Scholar
  25. Trentin, G. 2000. The quality-interactivity relationship in distance education. Educational Technology, 40, 1, 17--27.Google ScholarGoogle Scholar
  26. Wise, A. F., Chang, J., Duffy, T. M., and del Valle, R. 2004. The effects of teacher social presence on student satisfaction, engagement, and learning. Journal of Educational Computing Research, 31, 3, 247--271.Google ScholarGoogle ScholarCross RefCross Ref
  27. Wise, A. F., Cui, Y., Jin, W., and Vytasek, J. 2017. Mining for gold: identifying content-related MOOC discussion threads across domains through linguistic modeling. The Internet and Higher Education, 32, 11--28.Google ScholarGoogle ScholarCross RefCross Ref
  28. Wise, A. F., Cui, Y., and Vytasek, J. 2016. Bringing order to chaos in MOOC discussion forums with content-related thread identification. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016) ACM New York, NY, USA, 188--197. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Yusof, N., and Rahman, A. A. 2009. Students' interactions in online asynchronous discussion forum: a social network analysis. In Proceedings of 2009 International Conference on Education Technology and Computer (Singapore, Singapore, Apr 17 -- 20, 2009). IEEE, 25--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Zhu, M., Bergner, Y., Zhang, Y., Baker, R., Wang, Y., and Paquette, L. 2016. Longitudinal engagement, performance, and social connectivity: a MOOC case study using exponential random graph models. In Proceedings of the 6th International Conference on Learning Analytics and Knowledge (Edinburgh, UK, April 25--29, 2016). ACM, New York, NY, USA, 223--230. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Honing in on social learning networks in MOOC forums: examining critical network definition decisions

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge Conference
      March 2017
      631 pages
      ISBN:9781450348706
      DOI:10.1145/3027385

      Copyright © 2017 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 13 March 2017

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      LAK '17 Paper Acceptance Rate36of114submissions,32%Overall Acceptance Rate236of782submissions,30%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader