research-article

Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics

Authors:

Alyssa Friend Wise,

Simone Nicole HausknechtAuthors Info & Claims

LAK '13: Proceedings of the Third International Conference on Learning Analytics and Knowledge

Pages 48 - 56

https://doi.org/10.1145/2460296.2460308

Published: 08 April 2013 Publication History

Abstract

This paper describes an application of learning analytics that builds on an existing research program investigating how students contribute and attend to the messages of others in online discussions. A pedagogical model that translates the concepts and findings of the research program into guidelines for practice and analytics with which students and instructors can assess their discussion participation are presented. The analytics are both embedded in the learning environment and extracted from it, allowing for integrated and reflective metacognitive activity. The pedagogical intervention is based on the principles of (1) Integration (2) Diversity (of Metrics) (3) Agency (4) Reflection (5) Parity and (6) Dialogue. Details of an initial implementation of this approach and preliminary findings are described. Initial results strongly support the value of student-teacher dialogue around the analytics. In contrast, instructor parity in analytics use did not seem as important to students as was expected. Analytics were reported as useful in validating invisible discussion activity, but at times triggered emotionally-charged responses.

References

[1]

Anderson, T. 2008. Towards a theory of online learning. In T. Anderson (Ed.) The theory and practice of online learning. (pp. 45--74). Edmonton, Canada: Athabasca University Press.

[2]

Boulos, M. N., & Wheeler, S. 2007. The emerging web 2.0 social software: An enabling suite of sociable technologies in health and health care education. Health Information and Libraries Journal, 24, 2--23.

[3]

Buckingham Shum, S. & Ferguson, R. 2012. Social learning analytics. Educational Technology & Society, 15(3), 3--26.

[4]

Clark, D., Sampson, V., Weinberger, A., & Erkens, G. 2007. Analytic frameworks for assessing dialogic argumentation in online learning environments. Educational Psychology Review, 19, 343--374.

[5]

Clow, D. 2012. The learning analytics cycle: closing the loop effectively. In Proceedings of the 2nd International Conference on Learning Analytics & Knowledge, (Vancouver, Canada, 2012).

Digital Library

[6]

Dennen, V. P. 2001. The design and facilitation of asynchronous discussion activities in web-based courses: Implications for instructional design theory. Doctoral thesis, IU-Bloomington

[7]

Duval, E. & Verbert, K. 2012. Learning analytics. E-Learning and Education, 1(8).

[8]

Ferguson, R. 2012. The state of learning analytics in 2012: A review and future challenges. Technical Report KMI-12-01, Knowledge Media Institute, The Open University

[9]

Ferguson, R. & Buckingham Shum, S. 2011. Learning analytics to identify exploratory dialogue within synchronous text chat. In Proceedings of the 1st International Conference on Learning Analytics & Knowledge, (Banff, Canada, 2011).

Digital Library

[10]

Govaerts, S., Verbert, K., Klerkx, J., Duval, E., 2010. December). Visualizing activities for self-reflection and awareness. In Proceedings of 9th International Conference on Web-based Learning, (Shanghai, China, 2010).

[11]

Henri, F. 1992. Computer conferencing and content analysis. In A. R. Kaye (Ed.), Collaborative learning through computer conferencing: the Najaden papers (pp. 117--36). Berlin: Springer-Verlag.

[12]

Herring, S. 1999. Interactional coherence in CMC. Journal of Computer-Mediated Communication, 4(4).

[13]

Hew, K. F., Cheung, W. S., & Ng, C. S. L. 2010. Student contribution in asynchronous online discussion: A review of the research and empirical exploration. Instructional Science, 38(6), 571--606.

[14]

Hewitt, J. 2003. How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computer Research, 28, 31--45.

[15]

Hewitt, J., Brett, C., & Peters, V. 2007. Scan rate: A new metric for the analysis of reading behaviors in asynchronous computer conferencing environments. American Journal of Distance Education, 21(4), 215--231.

[16]

Jonassen, D. H., & Kwon, H. I. 2001. Communication patterns in computer mediated versus face-to-face group problem solving. Educational Technology Research and Development, 49(1), 35--51.

[17]

Jovanović, J., Gaševic, D., Brooks, C., Devedžic, V., Hatala, M., Eap, T., et al. 2008. LOCO-Analyst: Semantic web technologies in learning content usage analysis. International Journal Of Continuing Engineering Education And Life Long Learning 18(1), 54--76.).

[18]

Jun, J. 2005. Understanding e-dropout. International Journal on E-Learning, 4(2), 229--240.

[19]

Kear, K. 2001. Following the thread in computer conferences. Computers & Education, 37, 81--99.

[20]

Knowlton, D. S. 2005. A taxonomy of learning through asynchronous discussion. Journal of Interactive Learning Research, 16(2), 155--177.

[21]

Lipponen, L. 2002. Exploring foundations for computer-supported collaborative learning. In Stahl, G. (Ed.) In Proceedings of Computer Supported Collaborative Learning (Boulder, USA, 2002)

Digital Library

[22]

Marbouti, F. 2012. Design, implementation and testing of a visual discussion forum to address new post bias. Masters thesis, Simon Fraser University.

[23]

McAlpine, L., & Weston, C. 2000. Reflection: Issues related to improving professors' teaching and students' learning. Instructional Science, 28(5), 363--385.

[24]

Pena-Shaff, J. B. & Nicholls, C. 2004. Analyzing student interactions and meaning construction in computer bulletin board discussions. Computers & Education, 42, 243--65.

Digital Library

[25]

Peters, V. & Hewitt, J. 2010. An investigation of student practices in asynchronous computer conferencing courses. Computers & Education, 54(4), 951--961.

Digital Library

[26]

Roll, I., Aleven, V., & Koedinger, K. R. 2010. The invention lab: Using a hybrid of model tracing and constraint- based modeling to offer intelligent support in inquiry environments. In Proceedings of the 10th International Conference on Intelligent Tutoring Systems. (Berlin, Germany, 2010)

Digital Library

[27]

Rovai, A. P. 2007. Facilitating online discussions effectively. The Internet and Higher Education, 10, 77--88.

[28]

Scardamalia, M. 2004. CSILE/Knowledge Forum. In Education and technology: An encyclopedia (pp. 183--192). Santa Barbara: ABC-CLIO.

[29]

Siemens, G., Gašević, D., Haythornthwaite, C., Dawson, S., Buckingham Shum, S., Ferguson, R., et al. 2011. Open Learning Analytics: An Integrated and Modularized Platform (Concept Paper): SOLAR.

[30]

Stahl, G. 2005. Group cognition in computer-assisted collaborative learning. Journal of Computer Assisted Learning, 21(2), 79--90.

[31]

Swan, K. 2003. Learning effectiveness: What the research tells us. In J. Bourne & J. C. Moore (Eds), Elements of quality online education, practice and direction (pp. 13--45). Needham, MA: Sloan Center for Online Education.

[32]

Thomas, M. 2002. Learning within incoherent structures: The space of online discussion forums. Journal of Computer Assisted Learning, 18, 351--366.

[33]

Webb, E., Jones, A., Barker, P., & van Schaik, P. 2004. Using e-learning dialogues in higher education. Innovations in Education and Teaching International, 41(1), 93--103.

[34]

Wise, A. F. Hausknecht, S., & Zhao, Y. In review. Relationships between speaking and listening in online discussions: An empirical examination. In Proceedings of Computer Supported Collaborative Learning, (Wisconson, USA, 2013)

[35]

Wise, A. F., Perera, N., Hsiao, Y., Speer, J. & Marbouti, F. 2012. Microanalytic case studies of individual participation patterns in an asynchronous online discussion in an undergraduate blended course. The Internet and Higher Education, 15, 108--117.

[36]

Wise, A. F., Speer, J., Marbouti, F. & Hsiao, Y. 2012. Broadening the notion of participation in online discussions: Examining patterns in learners' online listening behaviors. Advance online publication. Instructional Science.

[37]

Wise, A., Hsiao, Y., Marbouti, F., Speer, J. & Perera, N. 2012. Initial validation of "listening" behavior typologies for online discussions using microanalytic case studies. In Proceedings of International Conference of Learning Sciences, (Sydney, Australia, 2012).

[38]

Wise, A. F., Marbouti, F., Hsiao, Y. & Hausknecht, S. In press. A survey of factors contributing to learners' "listening" behaviors in asynchronous discussions. Accepted for publication in the Journal of Educational Computing Research.

[39]

Wise, A. F. & Chiu, M. M. 2013. The effects of summarizing roles on learner's listening behaviors in online discussions. Paper presented at the 2013 Annual Meeting of the American Educational Research Association, San Francisco, CA.

Cited By

Kong XLiu ZChen CLiu SXu ZTang Q(2025)Exploratory study of an AI-supported discussion representational tool for online collaborative learning in a Chinese universityThe Internet and Higher Education10.1016/j.iheduc.2024.10097364(100973)Online publication date: Jan-2025
https://doi.org/10.1016/j.iheduc.2024.100973
Anthraper NJaviya PIluru SChen LKleinsmith A(2024)PeerConnect: Co-Designing a Peer-Mentoring Support System with Computing Transfer StudentsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650936(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650936
Dai YLin ZLiu A(2024)Facilitating Students’ Adaptive Help-seeking and Peer Interactions through an Analytics-enhanced Forum in Engineering Design EducationProcedia CIRP10.1016/j.procir.2024.06.024128(292-297)Online publication date: 2024
https://doi.org/10.1016/j.procir.2024.06.024
Show More Cited By

Index Terms

Learning analytics for online discussions: a pedagogical model for intervention with embedded and extracted analytics
1. Applied computing
  1. Education

Recommendations

Designing pedagogical interventions to support student use of learning analytics
LAK '14: Proceedings of the Fourth International Conference on Learning Analytics And Knowledge

This article addresses a relatively unexplored area in the emerging field of learning analytics, the design of learning analytics interventions. A learning analytics intervention is defined as the surrounding frame of activity through which analytic ...
Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses

Individuals with strong self-regulated learning (SRL) skills, characterized by the ability to plan, manage and control their learning process, can learn faster and outperform those with weaker SRL skills. SRL is critical in learning environments that ...
Emotion analysis meets learning analytics: online learner profiling beyond numerical data
Koli Calling '14: Proceedings of the 14th Koli Calling International Conference on Computing Education Research

Learning analytics is an emerging field of research, which deals with collecting and analysing data about learners and their learning context, as well as developing solutions that utilise the analysed data. Traditionally, learning analytics methods ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

LAK '13: Proceedings of the Third International Conference on Learning Analytics and Knowledge

April 2013

300 pages

ISBN:9781450317856

DOI:10.1145/2460296

Editors:
Dan Suthers
University of Hawaii, USA
,
Katrien Verbert
Eindhoven University of Technology, The Netherlands
,
Erik Duval
University of Leuven, Belgium
,
Xavier Ochoa
Escuela Superior Politécnica del Litoral, Ecuador

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
K.U. Leuven: K.U. Leuven
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Social Sciences and Humanities Research Council of Canada

Conference

LAK '13

Sponsor:

SIGWEB
K.U. Leuven
SIGCHI

LAK '13: Third Conference on Learning Analytics and Knowledge

April 8 - 13, 2013

Leuven, Belgium

Acceptance Rates

LAK '13 Paper Acceptance Rate 16 of 58 submissions, 28%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

53
Total Citations
View Citations
1,092
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kong XLiu ZChen CLiu SXu ZTang Q(2025)Exploratory study of an AI-supported discussion representational tool for online collaborative learning in a Chinese universityThe Internet and Higher Education10.1016/j.iheduc.2024.10097364(100973)Online publication date: Jan-2025
https://doi.org/10.1016/j.iheduc.2024.100973
Anthraper NJaviya PIluru SChen LKleinsmith A(2024)PeerConnect: Co-Designing a Peer-Mentoring Support System with Computing Transfer StudentsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650936(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650936
Dai YLin ZLiu A(2024)Facilitating Students’ Adaptive Help-seeking and Peer Interactions through an Analytics-enhanced Forum in Engineering Design EducationProcedia CIRP10.1016/j.procir.2024.06.024128(292-297)Online publication date: 2024
https://doi.org/10.1016/j.procir.2024.06.024
da Silveira Fleck AZhu T(2024)Impact of Embedded Learning Strategy Activities: Student Engagement and PerformanceTechnology, Knowledge and Learning10.1007/s10758-023-09715-029:3(1475-1498)Online publication date: 9-Jan-2024
https://doi.org/10.1007/s10758-023-09715-0
Hooshyar DTammets KLey TAus KKollom K(2023)Learning Analytics in Supporting Student Agency: A Systematic ReviewSustainability10.3390/su15181366215:18(13662)Online publication date: 13-Sep-2023
https://doi.org/10.3390/su151813662
García-Senín SArguedas MDaradoumis T(2022)Using learning analytics to support STEAM students’ academic achievement and self-regulated learningResearch on Education and Media10.2478/rem-2022-000514:1(36-45)Online publication date: 8-Jun-2022
https://doi.org/10.2478/rem-2022-0005
Ye DPennisi S(2022)Analysing interactions in online discussions through social network analysisJournal of Computer Assisted Learning10.1111/jcal.1264838:3(784-796)Online publication date: 25-Jan-2022
https://doi.org/10.1111/jcal.12648
Khuzairi NCob ZHilaluddin T(2022)Towards understanding the synergetic relationship of data visualization with learning analytics: A review10TH INTERNATIONAL CONFERENCE ON APPLIED SCIENCE AND TECHNOLOGY10.1063/5.0104226(030030)Online publication date: 2022
https://doi.org/10.1063/5.0104226
Khan AKaliteevskii VShnai IChechurin L(2022)Systematic Assessment and Illustration of Students’ Online Discussion EngagementDigital Teaching and Learning in Higher Education10.1007/978-3-031-00801-6_7(145-164)Online publication date: 2-Nov-2022
https://doi.org/10.1007/978-3-031-00801-6_7
Hai-Jew S(2021)Designing “Concentrated Listening” for Advantageous Adult Learning With MultimediaResearch Anthology on Adult Education and the Development of Lifelong Learners10.4018/978-1-7998-8598-6.ch043(861-877)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-8598-6.ch043
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten