Abstract
The study of how affect develops and manifests over time during learning is a popular area of research called affect dynamics. Students’ affective states are recorded in authentic settings like classrooms using direct observations by culturally sensitive, trained, and certified coders. A popular approach to studying affect dynamics in the last decade involved a transition metric called the L statistic. However, recent studies have reported statistical errors and other discrepancies with L statistic leading to questions about its reliability. Thus, we turn to epistemic network analysis (ENA), an emerging technique that is gaining popularity in studying the structure of temporal interconnections between codes. In this paper, we present an alternative approach to study affect dynamics by extending ENA to include directionality in the network edges to capture transitions. We also propose a new approach to running significance tests on network edges to identify significantly likely transitions. Then, we apply the two techniques – L statistic and ENA - to a previously collected affect dataset from a middle school math class, in order to better understand the trade-offs between these methods. Our analysis revealed that ENA could be a promising new approach to conduct affect dynamics analysis. In addition to avoiding statistical errors seen in L statistic, ENA offers better visualization which better emphasizes the magnitude of a transition’s strength. We discuss the assumptions in ENA that need to be vetted further and the possibility for new kinds of analysis in the future for affect dynamics research using ENA.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Baker, R.S.J.D., Rodrigo, M.M.T., Xolocotzin, U.E.: The dynamics of affective transitions in simulation problem-solving environments. In: Paiva, Ana C.R., Prada, R., Picard, Rosalind W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 666–677. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74889-2_58
Baker, R.S., D’Mello, S., Rodrigo, M.M.T., Graesser, A.: Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive-affective states during interactions with 3 different computer-based learning environments. Int. J. Hum Comput Stud. 68(4), 223–241 (2010)
Baker, R.S., Ocumpaugh, J.L., Andres, J.M.A.L.: BROMP quantitative field observations: a review. Learning Science: Theory, Research, and Practice, McGraw-Hill, New York (2020)
Bosch, N., D’Mello, S.: The affective experience of novice computer programmers. Int. J. Artif. Intell. Educ. 27(1), 181–206 (2017)
Bosch, N., Paquette, L.: (under review). What’s next? Edge cases in measuring transitions between sequential states (2020, submitted)
Botelho, A.F., Baker, R., Ocumpaugh, J., Heffernan, N.: Studying affect dynamics and chronometry using sensor-free detectors. In: Proceedings of the 11th International Conference on Educational Data Mining, pp. 157–166 (2018)
D’Mello, S., Person, N., Lehman, B.: Antecedent-consequent relationships and cyclical patterns between affective states and problem solving outcomes. In: AIED, pp. 57–64 (2009)
D’Mello, S., Graesser, A.: Dynamics of Affective states during complex learning. Learn. Instr. 22, 145–157 (2012)
DeFalco, J.A., et al.: Detecting and addressing frustration in a serious game for military training. Int. J. Artif. Intell. Educ. 28(2), 152–193 (2017). https://doi.org/10.1007/s40593-017-0152-1
Karumbaiah, S., Lizarralde, R., Allessio, D., Woolf, B.P., Arroyo, I., Wixon, N.: Addressing student behavior and affect with empathy and growth mindset. In: Educational Data Mining (2017)
Karumbaiah, S., Andres, J. M.A.L., Botelho, A.F., Baker, R.S., Ocumpaugh, J.S.: The implications of a subtle difference in the calculation of affect dynamics. In: 26th International Conference for Computers in Education (2018)
Karumbaiah, S., Baker, Ryan S., Ocumpaugh, J.: The case of self-transitions in affective dynamics. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) AIED 2019. LNCS (LNAI), vol. 11625, pp. 172–181. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23204-7_15
Karumbaiah, S., Baker, R. S., Ocumpaugh, J., Andres, J. M.A.L.: A Re-analysis and synthesis of data on affect dynamics in learning (2020, submitted)
Kuppens, P.: It’s about time: A special section on affect dynamics. Emotion Rev. 7(4), 297–300 (2015)
Marquart, C.L., Swiecki, Z., Collier, W., Eagan, B., Woodward, R., Shaffer, D.W.: rENA: epistemic network analysis (2019)
Matayoshi, J., Karumbaiah, S.: Adjusting the L statistic when self-transitions are excluded in affect dynamics. J. Educ. Data Min. 12(4), 1–23 (2020)
McQuiggan, S.W., Lester, J.: Modeling affect expression and recognition in an interactive learning environment. Int. J. Learn. Technol. 4(3–4), 216–233 (2009)
Ferreira Mello, R., Gašević, D.: What is the effect of a dominant code in an epistemic network analysis? In: Eagan, B., Misfeldt, M., Siebert-Evenstone, A. (eds.) ICQE 2019. CCIS, vol. 1112, pp. 66–76. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33232-7_6
Nye, B.D., et al.: Engaging with the scenario: affect and facial patterns from a scenario-based intelligent tutoring system. In: Penstein Rosé, C. (ed.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 352–366. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93843-1_26
Okur, E., Aslan, S., Alyuz, N., Arslan Esme, A., Baker, R.S.: Role of socio-cultural differences in labeling students’ affective states. In: Penstein Rosé, C. (ed.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 367–380. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93843-1_27
Rodrigo, M.M.T., Anglo, E., Sugay, J., Baker, R.: Useofun-super- vised clustering to characterize learner behaviors and affective states while using an intelligent tutoring system. In: International Conference on Computers in Education, pp. 57–64 (2008)
Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P.W., Paiva, A.: Automatic analysis of affective postures and body motion to detect engagement with a game companion. In: Proceedings of the 6th International Conference on Human-robot Interaction, pp. 305–312. ACM (2011)
Shaffer, D.W., Collier, W., Ruis, A.R.: A tutorial on epistemic network analysis: analyzing the structure of connections in cognitive, social, and interaction data. J. Learn. Anal. 3(3), 9–45 (2016)
Acknowledgments
We would like to thank the Penn Center for Learning Analytics (PCLA) for supporting this work and the discussions at the 2019 workshop on advanced ENA in the first international conference on quantitative ethnography (ICQE).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Karumbaiah, S., Baker, R.S. (2021). Studying Affect Dynamics Using Epistemic Networks. In: Ruis, A.R., Lee, S.B. (eds) Advances in Quantitative Ethnography. ICQE 2021. Communications in Computer and Information Science, vol 1312. Springer, Cham. https://doi.org/10.1007/978-3-030-67788-6_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-67788-6_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-67787-9
Online ISBN: 978-3-030-67788-6
eBook Packages: Computer ScienceComputer Science (R0)