Gloria Milena Fernandez-Nieto
Simon Buckingham Shum
ABSTRACT
In nursing education through team simulations, students must learn to position themselves correctly in coordination with colleagues. However, with multiple student teams in action, it is difficult for teachers to give detailed, timely feedback on these spatial behaviours to each team. Indoor-positioning technologies can now capture student spatial behaviours, but relatively little work has focused on giving meaning to student activity traces, transforming low-level x/y coordinates into language that makes sense to teachers. Even less research has investigated if teachers can make sense of that feedback. This paper therefore makes two contributions. (1) Methodologically, we document the use of Epistemic Network Analysis (ENA) as an approach to model and visualise students’ movements. To our knowledge, this is the first application of ENA to analyse human movement. (2) We evaluated teachers’ responses to ENA diagrams through qualitative analysis of video-recorded sessions. Teachers constructed consistent narratives about ENA diagrams’ meaning, and valued the new insights ENA offered. However, ENA’s abstract visualisation of spatial behaviours was not intuitive, and caused some confusions. We propose, therefore, that the power of ENA modelling can be combined with other spatial representations such as a classroom map, by overlaying annotations to create a more intuitive user experience.
- Karan Ahuja, Dohyun Kim, Franceska Xhakaj, Virag Varga, Anne Xie, Stanley Zhang, Jay Townsend, Chris Harrison, Amy Ogan, and Yuvraj Agarwal. 2019. EduSense: Practical Classroom Sensing at Scale. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (Sep 2019), 1–26. https://doi.org/10.1145/3351229Google Scholar
Digital Library
- Pengcheng An, Saskia Bakker, Sara Ordanovski, Ruurd Taconis, and Berry Eggen. 2018. ClassBeacons: Designing Distributed Visualization of Teachers’ Physical Proximity in the Classroom. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, USA, 357–367. https://doi.org/10.1145/3173225.3173243Google ScholarDigital Library
- Sean Andrist, Wesley Collier, Michael Gleicher, Bilge Mutlu, and David W. Shaffer. 2015. Look together: analyzing gaze coordination with epistemic network analysis. Frontiers in Psychology 6 (Jul 2015), 1016. https://doi.org/10.3389Google Scholar
- Liz Berragan. 2011. Simulation: An effective pedagogical approach for nursing?Nurse Education Today 31, 7 (2011), 660–663. https://doi.org/10.1016/j.nedt.2011.01.019Google Scholar
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (Jan 2006), 77–101. https://doi.org/10.1191/1478088706qp063oaGoogle ScholarCross Ref
- Simon Buckingham Shum, Vanessa Echeverria, and Roberto Martinez-Maldonado. 2019. The Multimodal Matrix as a Quantitative Ethnography Methodology. In International Conference on Quantitative Ethnography. Springer, 26–40. https://doi.org/10.1007/978-3-030-33232-7_3Google ScholarCross Ref
- Adam Cheng, Walter Eppich, Taylor Sawyer, and Vincent Grant. 2018. Debriefing: the state of the art and science in healthcare simulation. Healthcare simulation education: evidence, theory and practice. Chichester: Wiley (2018), 158–64. https://doi.org/10.1002/9781119061656.ch21Google Scholar
- Edwin Chng, Mohamed Seyam, William Yao, and Bertrand Schneider. 2020. Using Motion Sensors to Understand Collaborative Interactions in Digital Fabrication Labs. In International Conference on Artificial Intelligence in Education. Springer, Cham, 118–128. https://doi.org/10.1007/978-3-030-52237-7_10Google ScholarDigital Library
- W. Collier. 2015. Application of ENA-based network analyses to fMRI data on school-children’s acquisition of number symbols. In Discovery Challenge Research Symposium. Wisconsin Institutes for Discovery, Madison, Wisconsin, USA.Google Scholar
- Andras Csanadi, Brendan Eagan, Ingo Kollar, David Williamson Shaffer, and Frank Fischer. 2018. When coding-and-counting is not enough: using epistemic network analysis (ENA) to analyze verbal data in CSCL research. International Journal of Computer-Supported Collaborative Learning 13, 4 (Dec 2018), 419–438. https://doi.org/10.1007/s11412-018-9292-zGoogle ScholarCross Ref
- Vanessa Echeverria, Roberto Martinez-Maldonado, and Simon Buckingham S.2019. Towards collaboration translucence: Giving meaning to multimodal group data. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–16. https://doi.org/10.1145/3290605.3300269Google Scholar
- Vanessa Echeverria, Roberto Martinez-Maldonado, Tamara Power, Carolyn Hayes, and Simon Buckingham Shum. 2018. Where Is the Nurse? Towards Automatically Visualising Meaningful Team Movement in Healthcare Education. In Proceedings International Conference on Artificial Intelligence in Education. Springer International Publishing, Cham, 74–78. https://doi.org/10.1007/978-3-319-93846-2_14Google ScholarCross Ref
- Máverick Ferreira, Vitor Rolim, Rafael Ferreira Mello, Rafael Dueire Lins, Guanliang Chen, and Dragan Gašević. 2020. Towards automatic content analysis of social presence in transcripts of online discussions. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge. 141–150.Google ScholarDigital Library
- Marva Foster, Marie Gilbert, Darlene Hanson, Kathryn Whitcomb, and Crystal Graham. 2019. Use of simulation to develop teamwork skills in prelicensure nursing students: an integrative review. Nurse educator 44, 5 (2019), E7–E11. https://doi.org/10.1097/NNE.0000000000000616Google ScholarCross Ref
- Kristin L. Fraser, Michael J. Meguerdichian, Jolene T. Haws, Vincent J. Grant, Komal Bajaj, and Adam Cheng. 2018. Cognitive Load Theory for debriefing simulations: implications for faculty development. Advances in Simulation 3, 1 (Dec 2018), 28. https://doi.org/10.1186/s41077-018-0086-1Google ScholarCross Ref
- Janet Gardner. 2014. Spatial ability in registered nurses.Ph.D. Dissertation. University of North Texas, Texas.Google Scholar
- Dragan Gašević, Srećko Joksimović, Brendan R Eagan, and David Williamson Shaffer. 2019. SENS: Network analytics to combine social and cognitive perspectives of collaborative learning. Computers in Human Behavior 92 (2019), 562–577. https://doi.org/10.1016/j.chb.2018.07.003Google ScholarDigital Library
- Edward T. Hall. 1963. A System for the Notation of Proxemic Behavior. American Anthropologist 65, 5 (1963), 1003–1026.Google ScholarCross Ref
- Marc Hassenzahl and Daniel Ullrich. 2007. To do or not to do: Differences in user experience and retrospective judgments depending on the presence or absence of instrumental goals. Interacting with Computers 19, 4 (Jul 2007), 429–437. https://doi.org/10.1016/j.intcom.2007.05.001Google ScholarDigital Library
- Tiffany Herder, Zachari Swiecki, Simon Fougt, Andreas Tamborg, Benjamin Allsopp, David W. Shaffer, and Morten Misfeldt. 2018. Supporting teachers’ intervention in students’ virtual collaboration using a network based model. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge. ACM, New York, NY, USA, 21–25. https://doi.org/10.1145/3170358.3170394Google ScholarDigital Library
- Michaela Kolbe and Margarete Boos. 2019. Laborious but elaborate: The benefits of really studying team dynamics. In Frontiers in Psychology, Vol. 10. Frontiers Media S.A., 1478. https://doi.org/10.3389/fpsyg.2019.01478Google Scholar
- Bette Mariani and Jessica Doolen. 2016. Nursing Simulation Research: What Are the Perceived Gaps?Clinical Simulation in Nursing 12, 1 (2016), 30–36. https://doi.org/10.1016/j.ecns.2015.11.004Google Scholar
- Gabriele Marini. 2019. Towards indoor localisation analytics for modelling flows of movements. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. 377–382. https://doi.org/10.1145/3341162.3349306Google ScholarDigital Library
- Roberto Martinez-Maldonado. 2019. ”I Spent More Time with that Team”: Making Spatial Pedagogy Visible Using Positioning Sensors. In Proceedings of the 9th International Conference on Learning Analytics & Knowledge - LAK19. ACM Press, New York, New York, USA, 21–25. https://doi.org/10.1145/3303772.3303818Google ScholarDigital Library
- Roberto Martinez-Maldonado, Vanessa Echeverria, Jurgen Schulte, Antonette Shibani, Katerina Mangaroska, and Simon Buckingham S.2020. Moodoo: Indoor Positioning Analytics for Characterising Classroom Teaching. In International Conference on Artificial Intelligence in Education. Springer, Cham, 360–373. https://doi.org/10.1007/978-3-030-52237-7_29Google Scholar
- Nora Mcdonald, Sarita Schoenebeck, and Nora McDonald. 2019. Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proc. ACM Hum.-Comput 1(2019), Article 39:23. https://doi.org/10.1145/3359174Google ScholarDigital Library
- Jane Moore, Dawn Prentice, and Maurene McQuestion. 2015. Social Interaction and Collaboration among Oncology Nurses. Nursing research and practice 2015 (2015). https://doi.org/10.1155/2015/248067Google Scholar
- Jakob Nielsen and Thomas K. Landauer. 1993. A mathematical model of the finding of usability problems. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI ’93. ACM Press, New York, New York, USA, 206–213. https://doi.org/10.1145/169059.169166Google ScholarDigital Library
- Pam Pointon and Ruth Kershner. 2000. Making decisions about organising the primary classroom environment as a context for learning: the views of three experienced teachers and their pupils. Teaching and Teacher Education 16, 1 (Jan 2000), 117–127. https://doi.org/10.1016/S0742-051X(99)00043-8Google ScholarCross Ref
- Luis P. Prieto, Kshitij Sharma, Pierre Dillenbourg, and María Jesús. 2016. Teaching Analytics: Towards Automatic Extraction of Orchestration Graphs Using Wearable Sensors. In Proceedings of the Sixth International Conference on Learning Analytics &; Knowledge (Edinburgh, United Kingdom) (LAK ’16). Association for Computing Machinery, New York, NY, USA, 148–157. https://doi.org/10.1145/2883851.2883927Google ScholarDigital Library
- Mikael Rask and David Brunt. 2007. Verbal and social interactions in the nurse-patient relationship in forensic psychiatric nursing care: a model and its philosophical and theoretical foundation.Nursing inquiry 14, 2 (Jun 2007), 169–76. https://doi.org/10.1111/j.1440-1800.2007.00364.xGoogle Scholar
- Vitor Rolim, Rafael Ferreira Leite De Mello, Vitomir Kovanovic, and Dragan Gaševic. 2019. Analysing social presence in online discussions through network and text analytics. In 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), Vol. 2161. IEEE, 163–167.Google ScholarCross Ref
- Nazmus Saquib, Ayesha Bose, Dwyane George, and Sepandar Kamvar. 2018. Sensei: Sensing Educational Interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (Jan 2018), 1–27. https://doi.org/10.1145/3161172Google ScholarDigital Library
- David W. Shaffer. 2006. Epistemic frames for epistemic games. Computers & Education 46, 3 (Apr 2006), 223–234. https://doi.org/10.1016/j.compedu.2005.11.003Google ScholarCross Ref
- David W. Shaffer. 2017. Quantitative ethnography. Lulu. com, Madison, WI, USA.Google Scholar
- David W. Shaffer, Wesley Collier, and A. Ruis. 2016. A Tutorial on Epistemic Network Analysis: Analyzing the Structure of Connections in Cognitive, Social, and Interaction Data.Journal of Learning Analytics 3, 3 (2016), 9–45. https://doi.org/10.18608/jla.2016.33.3Google ScholarCross Ref
- David W. Shaffer, David Hatfield, Gina N. Svarovsky, Padraig Nash, Aran Nulty, Elizabeth Bagley, Ken Frank, André A Rupp, and Robert Mislevy. 2009. Epistemic network analysis: A prototype for 21st-century assessment of learning. International Journal of Learning and Media 1, 2 (2009). https://doi.org/10.1162/ijlm.2009.0013Google ScholarCross Ref
- David W. Shaffer and A. Ruis. 2017. Epistemic Network Analysis: A Worked Example of Theory-Based Learning Analytics. In Handbook of Learning Analytics. Society for Learning Analytics Research (SoLAR), Chapter 15, 175–187. https://doi.org/10.18608/hla17.015Google Scholar
- Hanall Sung, Shengyang Cao, Andrew R Ruis, and David Williamson Shaffer. 2019. Reading for Breadth, Reading for Depth: Understanding the Relationship Between Reading and Complex Thinking Using Epistemic Network Analysis. International Conference on Computer Supported Collaborative Learning (Jun 2019). https://doi.org/10.22318/cscl2019.376Google Scholar
- Zachari Swiecki and David Williamson Shaffer. 2020. iSENS: an integrated approach to combining epistemic and social network analyses. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge. ACM, New York, NY, USA, 305–313. https://doi.org/10.1145/3375462.3375505Google ScholarDigital Library
- Zachari Swiecki and David Williamson Shaffer. 2020. iSENS: an integrated approach to combining epistemic and social network analyses. In Proceedings of the Tenth International Conference on Learning Analytics & Knowledge. 305–313.Google ScholarDigital Library
- Abigail Wooldridge, Pascale Carayon, David W. Shaffer, and Brendan Eagan. 2018. Quantifying the qualitative with epistemic network analysis: A human factors case study of task-allocation communication in a primary care team. IISE Transactions on Healthcare Systems Engineering 8, 1 (Jan 2018), 72–82. https://doi.org/10.1080/24725579.2017.1418769Google ScholarCross Ref
- Marcelo Worsley. 2018. Multimodal Learning Analytics’ Past, Present, and, Potential Futures, In 2nd Multimodal Learning Analytics Across (Physical and Digital) Spaces, CrossMMLA 2018. CEUR Workshop Proceedings, 1–16.Google Scholar
- Zhan Zhang and Aleksandra Sarcevic. 2015. Constructing Awareness Through Speech, Gesture, Gaze and Movement During a Time-Critical Medical Task. In ECSCW 2015: Proceedings of the 14th European Conference on Computer Supported Cooperative Work, 19-23 September 2015, Oslo, Norway. Springer International Publishing, Cham, 163–182. https://doi.org/10.1007/978-3-319-20499-4_9Google ScholarCross Ref
Recommendations
The Objective Structured Clinical Examination (Osce) In High-Fidelity Simulations for Assessing Nursing Students' Clinical Judgment
ICEMT '19: Proceedings of the 3rd International Conference on Education and Multimedia TechnologyClinical judgment is defined as an interpretation and reaching a conclusion about a patient's situation and the decision by the nurse to intervene. Clinical judgment is a very essential skill in caring for patients, but nurse educators may struggle with ...
Epistemic network analysis of students' longer written assignments as formative/summative evaluation
LAK '18: Proceedings of the 8th International Conference on Learning Analytics and KnowledgeThis paper reports on an exploratory trial of developing pedagogical visualizations of 16 students' written assignments on literary analysis using two sets of keywords and Epistemic Network Analysis (ENA). The visualizations are aimed at summative ...
Exploring teacher methodology: using the example of sexual abuse of children as a way of teaching social informatics
ITICSE '06: Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science educationThis paper describes a unique, educational project that was implemented in the undergraduate study of Computer Science in 2002. Nesna University College has been using the example of sexual abuse of children in case study teaching in Social Informatics. ...
Comments