Skip to main content

Modeling Students’ Performances in Physics Assessment Tasks Using Epistemic Network Analysis

  • Conference paper
  • First Online:
Advances in Quantitative Ethnography (ICQE 2022)

Abstract

The education community continues to struggle to support students to make meaningful connections between disciplinary learning at schools with their everyday life experiences. Even when the students engage in meaningful science learning experiences, recognizing the connections and relations that students make through their engagement is methodologically challenging, especially through the analysis of qualitative data. The purpose of this study was to explore the patterns of connections that students generated through their participation in a co-designed physics unit. We analyzed 76 high school students written and pictorial responses to performance assessment tasks designed to engage students in physics learning. We used quantitative ethnographic techniques and a tool named Epistemic Network Analysis (ENA), to visualize the structure of connections between physics concepts and real-life experiences in students’ assessment tasks. The ENA results revealed patterns of connections that students generated between physics concepts they learned at school and their everyday experiences. Notably, the analyses showed differences in patterns of connections between male and female participants and between written and pictorial preferences in momentum and impulse unit assessment tasks. The implications for curriculum design and performance assessment in science are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bang, M., Vossoughi, S.: Participatory design research and educational justice: studying learning and relations within social change making, vol. 34, pp. 173–193. Taylor & Francis (2016)

    Google Scholar 

  2. Banilower, E.R., Smith, P.S., Malzahn, K.A., Plumley, C.L., Gordon, E.M., Hayes, M.L.: Report of the 2018 NSSME+. Horizon Research Inc., Chapel Hill, (2018)

    Google Scholar 

  3. Bennett, D., Roberts, L., Creagh, C.: Exploring possible selves in a first-year physics foundation class: engaging students by establishing relevance. Phys. Rev. Phys. Educ. Res. 12(1), 010120 (2016)

    Article  Google Scholar 

  4. Birmingham, D., Calabrese Barton, A., McDaniel, A., Jones, J., Turner, C., Rogers, A.: “But the science we do here matters”: youth-authored cases of consequential learning. Sci. Educ. 101(5), 818–844 (2017)

    Article  Google Scholar 

  5. Calabrese-Barton, A., Tan, E.: Funds of knowledge and discourses and hybrid space. J. Res. Sci. Teach. Off. J. Natl. Assoc. Res. Sci. Teach. 46(1), 50–73 (2009)

    Google Scholar 

  6. Calabrese-Barton, A.C., Tan, E.: We be burnin’! agency, identity, and science learning. J. Learn. Sci. 19(2), 187–229 (2010)

    Article  Google Scholar 

  7. Ceci, S.J., Roazzi, A.: The effects of context on cognition: Postcards from Brazil (1994)

    Google Scholar 

  8. Csanadi, A., Eagan, B., Kollar, I., Shaffer, D.W., Fischer, F.: When coding-and-counting is not enough: using epistemic network analysis (ENA) to analyze verbal data in CSCL research. Int. J. Comput.-Support. Collab. Learn. 13(4), 419–438 (2018). https://doi.org/10.1007/s11412-018-9292-z

    Article  Google Scholar 

  9. Fine, C.G.M., Furtak, E.M.: A framework for science classroom assessment task design for emergent bilingual learners. Sci. Educ. 104(3), 393–420 (2020)

    Article  Google Scholar 

  10. Fishman, B., Penuel, W.: Design-based implementation research. In: International Handbook of the Learning Sciences, pp. 393–400. Routledge (2018)

    Google Scholar 

  11. Fulmer, G.W., Tanas, J., Weiss, K.A.: The challenges of alignment for the next generation science standards. J. Res. Sci. Teach. 55(7), 1076–1100 (2018)

    Article  Google Scholar 

  12. Fusco, D.: Creating relevant science through urban planning and gardening. J. Res. Sci. Teach. Off. J. Natl. Assoc. Res. Sci. Teach. 38(8), 860–877 (2001)

    Google Scholar 

  13. Greeno, J.G.: On claims that answer the wrong questions. Educ. Res. 26(1), 5–17 (1997)

    Google Scholar 

  14. Greeno, J.G.: The situativity of knowing, learning, and research. Am. Psychol. 53(1), 5 (1998)

    Article  Google Scholar 

  15. Greeno, J.G., Gresalfi, M.S.: Opportunities to learn in practice and identity (2008)

    Google Scholar 

  16. Gutiérrez, K.D., Jurow, A.S.: Social design experiments: toward equity by design. J. Learn. Sci. 25(4), 565–598 (2016)

    Article  Google Scholar 

  17. Hazari, Z., Sonnert, G., Sadler, P.M., Shanahan, M.C.: Connecting high school physics experiences, outcome expectations, physics identity, and physics career choice: a gender study. J. Res. Sci. Teach. 47(8), 978–1003 (2010)

    Google Scholar 

  18. Johnson, D.R., et al.: Examining sense of belonging among first-year undergraduates from different racial/ethnic groups. J. Coll. Stud. Dev. 48(5), 525–542 (2007)

    Article  Google Scholar 

  19. Kang, H., Barton, A.C., Tan, E., Simpkins, S.D., Rhee, H.Y., Turner, C.: How do middle school girls of color develop STEM identities? middle school girls’ participation in science activities and identification with STEM careers. Sci. Educ. 103(2), 418–439 (2019)

    Article  Google Scholar 

  20. Kang, H., Talafian, H., Tschida, P.: Expanding opportunities to learn in secondary science classrooms using multiple forms of classroom assessments [Structured Symposium Session]. In: Annual Meeting of the American Educational Research Association (AERA), San Diego, CA (2022)

    Google Scholar 

  21. Kirshner, D., Whitson, J.A., Whitson, J.A.: Situated Cognition: Social, Semiotic, and Psychological Perspectives. Psychology Press, London (1997)

    Google Scholar 

  22. Krakehl, R., Kelly, A.M.: Intersectional analysis of advanced placement physics participation and performance by gender and ethnicity. Phys. Rev. Phys. Educ. Res. 17(2), 020105 (2021)

    Article  Google Scholar 

  23. Lave, J.: Situating learning in communities of practice (1991)

    Google Scholar 

  24. Lave, J., Wenger, E.: Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge (1991)

    Book  Google Scholar 

  25. Lund, K., Burgess, C.: Producing high-dimensional semantic spaces from lexical co-occurrence. Behav. Res. Methods Instrum. Comput. 28(2), 203–208 (1996)

    Article  Google Scholar 

  26. Marquart, C., Hinojosa, C., Swiecki, Z., Eagan, B., Shaffer, D.: Epistemic network analysis (version 1.5. 2)[software] (2018)

    Google Scholar 

  27. Nair, A., Sawtelle, V.: Operationalizing relevance in physics education: using a systems view to expand our conception of making physics relevant. Phys. Rev. Phys. Educ. Res. 15(2), 020121 (2019)

    Article  Google Scholar 

  28. Nasir, N.I.S., Hand, V.M.: Exploring sociocultural perspectives on race, culture, and learning. Rev. Educ. Res. 76(4), 449–475 (2006)

    Article  Google Scholar 

  29. Nasir, N.I.S., Lee, C.D., Pea, R., de Royston, M.M.: Rethinking learning: what the interdisciplinary science tells us. Educ. Research. 50(8), 557–565 (2021)

    Article  Google Scholar 

  30. National Academies of Sciences, Engineering and Medicine. How people learn II: Learners, contexts, and cultures. National Academies Press (2018)

    Google Scholar 

  31. National Research Council. How people learn: Brain, mind, experience, and school: Expanded edition. National Academies Press (2000)

    Google Scholar 

  32. National Research Council. Next generation science standards: For states, by states (2013)

    Google Scholar 

  33. NGSS Lead States: Next Generation Science Standards: For States, By States. The National Academies Press, Washington DC (2013)

    Google Scholar 

  34. Newton, D.P.: Relevance and science education. Educ. Philos. Theory 20(2), 7–12 (1988)

    Article  Google Scholar 

  35. Nunes, T., Carraher, T.N., Schliemann, A.D., Carraher, D.W.: Street Mathematics and School Mathematics. Cambridge University Press, Cambridge (1993)

    Google Scholar 

  36. Packer, M.J., Goicoechea, J.: Sociocultural and constructivist theories of learning: Ontology, not just epistemology. Educ. Psychol. 35(4), 227–241 (2000)

    Article  Google Scholar 

  37. Polly, D., Allman, B., Casto, A., Norwood, J.: Sociocultural perspectives of learning. In: Foundations of Learning and Instructional Design Technology (2017)

    Google Scholar 

  38. Rajala, A., Hilppö, J., Lipponen, L., Kumpulainen, K.: Expanding the chronotopes of schooling for the promotion of students’ agency. In: Identity, Community, and Learning Lives in the Digital Age, pp. 107–125 (2013)

    Google Scholar 

  39. Reiser, B.J.: Designing coherent storylines aligned with NGSS for the K-12 classroom. In: Paper Presented at the National Science Education Leadership Association Meeting, Boston, MA (2014)

    Google Scholar 

  40. Rogoff, B.E., Lave, J.E.: Everyday Cognition: Its Development in Social Context. Harvard University Press, Boston (1984)

    Google Scholar 

  41. Rosebery, A.S., Ogonowski, M., DiSchino, M., Warren, B.: “The coat traps all your body heat”: heterogeneity as fundamental to learning. J. Learn. Sci. 19(3), 322–357 (2010)

    Article  Google Scholar 

  42. Roseman, J.E., Herrmann-Abell, C.F., Koppal, M.: Designing for the next generation science standards: educative curriculum materials and measures of teacher knowledge. J. Sci. Teacher Educ. 28(1), 111–141 (2017)

    Article  Google Scholar 

  43. Shaffer, D.W.: How Computer Games Help Children Learn. Macmillan, New York (2006)

    Book  Google Scholar 

  44. Shaffer, D.W.: Quantitative ethnography (2017). https://lulu.com/

  45. Shaffer, D.W., Ruis, A.R.: Epistemic network analysis: a worked example of theory-based learning analytics. In: Lang, C., Siemens, G., Wise, A.F., Gasevic, D. (eds.) Handbook of Learning Analytics, pp. 175–187. Society for Learning Analytics Research (2017)

    Chapter  Google Scholar 

  46. Shaffer, D.W., Collier, W., Ruis, A.R.: A tutorial on epistemic network analysis: analyzing the structure of connections in cognitive, social, and interaction data. J. Learn. Anal. 3(3), 9–45 (2016)

    Article  Google Scholar 

  47. Talafian, H., Shah, M., Barany, A., Foster, A.: Promoting and tracing high school students’ identity change in an augmented virtual learning environment. In: Paper published in the A Wide Lens: Combining Embodied, Enactive, Extended, and Embedded Learning in Collaborative Settings, 13th International Conference on Computer Supported Collaborative Learning (CSCL), Lyon, France, 17–21 June 2019 (2019)

    Google Scholar 

  48. Tan, E., Calabrese Barton, A., Kang, H., O’Neill, T.: Desiring a career in STEM-related fields: how middle school girls articulate and negotiate identities-in-practice in science. J. Res. Sci. Teach. 50(10), 1143–1179 (2013)

    Article  Google Scholar 

  49. Tzou, C., Bell, P.: Micros and Me: Leveraging home and community practices in formal science instruction (2010)

    Google Scholar 

  50. White, S., Tesfaye, C.L.: Female students in high school physics: results from the 2008–09 nationwide survey of high school physics teachers. In: Focus on Statistical Research Center of the American Institute of Physics (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hamideh Talafian .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Talafian, H., Kang, H. (2023). Modeling Students’ Performances in Physics Assessment Tasks Using Epistemic Network Analysis. In: Damşa, C., Barany, A. (eds) Advances in Quantitative Ethnography. ICQE 2022. Communications in Computer and Information Science, vol 1785. Springer, Cham. https://doi.org/10.1007/978-3-031-31726-2_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-31726-2_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-31725-5

  • Online ISBN: 978-3-031-31726-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics