Satabdi Basu
ABSTRACT
In today's increasingly digital world, it is critical that all students learn to think computationally from an early age. Assessments of Computational Thinking (CT) are essential for capturing information about student learning and challenges. Several existing K-12 CT assessments focus on concepts like variables, iterations and conditionals without emphasizing practices like algorithmic thinking, reusing and remixing, and debugging. In this paper, we discuss the development of and results from a validated CT Practices assessment for 4th-6th grade students. The assessment tasks are multilingual, shifting the focus to CT practices, and making the assessment useful for students using different CS curricula and different programming languages. Results from an implementation of the assessment with about 15000 upper elementary students in Hong Kong indicate challenges with algorithm comparison given constraints, deciding when code can be reused, and choosing debugging test cases. These results point to the utility of our assessment as a curricular tool and the need for emphasizing CT practices in future curricular initiatives and teacher professional development.
- Aho, A. V. (2012). Computation and computational thinking. The Computer Journal, 55(7), 832--835.Google Scholar
Digital Library
- Berland, M., Martin, T., Benton, T., Petrick Smith, C., & Davis, D. (2013). Using learning analytics to understand the learning pathways of novice programmers. Journal of the Learning Sciences, 22(4), 564--599.Google ScholarCross Ref
- Bienkowski, M., Snow, E., Rutstein, D. W., & Grover, S. (2015). Assessment design patterns for computational thinking practices in secondary computer science: A first look (SRI technical report).Google Scholar
- Blikstein, P., Worsley, M., Piech, C., Sahami, M., Cooper, S., & Koller, D. (2014). Programming pluralism: Using learning analytics to detect patterns in the learning of computer programming. Journal of the Learning Sciences, 23(4), 561--599.Google ScholarCross Ref
- Brennan, K., & Resnick, M. (2012). New frameworks for studying and assessing the development of computational thinking. Paper presented at the 2012 Annual Meeting of the American Educational Research Association, Vancouver, Canada.Google Scholar
- Childs, R. A, Dings, J., R., & Kingston, N (2002), The effect of Matrix Sampling on Student Score Comparability in Constructed -- Response and Multiple- Choice Assessment. Washington DC: Council of Chief State School Officers.Google Scholar
- Dagien, V., & Futschek, G. (2008, July). Bebras international contest on informatics and computer literacy: Criteria for good tasks. In International conference on informatics in secondary schools-evolution and perspectives (pp. 19--30). Springer, Berlin, Heidelberg.Google Scholar
- Dorn, B., Tew, A. E., & Guzdial, M. (2007, September). Introductory computing construct use in an end-user programming community. In IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2007) (pp. 27--32). IEEE.Google ScholarDigital Library
- Ericson, B. Evaluation for App Inventor. https://studylib.net/doc/7006187/app-inventor-eval-v2Google Scholar
- Grover, S., & Basu, S. (2017, March). Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and boolean logic. In Proceedings of the 2017 ACM SIGCSE technical symposium on computer science education (pp. 267--272). ACM.Google ScholarDigital Library
- Grover, S., Basu, S., Bienkowski, M., Eagle, M., Diana, N., & Stamper, J. (2017). A framework for using hypothesis-driven approaches to support data-driven learning analytics in measuring computational thinking in block-based programming environments. ACM Transactions on Computing Education (TOCE), 17(3), 14.Google Scholar
- K-12 Computer Science Framework (2016). Retrieved from http://www.k12cs.orgGoogle Scholar
- Koh, K. H., Basawapatna, A., Bennett, V., & Repenning, A. (2010, September). Towards the automatic recognition of computational thinking for adaptive visual language learning. In 2010 IEEE Symposium on Visual Languages and Human-Centric Computing (pp. 59--66). IEEE.Google ScholarDigital Library
- Mislevy, R. J., & Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational Measurement: Issues and Practice, 25(4), 6--20.Google ScholarCross Ref
- National Research Council. 2001. Knowing What Students Know: The Science and Design of Educational Assessment. Washington, DC: The National Academies Press. https://doi.org/10.17226/10019.Google Scholar
- NGSS Lead States. (2013). Next Generation Science Standards: For states, by states. Washington, DC: National Academies Press.Google Scholar
- Román-González, M., Pérez-González, J.-C. and Jiménez-Fernández, C. Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test. Computers in Human Behavior 72 (2016), 678--691.Google Scholar
- Seiter, L., & Foreman, B. (2013, August). Modeling the learning progressions of computational thinking of primary grade students. In Proceedings of the ninth annual international ACM conference on International computing education research (pp. 59--66). ACM.Google ScholarDigital Library
- Snow, E., Rutstein, D., Bienkowski, M., & Xu, Y. (2017, August). Principled assessment of student learning in high school computer science. In Proceedings of the 2017 ACM Conference on International Computing Education Research (pp. 209--216). ACM.Google ScholarDigital Library
- Tew, A.E. and Guzdial, M. 2011. The FCS1: a language independent assessment of CS1 knowledge. Proc. of the 42nd Annual ACM SIGCSE Conference (2011), 111--116.Google Scholar
- Weintrop, D., & Wilensky, U. (2015, July). Using Commutative Assessments to Compare Conceptual Understanding in Blocks-based and Text-based Programs. In ICER (Vol. 15, pp. 101--110).Google ScholarDigital Library
- Werner, L., Denner, J., Campe, S., & Kawamoto, D. C. (2012, February). The fairy performance assessment: measuring computational thinking in middle school. In Proceedings of the 43rd ACM technical symposium on Computer Science Education (pp. 215--220). ACM.Google ScholarDigital Library
- Wiebe, E., London, J., Aksit, O., Mott, B. W., Boyer, K. E., & Lester, J. C. (2019, February). Development of a Lean Computational Thinking Abilities Assessment for Middle Grades Students. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (pp. 456--461). ACM.Google ScholarDigital Library
- Wing, J. M. (2006). Computational Thinking. Communications of the ACM, 49(3), 33--35. doi:10.1145/1118178.1118215Google ScholarDigital Library
- Yadav, A., Burkhart, D., Moix, D., Snow, E., Bandaru, P., & Clayborn, L. (2015). Sowing the seeds: A landscape study on assessment in secondary computer science education. Comp. Sci. Teachers Assn., NY, NY.Google Scholar
Index Terms
- A Principled Approach to Designing a Computational Thinking Practices Assessment for Early Grades
Recommendations
Assessments for Computational Thinking in K-12 (Abstract Only)
SIGCSE '15: Proceedings of the 46th ACM Technical Symposium on Computer Science EducationAs computer science (CS) and computational thinking (CT) make their way into all levels of K-12 education, valid assessments aligned with new curricula can assist in measuring student learning, easing the way for adoption of new computing courses, and ...
Thinking about Computational Thinking: Lessons from Education Research
SIGCSE '19: Proceedings of the 50th ACM Technical Symposium on Computer Science EducationComputational thinking (CT) is a means to help learners engage in authentic disciplinary and problem-solving practices of computer science (CS). For CS classrooms, CT is considered "thinking like a computer scientist". CT is believed to be an important ...
Assessing computational thinking: A systematic review of empirical studies
AbstractWith the increasing attention to Computational Thinking (CT) in education, there has been a concomitant rise of needs and interest in investigating how to assess CT skills. This study systematically reviewed how CT has been assessed in ...
Highlights- A review of current CT assessments about context, construct, assessment type, and psychometric evidence.
Comments