Abstract
FACT (Formative Assessment with Computational Technology) is an intelligent orchestration system. That is, because it helps the teacher manage the workflow of a complicated set of activities in the classroom, it is an orchestration system. Because it conducts tasks-specific and domain-specific analyses of the students’ mathematical products and their group interactions, it is more intelligent than other orchestration systems. From analyzing videos of our iterative development trials, we realized that too many students needed help simultaneously, but the teacher could only visit one group at a time. Thus, we modified FACT to send a few messages to the students directly instead of sending all its advice to the teacher. This paper reports a successful pilot test of auto-sending.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dillenbourg, P., Jermann, P.: Technology for classroom orchestration. In: Khine, M.S., Saleh, I.M. (eds.) New Science of Learning: Cognition, Computers and Collaboration in Education. Springer, New York (2010). https://doi.org/10.1007/978-1-4419-5716-0_26
Prieto, L.P., Dlab, M.H., Abdulwahed, M., Balid, W.: Orchestrating technology enhanced learning: a literature review and conceptual framework. Int. J. Technol. Enhanced Learn. 3(6), 583–598 (2011)
Holstein, K., McLaren, B.M., Aleven, V.: Student learning benefits of a mixed-reality teacher awareness tool in ai-enhanced classrooms. In: Penstein Rosé, C., et al. (eds.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 154–168. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93843-1_12
Molenaar, I., Knoop-van Campen, C.A., Hasselman, F.: The effects of learning analytics empowered technology on students’ arithmetic skill development. In: Proceedings of the Learning Analytics and Knowledge LAK 2017, Vancouver, BC, Canada, pp. 614–615 (2017)
Molenaar, I., Knoop-van Campen, C.A.: Teacher dashboards in practice: usage and impact. In: Proceedings European Conference on Technology Enhanced Learning: EC-TEL 2017, pp. 125–138 (2017)
Håklev, S., Faucon, L., Hadzilacos, T., Dillenbourg, P.: FROG: rapid prototyping of collaborative learning scenarios. In: Proceedings of the EC-TEL 2017 (2017)
Haklev, S., Faucon, L., Hadzilacos, T., Dillenbourg, P.: Orchestration graphs: enabling rich social pedagogical scenarios in MOOCs. In: Proceedings of the Fourth (2017) ACM Conference on Learning@Scale, pp. 261–264 (2017)
van Alphen, E., Bakker, S.: Lernanto: using an ambient display during differentiated instruction. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2334–2340. ACM (2016)
Mercier, E.: Teacher orchestration and student learning during mathematics activities in a smart classroom. Int. J. Smart Technol. Learn. 1(1), 33–52 (2016)
Martinez-Maldonado, R., Yacef, K., Kay, J.: TSCL: a conceptual model to inform understanding of collaborative learning processes at interactive tabletops. Int. J. Hum Comput Stud. 83, 62–82 (2015)
Martinez-Maldonado, R., Clayphan, A., Yacef, K., Kay, J.: MTFeedback: providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Trans. Learn. Technol. 8(2), 187–200 (2015)
Berland, M., Davis, D., Smith, C.P.: AMOEBA: designing for collaboration in computer science classrooms through live learning analytics. Int. J. Comput. Support. Collaborative Learn. 10, 425–447 (2015)
Prieto, L.P., Asensio-Perez, J.I., Munoz-Cristobal, J.A., Jorrin-Abellan, I.M., Dimitriadis, Y., Gomez-Sanchez, E.: Supporting orchestration of CSCL scenarios in web-based distributed learning environments. Comput. Educ. 73, 9–25 (2014)
Balestrini, M., Hernandez-Leo, D., Nieves, R., Blat, J.: Technology-supported orchestration matters: outperforming paper-based scripting in a jigsaw classroom. IEEE Trans. Learn. Technol. 7(1), 17–30 (2014)
Higgens, S., Mercier, E., Burd, E., Joyce-Gibbons, A.: Multi-touch tables and collaborative learning. Br. J. Educ. Technol. 43(6), 1041–1054 (2012)
Do-Lenh, S.: Supporting reflection and classroom orchestration with tangible tabletops. Ecole Polytechiuqe Federale de Lausanne (2012)
Alavi, H., Dillenbourg, P.: An ambient awareness tool for supporting supervised collaborative problem solving. IEEE Trans. Learn. Technol. 5(3), 264–274 (2012)
Looi, C.-K., Lin, C.-P., Liu, K.-P.: Group scribbles to support knowledge building in a jigsaw method. IEEE Trans. Learn. Technol. 1(3), 157–164 (2008)
VanLehn, K., Cheema, S., Wetzel, J., Pead, D.: Some less obvious features of classroom orchestration systems. In: Lin, L., Atkinson, R.K. (eds.) Educational Technologies: Challenges, Applications and Learning Outcomes, pp. 73–94. Nova Scientific Publishers (2016)
VanLehn, K., et al.: The effect of digital versus traditional orchestration on collaboration in small groups. In: Penstein Rosé, C., et al. (eds.) AIED 2018. LNCS (LNAI), vol. 10948, pp. 369–373. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93846-2_69
VanLehn, K., Burkhardt, H., Cheema, S., Pead, D., Schoenfeld, A.H., Wetzel, J.: How can FACT encourage collaboration and self-correction?. In: Millis, K., Long, D., Magliano, J., Wiemer, K. (eds.) Multi-Disciplinary Approaches to Deep Learning, pp. 114–127. Routledge (2018)
Wetzel, J., et al.: A preliminary evaluation of the usability of an ai-infused orchestration system. In: Penstein Rosé, C., et al. (eds.) AIED 2018. LNCS (LNAI), vol. 10948, pp. 379–383. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93846-2_71
VanLehn, K., et al.: Can an orchestration system increase collaborative, productive struggle in teaching-by-eliciting classrooms?. Interactive Learning Environments, in press
Herman, J., et al.: The implementation and effects of the Mathematics Design Collaborative (MDC): early findings from Kentucky ninth-grade algebra 1 courses (CRESST Report 845). University of California at Los Angeles, National Center for Research on Evaluation, Standards and Student Testing (2015)
Black, P., Wiliam, D.: Assessment and classroom learning. Assess. Educ. Principles Policy Pract. 5(1), 7–75 (1998)
Viswanathan, S.A., VanLehn, K.: Using the tablet gestures and speech of pairs of students to classify their collaboration. IEEE Trans. Learn. Technol. 11(2), 230–242 (2018)
Acknowledgements
This research was supported by the Bill and Melinda Gates Foundation under OPP1061281, the Diane and Gary Tooker Chair for Effective Education in Science, Technology, Engineering and Math and NSF grant 1840051. We gratefully acknowledge the contributions of all the members of the FACT project, past and present.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
VanLehn, K., Cheema, S., Kang, S., Wetzel, J. (2019). Auto-Sending Messages in an Intelligent Orchestration System: A Pilot Study. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science(), vol 11626. Springer, Cham. https://doi.org/10.1007/978-3-030-23207-8_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-23207-8_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-23206-1
Online ISBN: 978-3-030-23207-8
eBook Packages: Computer ScienceComputer Science (R0)