Abstract
The use of technology for instruction, and the enormous amount of information available for consumption, places a considerable burden on instructors who must learn to integrate appropriate student practices and learning assessment. The Pedagogical Workflows project is developing a novel workflow environment that supports efficient assessment of student learning through interactive generation and execution of various assessment workflows. We focus especially on how student discussion use can be combined with more traditional assessment data. In this paper, we present our initial assessment workflows, the initial feedback from instructors, and the user portal that is being developed for running the workflows. Inherent in the development of the workflows is an examination of what teachers think is important to learn about their students, a question that is central to every intelligent tutoring system. We anticipate that assessment workflows will become an important tool for instructors, researchers, and ITS development.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Deelman, E., Singh, G., Su, M., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G.B., Good, J., Laity, A., Jacob, J.C., Katz, D.S.: Pegasus: a Framework for Mapping Complex Scientific Workflows onto Distributed Systems. Scientific Programming Journal 13(3) (2005)
Gil, Y., Ratnakar, V., Kim, J., Gonzales-Calero, P., Groth, P., Moody, J., Deelman, E.: WINGS: Intelligent Workflow-Based Design of Computational Experiments. IEEE Intelligent Systems (2010)
Kim, J., Shaw, E.: Pedagogical Discourse: Connecting Students to Past Discussions and Peer Mentors within an Online Discussion Board. In: The 21st Innovative Applications of Artificial Intelligence Conference (2009)
Ravi, S., Kim, J.: Profiling Student Interactions in Threaded Discussions with Speech Act Classifiers. In: Proceedings of the AI in Education Conference (2007)
Reed-Rhoads: C16 – Tools for Assessing Learning in Engineering. Presentation on Inventions and Impact 2: Building Excellence in Undergraduate Science, Technology, Engineering, and Mathematics (STEM) Education (2008)
Kim, J., Deelman, E., Gil, Y., Mehta, G., Ratnakar, V.: Provenance Trails in the Wings/Pegasus Workflow System. Concurrency and Computation: Practice and Experience, Special Issue on the First Provenance Challenge 20(5) (April 2008)
Suthers, D., Hundhausen, C.: The effects of representations on students’ elaborations in collaborative inquiry. In: Proceedings of Computer Support for Collaborative Learning, pp. 280–472. Erlbaum, Hillsdale (2002)
Stahl, G.: The Complexity of a Collaborative Interaction. In: Proc. of the International Conference of the Learning Sciences, ICLS 2002 (2002)
Kim, J., Gil, Y., Spraragen, M.: Principles for Interactive Acquisition and Validation of Workflows. Journal of Experimental and Theoretical Artificial Intelligence (2009)
Kim, J., Spraragen, M., Gil, Y.: An Intelligent Assistant for Interactive Workflow Composition. In: Proceedings of the International Conference on Intelligent User Interfaces (2004)
OWL 2010 (2010), http://www.w3.org/TR/owl-features/
Jena 2010 (2010), http://jena.sourceforge.net/
Della-Piana, C., Pimmel, R., Watford, B.: Project Evaluation. In: Workshop for Faculty from Minority Serving Institutions, Feburary 8 -10 (2006)
McLaren, B.M., Scheuer, O., De Laat, M., Hever, R., De Groot, R., Rose, C.P.: Using Machine Learning Techniques to Analyze and Support Mediation of Student E-Discussions. In: Proceedings of the 13th International Conference on Artificial Intelligence in Education (2007)
Graesser, A.C., Olney, A., Ventura, M., Jackson, G.T.: AutoTutor’s Coverage of Expectations during Tutorial Dialogue. In: Proceedings of the FLAIRS Conference 2005, pp. 518–523 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ma, J., Shaw, E., Kim, J. (2010). Computational Workflows for Assessing Student Learning. In: Aleven, V., Kay, J., Mostow, J. (eds) Intelligent Tutoring Systems. ITS 2010. Lecture Notes in Computer Science, vol 6095. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13437-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-13437-1_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13436-4
Online ISBN: 978-3-642-13437-1
eBook Packages: Computer ScienceComputer Science (R0)