research-article

Toward Caring Assessment Systems

Author:

Diego Zapata-RiveraAuthors Info & Claims

UMAP '17: Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization

Pages 97 - 100

https://doi.org/10.1145/3099023.3099106

Published: 09 July 2017 Publication History

Abstract

The notion of intelligent systems that "care" is at the center of research in areas such as Intelligent Tutoring Systems and Adaptive Systems. This paper elaborates on the notion of caring assessment systems, and presents work towards achieving this vision that has potential for improving students' assessment experiences.

References

[1]

Self, J.A. 1999. The distinctive characteristics of intelligent tutoring systems research: ITSs care, precisely, International Journal of Artificial Intelligence in Education, 10, 350--364

[2]

du Boulay, B., Avramides, K., Luckin, R., Martinuz-Miron, E., Rebolledo Mendez, G., & Carr, A. 2010. Towards systems that care: a conceptual framework based on Motivation, Metacognition and Affect. International Journal of Artificial Intelligence in Education, 20, 197--229

Digital Library

[3]

Kay, J., & McCalla, G. 2003. The careful double vision of self. International Journal of Artificial Intelligence and Education, 13, 1--18

Digital Library

[4]

Brusilovsky, P., & Milan, E. 2007. User models for adaptive hypermedia and adaptive educational systems. In P. Brusilovsky, A. Kobsa, & W. Nejdl (Eds.), The adaptive web. Methods and strategies of web personalization. LNCS 4321, Berlin Heidelberg: Springer-Verlag. 3--53

Digital Library

[5]

Shute, V. J., & Zapata-Rivera, D. 2012. Adaptive educational systems. In P. Durlach (Ed.), Adaptive technologies for training and education. New York, NY:Cambridge University Press. 7--27

[6]

Conati, C., Gertner, A., & VanLehn, K. 2002. Using Bayesian networks to manage uncertainty in student modeling. Journal of User Modeling and User-Adapted Interaction, 12(4), 371--417

Digital Library

[7]

Jameson, A. 1995. Numerical uncertainty management in user and student modeling: An overview of systems and issues. User Modeling and User-Adapted Interaction, 5(3/4), 193--251

[8]

Anderson, J. R. 1993. The adaptive character of thought. Hillsdale, NJ: Lawrence Erlbaum.

[9]

Anderson, J. R, Corbett, A. T., Koedinger, K. R., & Pelletier, R. 1995. Cognitive tutors: Lessons learned. Journal of the Learning Sciences, 4, 167--207

[10]

Koedinger, K.R., Anderson, J.R., Hadley, W.H., & Mark, M.A. 1997. Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education, 8, 30--43

[11]

Webb, G., Pazzani, M. J., & Billsus, D. 2001. Machine learning for user modeling. User Modeling and User-Adapted Interaction, 11, 19--29

Digital Library

[12]

Ohlsson, S. 1994, Constraint-Based Student Modelling. In J. Greer and G. McCalla (eds) Student Modelling: The Key to Individualised Knowledge-based Instruction, vol. 125 Computer Systems and Sciences, NATO ASI, Springer-Verlag, 167--189

[13]

Mitrovic, A., & Ohlsson, S. 1999. Evaluation of a constraint-based tutor for a database language. International Journal of Artificial Intelligence in Education, 10(3--4), 238--256

[14]

Vassileva, J., McCalla, G., & Greer, J. 2003. Multi-agent multi-user modeling in I-help. User Model. User Adapt. Interact. 13(1-2), 179--210

Digital Library

[15]

Rosaci, D., & Sarnè, G.M.L. 2011. EVA: An evolutionary approach to mutual monitoring of learning information agents. Applied Artificial Intelligence. 25 (5), 341--361

Digital Library

[16]

Rich, E. 1979. User modeling via stereotypes. Cognitive Science, 3(4), 329--354

[17]

Kay, J. 2000. Stereotypes, student models and scrutability. In G. Gauthier, C. Frasson, & K. VanLehn (Eds.), Lecture notes in computer science: Vol. 1839. Intelligent tutoring systems. Berlin: Springer-Verlag. 19--30

Digital Library

[18]

Stansfield, J., Carr, B., & Goldstein, I. 1976. Wumpus advisor: A first implementation of a program that tutors logical and probabilistic reasoning skills (Technical Rep. No. 381). Cambridge, MA: MIT, Artificial Intelligence Laboratory

[19]

Zapata-Rivera, D., & Greer, J. 2000. Inspecting and visualizing distributed Bayesian student models. In G. Gauthier, C. Frasson, & K. VanLehn (Eds.), Lecture notes in computer science: Vol. 1839. Intelligent tutoring systems. Berlin: Springer-Verlag. 1839, 544--553

Digital Library

[20]

Mislevy, R.J., Steinberg, L.S., & Almond, R.G. 2003. On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives. 1, 3--62

[21]

Mislevy, R.J. 2008. Issues of structure and issues of scale in assessment from a situative / sociocultural perspective. In P. A. Moss, D. Pullin, E. H. Haertel, J. P. Gee, & L. J. Young (Eds.). Assessment, equity, and opportunity to learn. New York: Cambridge University Press. 259--294

[22]

Laitusis C. C., Buzick H. M., Cook L. L., & Stone E. 2011. Adaptive testing options for accountability assessments. In M. Russell (Ed.), Assessing students in the margins: Challenges, strategies, and techniques. Charlotte, NC: Information Age. 291--310

[23]

Kay, J. 2008. Lifelong learner modeling for lifelong personalized pervasive learning. IEEE Transactions on Learning Technologies, 1(4), 215--228.

Digital Library

[24]

Shute, V.J., Hansen, E.G., & Almond, R.G. 2008. You Can't Fatten A Hog by Weighing It-Or Can You? Evaluating an Assessment for Learning System Called ACED., International Journal of Artificial Intelligence in Education, 18(4), 289--316

Digital Library

[25]

Attali, Y., & Powers, D. 2010. Immediate feedback and opportunity to revise answers to open-ended questions. Educational and Psychological Measurement. 70 (1), 22--35

[26]

Graesser, A. C., Person, N. K., & Harter, D. 2001. The Tutoring Research Group: Teaching tactics and dialogue in AutoTutor. International Journal of Artificial Intelligence in Education. 12, 257--279

[27]

Johnson, W.L., & Lester, J.C. 2016. Face-to-Face Interaction with Pedagogical Agents, Twenty Years Later. International Journal of Artificial Intelligence in Education. 26 (1), 25--36

[28]

Zapata-Rivera, D., Jackson, T., Liu, L., Bertling, M., Vezzu, M., & Katz, I. R. 2014. Science Inquiry Skills using Trialogues. 12th International Conference on Intelligent Tutoring Systems. 625--626

Digital Library

[29]

So, Y., Zapata-Rivera, D., Cho, Y., Luce, C., & Battistini, L. 2015. Using trialogues to measure English language skills. In J. García Laborda, D. G Sampson, R. K. Hambleton and E. Guzman (Eds.) Journal of Educational Technology and Society. Special Issue: Technology Supported Assessment in Formal and Informal Learning. 21--32

[30]

Sparks, J.R., Andrews, J.J., Zapata-Rivera, D., Lehman, B., & James, K. 2017. Students' perceptions of collaborator expertise in science inquiry tasks using simulated conversations. Paper presented at the annual meeting of the AERA, San Antonio, TX.

[31]

Lehman, B., & Zapata-Rivera, D. 2017. Student emotions during conversation-based assessments. Paper presented at the annual meeting of the AERA, San Antonio, TX.

[32]

Bull, S., & Kay, J. 2007. Student models that invite the learner in: the SMILI open learner modelling framework. International Journal of Artificial Intelligence in Education, 17(2), 89--120

Digital Library

Cited By

Sparks JLehman BZapata-Rivera D(2024)Caring assessments: challenges and opportunitiesFrontiers in Education10.3389/feduc.2024.12164819Online publication date: 21-Jun-2024
https://doi.org/10.3389/feduc.2024.1216481
Bittencourt IChalco GSantos JFernandes SSilva JBatista NHutz CIsotani S(2023)Positive Artificial Intelligence in Education (P-AIED): A RoadmapInternational Journal of Artificial Intelligence in Education10.1007/s40593-023-00357-y34:3(732-792)Online publication date: 3-Aug-2023
https://doi.org/10.1007/s40593-023-00357-y
Zapata-Rivera D(2020)Open Student Modeling Research and its Connections to Educational AssessmentInternational Journal of Artificial Intelligence in Education10.1007/s40593-020-00206-231:3(380-396)Online publication date: 6-Oct-2020
https://doi.org/10.1007/s40593-020-00206-2
Show More Cited By

Index Terms

Toward Caring Assessment Systems
1. Applied computing
  1. Education
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User models

Recommendations

Validating the octave allegro information systems risk assessment methodology: a case study
Toward Ubiquitous Assessment of Neonates' Health Condition
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers

Neonates needs an intensive health care during their early life. The cost of health care is high. In addition, health care might not be accessible to neonates in rural areas. In this paper, we propose the development of a smart, accessible, and cost-...
Toward an assessment of software development risk
Special section: Strategic and competitive information systems

Despite the introduction and use of a wide variety of system development methods and tools, software projects are still plagued by time and cost overruns, and unmet user requirements. To avoid these problems, it is frequently recommended that the risk ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '17: Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization

July 2017

456 pages

ISBN:9781450350679

DOI:10.1145/3099023

Editors:
Marko Tkalcic
Free University of Bolzano
,
Dhaval Thakker
University of Leeds
,
Panagiotis Germanakos
SAP SE & University of Cyprus
,
Kalina Yacef
University of Sydney
,
Cecile Paris
CSIRO ICT Centre
,
Olga Santos
Spanish National University for Distance Education
,
General Chairs:
Maria Bielikova
Slovak University of Technology in Bratislava, Slovakia
,
Eelco Herder
L3S Research Center, Germany and Radboud Universiteit Nijmegen, The Netherlands
,
Program Chairs:
Michel Desmarais
Polytechnique University, Montreal, Canada
,
Federica Cena
University of Torino, Italy

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 July 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UMAP '17

Sponsor:

UMAP '17: 25th Conference on User Modeling, Adaptation and Personalization

July 9 - 12, 2017

Bratislava, Slovakia

Acceptance Rates

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
147
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sparks JLehman BZapata-Rivera D(2024)Caring assessments: challenges and opportunitiesFrontiers in Education10.3389/feduc.2024.12164819Online publication date: 21-Jun-2024
https://doi.org/10.3389/feduc.2024.1216481
Bittencourt IChalco GSantos JFernandes SSilva JBatista NHutz CIsotani S(2023)Positive Artificial Intelligence in Education (P-AIED): A RoadmapInternational Journal of Artificial Intelligence in Education10.1007/s40593-023-00357-y34:3(732-792)Online publication date: 3-Aug-2023
https://doi.org/10.1007/s40593-023-00357-y
Zapata-Rivera D(2020)Open Student Modeling Research and its Connections to Educational AssessmentInternational Journal of Artificial Intelligence in Education10.1007/s40593-020-00206-231:3(380-396)Online publication date: 6-Oct-2020
https://doi.org/10.1007/s40593-020-00206-2
Zapata-Rivera DLehman BSparks J(2020)Learner Modeling in the Context of Caring AssessmentsAdaptive Instructional Systems10.1007/978-3-030-50788-6_31(422-431)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-50788-6_31
Hazzan ORagonis NLapidot THazzan ORagonis NLapidot T(2020)AssessmentGuide to Teaching Computer Science10.1007/978-3-030-39360-1_13(279-303)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-39360-1_13
Sparks JZapata-Rivera DLehman BJames KSteinberg J(2018)Simulated Dialogues with Virtual Agents: Effects of Agent Features in Conversation-Based AssessmentsArtificial Intelligence in Education10.1007/978-3-319-93846-2_88(469-474)Online publication date: 20-Jun-2018
https://doi.org/10.1007/978-3-319-93846-2_88

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten