Abstract
In a computer-adaptive test (CAT), learners are not usually allowed to revise previously entered responses. In this paper, we present findings from our most recent empirical study, which involved two groups of learners and a modified version of a CAT application that provided the facility to revise previously entered responses. Findings from this study showed that the ability to modify previously entered responses did not lead to significant differences in performance for one group of learners (p>0.05), and only relatively small yet significant differences for the other (p<0.01). The implications and the reasons for the difference between the groups are explored in this paper. Despite the small effect of the modification, it is argued that this option is likely to lead to a reduction in student anxiety and an increase in student confidence in this assessment method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anderson, L.W., Krathwohl, D.R. (eds.): A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Longman, New York (2001)
Barker, T., Lilley, M.: Are Individual Learners Disadvantaged by the Use of Computer-Adaptive Testing? In: Proceedings of the 8th Learning Styles Conference. University of Hull, United Kingdom, European Learning Styles Information Network (ELSIN), pp. 30–39 (2003)
Carlson, R.D.: Computer-Adaptive Testing: a Shift in the Evaluation Paradigm. Journal of Educational Technology Systems 22(3), 213–224 (1994)
Conejo, R., Millán, E., Pérez-de-la-Cruz, J.L., Trella, M.: An Empirical Approach to On-Line Learning in SIETTE. In: Gauthier, G., VanLehn, K., Frasson, C. (eds.) ITS 2000. LNCS, vol. 1839, pp. 605–614. Springer, Heidelberg (2000)
Freedle, R.O., Duran, R.P.: Cognitive and Linguistic Analyses of test performance. Ablex, New Jersey (1987)
Graduate Management Admission Council, Computer-Adaptive Format [online] (2002), Available from http://www.mba.com/mba/TaketheGMAT/TheEssentials/WhatIstheGMAT/ComputerAdaptiveFormat.html [Accessed 21 Mar 2004]
Jacobson, R.L.: New Computer Technique Seen Producing a Revolution in Educational Testing. The Chronicle of Higher Education 40(4), 22–23, 26 (1993)
Lilley, M., Barker, T.: Comparison between computer-adaptive testing and other assessment methods: An empirical study. In: Research Proceedings of the 10th Association for Learning and Teaching Conference. The University of Sheffield and Sheffield Hallam University, United Kingdom, pp. 249–258 (2003)
Lilley, M., Barker, T.: The Development and Evaluation of a Computer-Adaptive Testing Application for English Language. In: Proceedings of the 6th Computer-Assisted Assessment Conference, pp. 169–184. Loughborough University, United Kingdom (2002)
Lilley, M., Barker, T.: An Evaluation of a Computer-Adaptive Test in a UK University context. In: Proceedings of the 7th Computer-Assisted Assessment Conference, pp. 171–182. Loughborough University, United Kingdom (2003)
Lilley, M., Barker, T., Briton, C.: The development and evaluation of a software prototype for computer adaptive testing. Computers & Education Journal 43(1-2), 109–123 (2004)
Lord, F.M.: Applications of Item Response Theory to practical testing problems. Lawrence Erlbaum Associates, New Jersey (1980)
Microsoft Corporation (2002), Exam and Testing Procedures [online], Available from http://www.microsoft.com/traincert/mcpexams/faq/procedures.asp [Accessed 21 March 2004]
Molich, R., Nielsen, J.: Improving a human-computer dialogue. Communications of the ACM 33(3), 338–348 (1990)
Olea, J., Revuelta, J., Ximénez, M.C., Abad, F.J.: Psychometric and psychological effects of review on computerized fixed and adaptive tests. Psicológica 21, 157–173 (2000)
Pritchett, N.: Effective Question Design. In: Brown, S., Race, P., Bull, J. (eds.) Computer-Assisted Assessment in Higher Education, Kogan Page, London (1999)
Rafacz, B., Hetter, R.D.: ACAP Hardware Selection, Software Development, and Acceptance Testing. In: Sands, W.A., Waters, B.K., McBride, J.R. (eds.) Computerized Adaptive Testing: from Inquiry to Operation, American Psychological Association, Washington (2001)
Riding, R.J.: Cognitive Style Analysis, Users Manual. Birmingham Learning and Training Technology, United Kingdom (1991)
Syang, A., Dale, N.B.: Computerized adaptive testing in computer science: assessing student programming abilities. ACM SIGCSE Bulletin 25(1), 53–57 (1993)
Wainer, H.: Computerized Adaptive Testing (A Primer), 2nd edn. Lawrence Erlbaum Associates, New Jersey (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lilley, M., Barker, T. (2004). A Computer-Adaptive Test That Facilitates the Modification of Previously Entered Responses: An Empirical Study. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds) Intelligent Tutoring Systems. ITS 2004. Lecture Notes in Computer Science, vol 3220. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30139-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-30139-4_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22948-3
Online ISBN: 978-3-540-30139-4
eBook Packages: Springer Book Archive