Abstract
This paper reports on the use of the flexilevel approach for the formative assessment of Computer Science undergraduates. A computerized version of the flexilevel was designed and developed, and its scores were compared with those of a traditional computer-based test. The results showed that the flexilevel and traditional scores were highly and significantly correlated (p<0.01). Findings from this study suggest that the flexilevel approach is a viable adaptive testing strategy, and may be a good candidate for smaller applications where IRT-based CATs may be too demanding in terms of resources.
Chapter PDF
Similar content being viewed by others
References
Assessment Systems Corporation, XCALIBRE Marginal Maximum-Likelihood Estimation, http://assess.com/xcart/product.php?productid=270&cat=0&page=1
Challis, D.: Committing to quality learning through adaptive online assessment. Assessment & Evaluation in Higher Education 30(5), 519–527 (2005)
Conejo, R., Guzmán, E., Millán, E., Trella, M., Pérez-de-la-Cruz, J.L., RÃos, A.: SIETTE: A Web–Based Tool for Adaptive Testing. International Journal of Artificial Intelligence in Education 14, 1–33 (2004)
Conejo, R., Millán, E., Pérez-de-la-Cruz, J.-L., Trella, M.: An empirical approach to on-line learning in SIETTE. In: Gauthier, G., VanLehn, K., Frasson, C. (eds.) ITS 2000. LNCS, vol. 1839, pp. 604–614. Springer, Heidelberg (2000)
Gierl, M.J., Ackerman, T.: Software Review: XCALIBRE — Marginal Maximum-Likelihood Estimation Program, Windows Version 1.10. Applied Psychological Measurement 20(3), 303–307 (1996)
Joy, M., Muzykantskii, B., Evans, M.: An Infrastructure for Web-Based Computer-Assisted Learning. ACM Journal of Educational Resources 2(4), 1–19 (2002)
Lilley, M.: The Development and Application of Computer-Adaptive Testing in a Higher Education Environment, Unpublished PhD thesis, School of Computer Science, University of Hertfordshire, Hertfordshire (2007)
Lord, F.M.: Applications of Item Response Theory to Practical Testing. Lawrence Erlbaum Associates Inc., Mahwah (1980)
RÃos, A., Conejo, R., Trella, M., Millán, E., Pérez-de-la-Cruz, J.L.: Aprendizaje automático de las curvas caracterÃsticas de las preguntas en un sistema de generación automática de tests. In: Actas de la Conferencia Española para la Inteligencia ArtificialCAEPIA 1999 (1999)
RÃos, A., Millán, E., Trella, M., Pérez-de-la-Cruz, J.L., Conejo, R.: Internet Based Evaluation System. In Open Learning Environments: New Computational Technologies to Support Learning, Exploration and Collaboration. In: Proceedings of the 9th World Conference of Artificial Intelligence and Education AIED 1999, pp. 387–394. IOS Press, Amsterdam (1999)
Wainer, H.: Computerized Adaptive Testing: A Primer. Lawrence Erlbaum Associates Inc., Mahwah (2000)
Ward, C.: Preparing and Using Objective Questions. Nelson Thornes Ltd., Cheltenham (1980)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lilley, M., Pyper, A. (2009). The Application of the Flexilevel Approach for the Assessment of Computer Science Undergraduates. In: Jacko, J.A. (eds) Human-Computer Interaction. Interacting in Various Application Domains. HCI 2009. Lecture Notes in Computer Science, vol 5613. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02583-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-02583-9_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02582-2
Online ISBN: 978-3-642-02583-9
eBook Packages: Computer ScienceComputer Science (R0)