Abstract
This paper describes the design, development and test of a novel Computerized Adaptive Testing (CAT) system for English language based on a testing process using features of Item Response Theory and an Ontology of English Language (ELO). The testing process employs a variable branching procedure to deliver the best next test item to the examinee based on the ability level shown so far. The formative assessment part is based on ELO, which acts as knowledge base for giving efficient and detailed feedback to the examinee. The summative part of the feedback consists of the percentage of correct answers regarding the three sections covered in the test: vocabulary, reading comprehension, and structure. It includes the proficiency level and places examinees into one of three groups: high, medium and low proficiency. After the test has terminated, each examinee contributes to a new version of the item bank by feeding back the individual response parameters, which refines item data for subsequent tests.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Sadler, D.R.: Beyond feedback: Developing student capability in complex appraisal. Assessment Eval. High. Educ. 35, 535–550 (2010)
Hepplestone, S., Holden, G., Irwin, B., Parkin, H.J., Thorpe, L.: Using technology to encourage student engagement with feedback: a literature review. Res. Learn. Technol. 19(2), 117–127 (2011)
Evans, G.E., Allen, G., Bender, T., Cluett, W.: We never talk: peer to peer observation and formative feedback as steps to evolving academic culture. In: Proceedings 2017 Canadian Engineering Education Association (CEEA 2017), Paper 174 (2017)
Vawter, L., Martens, A.: Categorizing software feedback in current language software. In: 2019 IEEE 19th International Conference on Advanced Learning Technologies (ICALT), pp. 258–260 (2019)
Fox, J.: Using Portfolios for Assessment/Alternative Assessment. In: Shohamy, E., Or, I.G., May, S. (eds.) Language Testing and Assessment. ELE, pp. 135–147. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-02261-1_9
Rietsche, R., Duss, K., Persch, J.M., Söllner, M.: Design and Evaluation of an IT-based Formative Feedback Tool to Foster Student Performance. In: 39th International Conference on Information Systems, San Francisco, pp. 1–17 (2018)
Van Groen, M.M., Eggen, T.J.H.M.: Educational test approaches: the suitability of computer-based test types for assessment and evaluation in formative and summative contexts. J. Appl. Test. Technol. 21(1), 12–24 (2020)
Hambleton, R.K., Swaminathan, H., Rogers, H.J.: Fundamentals of Item Response Theory. SAGE Publications, Newbury Park, C.A. (1991)
de Ayala, R.J.: The Theory and Practice of Item Response Theory, 2nd edn. Guilford Publications, New York (2008)
Schalley, A.C.: Ontologies and ontological methods in linguistics. Lang. Linguist. Compass 13(11), 1–19 (2019)
Rudner, L.M.: An On-line, Interactive, Computer Adaptive Testing,Tutorial. Computer Adaptive Testing Tutorial. http://echo.edres.org:8080/scripts/cat/catdemo.html. Accessed 15 Mar 2020
Weiss, D.J.: Strategics of adaptive ability measurement. University of Minnoseta, Mineapolis (1974)
Lord, F.M.: A theoretical study of the measurement effectiveness of flexilevel test. Educ. Psychol. Meas. 31, 805–813 (1971)
Urry, V.W.: Tailored testing: A successful application of latent trait theory. J. Educ. Meas. 14, 181–196 (1977)
Reckase, M.D.: An interactive computer program for tailored testing based on the one-parameter logistic model. Behav. Res. Methods Instrum. 6, 208–212 (1974)
O’Sullivan, B.: Language Testing: Theories and Practices. Palgrave Macmillan, UK (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Namahoot, C.S., Brückner, M., Nuntawong, C. (2020). CLASS-O, A Cooperative Language Assessment System with Ontology. In: Luo, Y. (eds) Cooperative Design, Visualization, and Engineering. CDVE 2020. Lecture Notes in Computer Science(), vol 12341. Springer, Cham. https://doi.org/10.1007/978-3-030-60816-3_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-60816-3_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60815-6
Online ISBN: 978-3-030-60816-3
eBook Packages: Computer ScienceComputer Science (R0)