Skip to main content
Springer Nature Link
Log in

Towards Computerized Adaptive Assessment Based on Structured Tasks

  • Conference paper
Adaptive Hypermedia and Adaptive Web-Based Systems (AH 2008)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5149))

  • 1245 Accesses

Abstract

In an attempt to support traditional classroom assessment processes with fully computerized methods, we have developed a method for adaptive assessment suitable for well structured domains with high emphasis on problem solving and capable of robust continuous assessment, potentially encouraging student’s achievements, reflective thinking, and creativity. The method selects problems according to the student’s demonstrated ability, structured task description schemes allow for a detailed analysis of student’s errors, and on-demand generation of task instances facilitates independent student work. We evaluated the proposed method using a software system we had developed in the domain of middle school mathematics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Brusilovsky, P., Miller, P.: Web-based testing for distance education. In: De Bra, P., Leggett, J. (eds.) Proceedings of WebNet 1999, pp. 149–154. AACE (1999)

    Google Scholar 

  2. Mills, C., Steffen, M.: The GRE Computer Adaptive Test: Operational Issues. Computerized Adaptive Testing: Theory and Practice (2000)

    Google Scholar 

  3. Aleven, V., McLaren, B., Sewall, J., Koedinger, K.: The Cognitive Tutor Authoring Tools (CTAT): Preliminary evaluation of efficiency gains. In: Ikeda, M., Ashley, K.D., Chan, T.-W. (eds.) ITS 2006. LNCS, vol. 4053, pp. 61–70. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  4. Feng, M., Heffernan, N., Koedinger, K.: Addressing the Testing Challenge with a Web-based E-Assessment System that Tutors as it Assesses. In: Proceedings of the 15th international conference on World Wide Web, pp. 307–316 (2006)

    Google Scholar 

  5. Lord, F., Novick, M.: Statistical theories of mental test scores. Addison-Wesley, Reading (1968)

    MATH  Google Scholar 

  6. Wainer, H.: Computerized Adaptive Testing: A Primer. Lawrence Erlbaum Associates, Mahwah (2000)

    Google Scholar 

  7. Black, P., Wiliam, D.: Inside the Black Box: Raising Standards Through Classroom Assessment. Phi Delta Kappan 80(2), 139–148 (1998)

    Google Scholar 

  8. Conejo, R.: SIETTE: A Web-Based Tool for Adaptive Testing. International Journal of Artificial Intelligence in Education 14(1), 29–61 (2004)

    Google Scholar 

  9. Conejo, R., Guzmán, E., Pérez-de-la Cruz, J.L., Millán, E.: An Empirical Study About Calibration of Adaptive Hints in Web-Based Adaptive Testing Environments. In: Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 71–80 (2006)

    Google Scholar 

  10. Irvine, S., Kyllonen, P.: Item Generation for Test Development. Lawrence Erlbaum Associates, Mahwah (2002)

    Google Scholar 

  11. Bejar, I., Lawless, R., Morley, M., Wagner, M., Bennett, R., Revuelta, J.: A Feasibility Study of On-the-Fly Item Generation in Adaptive Testing. Journal of Technology, Learning, and Assessment 2(3) (2003)

    Google Scholar 

  12. Sinharay, S., Johnson, M.: Analysis of Data From an Admissions Test With Item Models. Educational Testing Service (2005)

    Google Scholar 

  13. Deane, P., Sheehan, K.: Automatic Item Generation via Frame Semantics: Natural Language Generation of Math Word Problems. In: Annual meeting of the National Council on Measurement in Education, Chicago, IL (2003)

    Google Scholar 

  14. Chang, H., Qian, J., Ying, Z.: a-Stratified Multistage Computerized Adaptive Testing with b-Blocking. Applied Psych. Measurement 25(4), 333–341 (2001)

    Article  MathSciNet  Google Scholar 

  15. Birnbaum, A.: Efficient design and use of tests of a mental ability for various decision-making problems. In: Randolph Air Force Base. Air University, School of Aviation Medicine, Texas (1957)

    Google Scholar 

  16. Baker, F., Seock-Ho, K.: Item Response Theory: Parameter Estimation Techniques. CRC Press, Boca Raton (2004)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Informatics and Information Technologies, Slovak University of Technology, Ilkovičova 3, 842 16, Bratislava, Slovakia

    Jozef Tvarožek & Mária Bieliková

  2. Open University of The Netherlands, Valkenburgerweg 177, 6419 AT, Heerlen, The Netherlands

    Miloš Kravčík

Authors
  1. Jozef Tvarožek
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Miloš Kravčík
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mária Bieliková
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Wolfgang Nejdl Judy Kay Pearl Pu Eelco Herder

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tvarožek, J., Kravčík, M., Bieliková, M. (2008). Towards Computerized Adaptive Assessment Based on Structured Tasks. In: Nejdl, W., Kay, J., Pu, P., Herder, E. (eds) Adaptive Hypermedia and Adaptive Web-Based Systems. AH 2008. Lecture Notes in Computer Science, vol 5149. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70987-9_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-70987-9_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-70984-8

  • Online ISBN: 978-3-540-70987-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics