Skip to main content
Log in

The Development of Computerized Adaptive Testing with Cognitive Diagnosis for an English Achievement Test in China

Journal of Classification Aims and scope Submit manuscript

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  • BOCK, D., and MISLEVY, R. (1982), “EAP Estimation of Ability in a Microcomputer Environment”, Applied Psychological Measurement, 6, 431–444.

    Article  Google Scholar 

  • CHENG, Y., and CHANG, H. (2007), “The Modified Maximum Global Discrimination Index Method for Cognitive Diagnostic Computerized Adaptive Testing[R]”, in Proceedings of the 2007 GMAC Computerized Adaptive Testing Conference, June 7, ed. D. Weiss.

  • CHENG, Y. (2009), “When Cognitive Diagnosis Meets Computerized Adaptive Testing: CD-CAT”, Psychometrika, 74, 619–632.

    Article  MathSciNet  MATH  Google Scholar 

  • CUI Y., LEIGHTON J.P, and ZHENG Y.G. (2006), “Simulation Studies for Evaluating the Performance of the Two Classification Methods in the AHM”, paper presented at the Annual Meeting of National Council on Measurement in Education, San Francisco, CA.

  • DE LA TORRE, J., and DOUGLAS, J.A. (2004), “Higher-Order Latent Trait Models for Cognitive Diagnosis”, Psychometrika, 69, 333–353.

    Article  MathSciNet  Google Scholar 

  • DE LA TORRE, J., and DOUGLAS, J.A. (2008), “Model Evaluation and Multiple Strategies in Cognitive Diagnosis: An Analysis of Fraction Subtraction Data”, Psychometrika, 73, 595–624.

    Article  MathSciNet  MATH  Google Scholar 

  • DE LA TORRE, J. (2009), “DINA Model and Parameter Estimation: A Didactic[J]”, Journal of Educational and Behavioral Statistics, 34, 115–130.

    Article  Google Scholar 

  • DE LA TORRE, J., and LEE, Y.S. (2010), “A Note on the Invariance of the DINA Model Parameters”, Journal of Educational Measurement, 47, 115–127.

    Article  Google Scholar 

  • DOEY, L., and KURTA, J. (2011), “Correspondence Analysis Applied to Psychological Research”, Tutorials in Quantitative Methods for Psychology, 7(1), 5–14.

    Google Scholar 

  • EDUCATIONAL TESTING SERVICE (2004), Arpeggio: Release 1.1 [Computer Software], Princeton, NJ: Author.

  • EMBRETSON, S. (1995), “A Cognitive Design System Approach to Generating Valid Tests: Application to Abstract Reasoning”, Psychological Methods, 3, 300–396.

    Google Scholar 

  • HARTZ, S. (2002), “A Bayesian Framework for the Unified Model for Assessing Cognitive Abilities: Blending Theory with Practicality”, unpublished doctoral thesis, University of Illinois at Urbana-Champaign.

  • HARTZ, S., ROUSSOS, L., and STOUT, W. (2002), Skill Diagnosis: Theory and Practice [Computer software user manual for Arpeggio software], Princeton, NJ: Educational Testing Service.

  • JANG, E. (2008), “A Framework for Cognitive Diagnostic Assessment”, in Towards an Adaptive CALL: Natural Language, eds. C.A. Chapelle, Y.-R. Chung, and J. Xu, pp. 117–132.

  • JUNKER, B., and SIJTSMA, K. (2001), “Cognitive Assessment Models with Few Assumptions, and Connections with Nonparametric Item Response Theory”, Applied Psychological Measurement, 25(3): 258–272.

    Article  MathSciNet  Google Scholar 

  • LEIGHTON, J.P., and GIERL, M.J. (eds) (2007), “Cognitive Diagnostic Assessment for Education: Theory and Practices”, Cambridge: Cambridge University Press.

  • LEIGHTON, J.P., GIERL, M.J., and HUNKA, S.M. (2004), “The Attribute Hierarchy Method for Cognitive Assessment: A Variation on Tatsuoka’s Rule-Space Approach”, Journal of Education Measurement, 41(3): 205–237.

    Article  Google Scholar 

  • MACREADY, G.B., and DAYTON, C.M. (1977), The Use of Probabilistic Models in the Assessment of Mastery”, Journal of Educational Statistics, 2, 99–120.

    Article  Google Scholar 

  • MARIS, E. (1999), “Estimating Multiple Classification Latent Class Models”, Psychometrika, 64, 187–212

    Article  MathSciNet  Google Scholar 

  • MCGLOHEN, M., and CHANG, H. (2008), “Combining Computer Adaptive Testing Technology with Cognitively Diagnostic Assessment”, Behavior Research Methods 40(3), 808–821.

    Article  Google Scholar 

  • MCGLOHEN, M. (2004), “The Application of Cognitive Diagnosis and Computerized Adaptive Testing to a Large-Scale Assessment”, unpublished doctoral thesis, University of Texas, Austin, TX.

  • MISLEVY, R. (1994), “Probability-Based Inference in Cognitive Diagnosis”, Education Testing Service Research Report, Princeton, NJ.

  • TATSUOKA, C. (2002), “Data Analytic Methods for Latent Partially Ordered Classification Models”, Journal of the Royal Statistical Society: Series C (Applied Statistics), 51(3), 337–350.

    Article  MathSciNet  MATH  Google Scholar 

  • TATSUOKA, C., and FERGUSON, T. (2003), “Sequential Analysis on Partially Ordered Sets”, Journal of the Royal. Statistical Society Series B, 65, 143–157.

    Article  MathSciNet  MATH  Google Scholar 

  • TATSUOKA, K.K. (1983), “Rule Space: An Approach for Dealing with Misconceptions Based on Item Response Theory [J]”, Journal of Educational Measurement, 20(4), 345–354.

    Article  Google Scholar 

  • TATSUOKA, K.K. (1995), “Architecture of Knowledge Structures and Cognitive Diagnosis: A Statistical Pattern Recognition and Classification Approach”, in Cognitively Diagnostic Assessment, eds. P.D. Nichols, S.F. Chipman, and R.L. Brennan, Hillsdale: Lawrence Erlbaum Associates, pp. 327–361.

  • TATSUOKA, K.K., and TATSUOKA, M.M. (1997), “Computerized Cognitive Diagnostic Adaptive Testing: Effect on Remedial Instruction as Empirical Validation”, Journal of Educational Measurement, 34(1), 3–20.

    Article  Google Scholar 

  • TEMPLIN, J. (2005), Arpeggio 2.0, [Computer software and Manual], Author owned: retrievable upon request.

  • TEMPLIN, J., HENSON, R., and DOUGLAS, J. ( 2006), “General Theory and Estimation of Cognitive Diagnosis Models: Using Mplus to Derive Model Estimates”, paper presented at the April 2007 National Council on Measurement in Education training session, Chicago, IL.

  • VON DAVIER, M. (2005), “General Diagnostic Model Applied to Language Testing Data”, Education Testing Service Research Report, RR-05-16, Princeton, NJ.

  • WEISS, D. (1983), New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing, New York: Academic Press.

    Google Scholar 

  • XU, X., and VON DAVIER, M. (2006). “Cognitive Diagnosis for NAEP Proficiency Data”, Education Testing Service Research Report, Princeton, NJ.

  • XU, X., CHANG, H., and DOUGLAS, J. (2005), “Computerized Adaptive Testing Strategies for Cognitive Diagnosis”, paper presented at the annual meeting of National Council on Measurement in Education, Montreal, Canada.

  • XU, X., CHANG, H., and DOUGLAS, J. (2003), “A Simulation Study to Compare CAT Strategies for Cognitive Diagnosis”, paper presented at the March annual meeting of National Council on Measurement in Education, Chicago, IL.

  • XU, X., and DOUGLAS, J. (2006), “Computerized Adaptive Testing Under Nonparametric IRT Models”, Psychometrika, 71, 121–137.

    Article  MathSciNet  Google Scholar 

  • YANG, X., and EMBRETSON, S. (2007), “Construct Validity and Cognitive Diagnostic Assessment”, in Cognitive Diagnostic Assessment for Education: Theory and Applications[C], eds. J. Leighton, and M.J. Jierl, Cambridge: Cambridge University Press, pp. 119–145.

  • ZHU, Y., DING, S.,ZHAO, T., and XU, Z. (2008), “A Polytomous Extension of AHM and a New Classification Method”, paper presented at the Annual Meeting of National Council on Measurement in Education, New York, NY

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hong-Yun Liu.

Additional information

The authors are indebted to the editor, associate editor and three anonymous reviewers for their constructive suggestions and comments on the earlier manuscript. They particularly thank Carolyn Anderson for her suggestions which led to numerous improvements.

This research was partially supported by Natural Science Foundation of China Grant 31100759, 30860084, and 31160203, by the project of Student Academic Quality Evaluation under the National Centre of Curriculum and Textbook Development for Basic Education (NCCT), Ministry of Education of the People’s Republic of China. Part of the paper was originally presented at the 2010 Annual Meeting of the National Council on Measurement in Education, Denver Co.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, HY., You, XF., Wang, WY. et al. The Development of Computerized Adaptive Testing with Cognitive Diagnosis for an English Achievement Test in China. J Classif 30, 152–172 (2013). https://doi.org/10.1007/s00357-013-9128-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00357-013-9128-5

Keywords

Navigation