Skip to main content

Advertisement

SpringerLink
Log in

Simultaneously construct IRT-based parallel tests based on an adapted CLONALG algorithm

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The simultaneously construct IRT-based (Item Response Theory) parallel tests problem requires large numbers of variables and constraints, which leads to high computational complexities and now there is no polynomial time algorithm that exists for finding the optimal solution. This article proposes an adapted CLONALG algorithm to simultaneously construct IRT-based parallel tests. Based on the CLONALG features, the proposed scheme can use a single test construction model to simultaneously construct multiple parallel tests. At the same time, it avoids the inequality problem in the sequential construction and solves the drawback of larger numbers of variables and constraints in the simultaneous construction. The serial experiments show that the proposed scheme has a lower deviation in simultaneously constructing parallel tests than the Linear Programming (LP) and the Genetic Algorithm (GA). It is also able to construct parallel tests with identical test specifications from a large item bank.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ackerman TA (1989) An alternative methodology for creating parallel test forms using the IRT information function. In: The annual meeting of the national council for measurement in education

    Google Scholar 

  2. Adema JJ (1992) Methods and models for the construction of weakly parallel tests. Appl. Psychol. Meas. 16:53–63

    Article  Google Scholar 

  3. Armstrong RD, Jones DH (1992) Polynomial algorithms for item matching. Appl. Psychol. Meas. 16:365–371

    Article  Google Scholar 

  4. Armstrong RD, Jones DH, Li X, Wu IL (1996) A study of a network-flow algorithm and a noncorrecting algorithm for test assembly. Appl. Psychol. Meas. 20:89–98

    Article  Google Scholar 

  5. Belov DI, Armstrong RD (2005) Monte Carlo test assembly for item pool analysis and extension. Appl. Psychol. Meas. 29:239–261

    Article  MathSciNet  Google Scholar 

  6. Boekkooi-Timminga E (1987) Simultaneous test construction by zero-one programming. Methodika 1:101–112

    Google Scholar 

  7. Boekkooi-Timminga E (1990) The construction of parallel tests from IRT-based item banks. J. Educ. Behav. Stat. 15:129–145

    Article  Google Scholar 

  8. Cor K, Alves C, Gierl MJ (2008) Conducting automated test assembly using the premium solver platform version 7.0 with Microsoft excel and the large-scale LP/QP solver engine add-in. Appl. Psychol. Meas. 32:652–663

    Article  MathSciNet  Google Scholar 

  9. Cor K, Alves C, Gierl MJ (2009) Three applications of automated test assembly within a user-friendly modeling environment. Pract. Assess. Res. Eval. 14:1–23

    Google Scholar 

  10. de Castro LN, Von Zuben FJ (2002) Learning and optimization using the clonal selection principle. IEEE Trans. Evol. Comput. 6:239–251

    Article  Google Scholar 

  11. Finkelman M, Kim W, Roussos LA (2009) Automated test assembly for cognitive diagnosis models using a genetic algorithm. J. Educ. Meas. 46:273–292

    Article  Google Scholar 

  12. Goldberg D, Korb B, Deb K (1989) Messy genetic algorithms: Motivation, analysis, and first results. The Clearinghouse for Genetic Algorithms (TCGA), Report 89003

  13. Hambleton RK, Swaminathan H (1985) Item response theory: principles and applications. Kluwer Academic, Amsterdam

    Google Scholar 

  14. Hwang GJ, Lin BMT, Tseng HH, Lin TL (2005) On the development of a computer-assisted testing system with genetic test sheet-generating approach. IEEE Trans. Syst. Man Cybern., Part C, Appl. Rev. 35:590–594

    Article  Google Scholar 

  15. Hwang GJ, Yin PY, Yeh SH (2006) A tabu search approach to generating test sheets for multiple assessment criteria. IEEE Trans. Ed. 49:88–97

    Article  Google Scholar 

  16. Hwang GJ, Chu HC, Yin PY, Lin JY (2008) An innovative parallel test sheet composition approach to meet multiple assessment criteria for national tests. Comput. Educ. 51:1058–1072

    Article  Google Scholar 

  17. Korkmaz EE (2010) Multi-objective Genetic Algorithms for grouping problems. Appl. Intell. 33:179–192

    Article  Google Scholar 

  18. Lee CL, Huang CH, Lin CJ (2007) Test-sheet composition using immune algorithm for e-learning application. In: New Trends in Applied Artificial. LNSC, vol. 4570, pp. 823–833

    Chapter  Google Scholar 

  19. Linhares A, Yanasse HH (2010) Search intensity versus search diversity: a false trade off? Appl. Intell. 32:279–291

    Article  Google Scholar 

  20. Lord FM (1980) Applications of item response theory to practical testing problems. Lawrence Erlbaum

  21. Ombuki BM, Ventresca M (2004) Local search genetic algorithms for the job shop scheduling problem. Appl. Intell. 21:99–109

    Article  MATH  Google Scholar 

  22. Ray SS, Bandyopadhyay S, Pal SK (2007) Genetic operators for combinatorial optimization in TSP and microarray gene ordering. Appl. Intell. 26:183–195

    Article  MATH  Google Scholar 

  23. Shewchuk JR (1994) An introduction to the conjugate gradient method without the agonizing pain. Tech Rep

  24. Sun KT, Chen SF (1999) A study of applying the artificial intelligent technique to select test items. Psychol. Test. 46:75–88

    Google Scholar 

  25. Sun KT, Chen YJ, Tsai SY, Cheng CF (2008) Creating IRT-based parallel test forms using the genetic algorithm method. Appl. Meas. Educ. 21:141–161

    Article  Google Scholar 

  26. Theunissen TJJM (1985) Binary programming and test design. Psychometrika 50:411–420

    Article  Google Scholar 

  27. van der Linden WJ (1998) Optimal assembly of psychological and educational tests. Appl. Psychol. Meas. 22:195–211

    Article  Google Scholar 

  28. van der Linden WJ (2005) Linear models for optimal test design. Statistics for social and behavioral sciences. Springer, Berlin

    Google Scholar 

  29. van der Linden WJ, Adema JJ (1998) Simultaneous assembly of multiple test forms. J. Educ. Meas. 35:185–198

    Article  Google Scholar 

  30. Verschoor AJ (2007) Genetic algorithms for automated test assembly. PhD thesis

  31. Wu IL (2001) A new computer algorithm for simultaneous test construction of two-stage and multistage testing. J. Educ. Behav. Stat. 26:180–198

    Article  Google Scholar 

  32. Yin PY, Chang KC, Hwang GJ, Hwang GH, Chan Y (2006) A particle swarm optimization method to composing serial test-sheets for multiple assessment criteria. Educ. Technol. Soc. 9:3–15

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate Institute of e-Learning, National Changhua University of Education, No. 1, Jin-De Road, Changhua City, Taiwan, ROC

    Ting-Yi Chang & You-Fu Shiu

Authors
  1. Ting-Yi Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. You-Fu Shiu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ting-Yi Chang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chang, TY., Shiu, YF. Simultaneously construct IRT-based parallel tests based on an adapted CLONALG algorithm. Appl Intell 36, 979–994 (2012). https://doi.org/10.1007/s10489-011-0308-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-011-0308-x

Keywords

Search

Navigation