research-article

Adaptive test system based on revised Bloom's taxonomy

Authors:

Mariana Raykova,

Hristina Kostadinova,

George TotkovAuthors Info & Claims

CompSysTech '11: Proceedings of the 12th International Conference on Computer Systems and Technologies

Pages 504 - 509

https://doi.org/10.1145/2023607.2023692

Published: 16 June 2011 Publication History

Abstract

Generating different tests' versions to satisfy the needs of different users is one of the biggest challenges that e-learning systems designers are faced with. This research deals with the basic elements of Computer Adaptive Tests (CAT) construction, as a way to resolve the abovementioned issue. Test generation has two main components: a calibrated bank of questions and an algorithm, which determines the start and end point of the test, and the sequence of the test items given to the users. The current method of creating the components of the test generation process is based on two main pillars: accumulation of the test items and Revised Bloom's Taxonomy (RBT). It allows the test items' level of difficulty to be automatically determined, according to the cognitive level in RBT and the bank of questions to be calibrated in every moment of the testing. The above described method is realized in BEST e-learning system.

References

[1]

Anderson, L., & D. Krathwohl (Eds), A Taxonomy for Learning, Teaching and Assessing: A revision of Bloom's Taxonomy of educational objectives: Complete edition, (2001). New York: Longman.

[2]

Articulate Quizmaker, http://www.articulate.com/products/quizmaker.php.

[3]

Bloom, B. S. Taxonomy of Educational Objectives (1956). Published by Allyn and Bacon, Boston, MA. Copyright (c) 1984 by Pearson Education.

[4]

Brusilovsky, P., Methods and Techniques of Adaptive Hypermedia, in User Modeling and User Adapted Interaction, 1996, v6, n2--3.

[5]

Brusilovsky P. Adaptive and Intelligent Technologies for Web-based Education, Kunstliche Intelligenz, Special Issue on Intelligent Systems and Teleteaching, 4, 1999.

[6]

Conejo R., Ed. Guzmán, E. Millán, M. Trella, J. L. Pérez-De-La-Cruz, A. Ríos, SIETTE: A Web--Based Tool for Adaptive Testing, International Journal of Artificial Intelligence in Education, 14 (2004) 1--33.

Digital Library

[7]

Giouroglou E., A. A. Economides, 2004 State-of-the-Art and Adaptive Open-closed Items in Adaptive Foreign Language Assessment. Proceedings of the 4th Conference on Information and CommunicationsTechnologies in Education, Athens 2004, 747--756.

[8]

GRE, http://www.ets.org/gre/.

[9]

Kostadinova H., G. Totkov, M. Raykova, Towards Automated Question Generation according to Bloom's Taxonomy, 40th Conference of UBM, Borovetz 2011, 413--422.

[10]

Sokolova M., G. Totkov, Towards Accumulative e-Learning Systems, in Proceedings of the 3rd Balkan Conference in Informatics (K. Boyanov, R. Nikolov, I. Nikolova, M. Nisheva eds.), vol.1, Sept. 27--29, 2007, Sofia, Bulgaria, 512--522.

[11]

Sokolova, M., G. Totkov, Accumulative Question Types in e-Learning Environment, Int. Conf. on Computer Systems and Technologies (e-learning), CompSysTech'07, IV. 21--1 -- IV. 21--6 Rousse, 2007.

Digital Library

[12]

Sokolova M., H. Indzhov, G. Totkov, Automatized Generation of Test Items Assessing Knowledge according to Bloom's Taxonomy, 3rd National Conference "Education in Information Society", 27--28.5.2010, Plovdiv, 117--124.

[13]

TOEFL, Successful TOEFL Test - The TOEFL CAT, http://www.mytoeflsuccess.com/toefl-test/faq/cat.htm, recently visited February 2011.

[14]

Totkov G., E. Somova, M. Sokolova, Modelling of e-Learning Processes: an Approach Used in Plovdiv e-University, Int. Conf. on Computer Systems and Technologies (e-learning), CompSysTech'04, 17--18 June 2004, Rousse, IV.12.1 -- IV.12.6.

Digital Library

[15]

Weiss, D. J., Adaptive Testing by Computer, Journal of Consulting and Ginkal Pathology 1985, Vol. 53, No. 6, 774--789.

[16]

Weiss, D. J., G. G. Kingsbury, Application of Computerized Adaptive Testing to Educational Problems, Journal of Educational Measurement, (1984), 21, 361--375.

[17]

Yang, S. Q. Yang, S. Z. Cai, S. L. Ding, and Q. L. Ding, Design and Realization of CAT with Cognitive Diagnosis Based on FCA, Journal of Nanjing University of Aeronautics and Astronautics, Nanjing, Vol.40, No.5, Oct. 2008, 696--701.

[18]

Yordzhev, K., I. Peneva, B. Kirilieva-Shivarova, A Relational Model of Personality Psychological Tests, FMNS-2009, SWU, Blagoevgrad, Bulgaria, Vol.1, 69--77.

Cited By

Chrysafiadi KTroussas CVirvou M(2018)A Framework for Creating Automated Online Adaptive Tests Using Multiple-Criteria Decision Analysis2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC.2018.00049(226-231)Online publication date: Oct-2018
https://doi.org/10.1109/SMC.2018.00049
Gottipati SShankararaman V(2018)Competency analytics toolEducation and Information Technologies10.1007/s10639-017-9584-323:1(41-60)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s10639-017-9584-3
Narayanan SKommuri VSubramanian NBijlani KNair N(2017)Unsupervised Learning of Question Difficulty Levels Using Assessment ResponsesComputational Science and Its Applications – ICCSA 201710.1007/978-3-319-62392-4_39(543-552)Online publication date: 6-Jul-2017
https://doi.org/10.1007/978-3-319-62392-4_39
Show More Cited By

Index Terms

Adaptive test system based on revised Bloom's taxonomy

Recommendations

A Coverage Relationship Model for Test Case Selection and Ranking for Multi-version Software
HASE '07: Proceedings of the 10th IEEE High Assurance Systems Engineering Symposium

Testing a group of software artifacts that implement the same specification can be time consuming, especially when the test case repository is large. In the meantime, some test cases may cover the same aspects in the software, thus it is not necessary ...
Self-assessment in a feasible, adaptive web-based testing system

Adaptive testing systems generate tests for assessment that are tailored to each student. In these tests, students are assessed through a process that uses Item Response Theory (IRT), a well-founded psychometric theory. This theory is responsible for ...
Adaptive test elimination for analog/RF circuits
DAC '09: Proceedings of the 46th Annual Design Automation Conference

In this paper, we propose an adaptive test strategy that tailors the test sequence with respect to the properties of each individual instance of a circuit. Reducing the test set by analyzing the dropout patterns during characterization and eliminating ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CompSysTech '11: Proceedings of the 12th International Conference on Computer Systems and Technologies

June 2011

688 pages

ISBN:9781450309172

DOI:10.1145/2023607

Editors:
Boris Rachev
Technical University of Varna, Varna, Bulgaria
,
Angel Smrikarov
University of Ruse, Ruse, Bulgaria

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

TELECVB: TELECOMS - Varna, Bulgaria
Austrian Comp Soc: Austrian Computer Society
BPCSB: BULGARIAN PUBLISHING COMPANY - Sofia, Bulgaria
IOMAIBB: INSTITUTE OF MATHEMATICS AND INFORMATICS - BAS, Bulgaria
NBUBB: New Bulgarian University - BAS, Bulgaria
Technical University of Sofia
IOIACTBB: INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGIES - BAS, Bulgaria
TSFPS: THE SEVENTH FRAMEWORK PROGRAMME - SISTER
ERSVB: EURORISC SYSTEMS - Varna, Bulgaria
FOSEUB: FEDERATION OF THE SCIENTIFIC ENGINEERING UNIONS - Bulgaria
UORB: University of Ruse, Bulgaria
BBPSB: BULGARIAN BUSINESS PUBLICATIONS - Sofia, Bulgaria
CASTUVTB: CYRIL AND ST. METHODIUS UNIVERSITY of Veliko Tarnovo, Bulgaria
TECHUVB: Technical University of Varna, Bulgaria
LLLPET: LIFELONG LEARNING PROGRAMME - ETN TRICE
IEEEBSB: IEEE Bulgaria Section, Bulgaria

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CompSysTech '11

Sponsor:

TELECVB
Austrian Comp Soc
BPCSB
IOMAIBB
NBUBB
IOIACTBB
TSFPS
ERSVB
FOSEUB
UORB
BBPSB
CASTUVTB
TECHUVB
LLLPET
IEEEBSB

CompSysTech '11: 12th International Conference on Computer Systems and Technologies

June 16 - 17, 2011

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 241 of 492 submissions, 49%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
362
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chrysafiadi KTroussas CVirvou M(2018)A Framework for Creating Automated Online Adaptive Tests Using Multiple-Criteria Decision Analysis2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC.2018.00049(226-231)Online publication date: Oct-2018
https://doi.org/10.1109/SMC.2018.00049
Gottipati SShankararaman V(2018)Competency analytics toolEducation and Information Technologies10.1007/s10639-017-9584-323:1(41-60)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s10639-017-9584-3
Narayanan SKommuri VSubramanian NBijlani KNair N(2017)Unsupervised Learning of Question Difficulty Levels Using Assessment ResponsesComputational Science and Its Applications – ICCSA 201710.1007/978-3-319-62392-4_39(543-552)Online publication date: 6-Jul-2017
https://doi.org/10.1007/978-3-319-62392-4_39
Sangodiah AAhmad RAhmad W(2016)Integration of machine learning approach in item bank test system2016 3rd International Conference on Computer and Information Sciences (ICCOINS)10.1109/ICCOINS.2016.7783208(164-168)Online publication date: Aug-2016
https://doi.org/10.1109/ICCOINS.2016.7783208
Raykova MKostadinova HTotkov G(2014)Automatized test item generation in moodleProceedings of the 15th International Conference on Computer Systems and Technologies10.1145/2659532.2659606(417-423)Online publication date: 27-Jun-2014
https://dl.acm.org/doi/10.1145/2659532.2659606
Shankararaman VGottipati S(2014)Aligning assessments with competencies using keyphrase extraction2014 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE)10.1109/TALE.2014.7062630(25-32)Online publication date: Dec-2014
https://doi.org/10.1109/TALE.2014.7062630
Kostadinova HTotkov GIndzhov H(2012)Adaptive e-learning system based on accumulative digital activities in revised Bloom's taxonomyProceedings of the 13th International Conference on Computer Systems and Technologies10.1145/2383276.2383330(368-375)Online publication date: 22-Jun-2012
https://dl.acm.org/doi/10.1145/2383276.2383330

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten