Abstract
In e-testing it is important to administer tests composed of good quality question items. By the term “quality” we intend the potential of an item in effectively discriminating between strong and weak students and in obtaining tutor’s desired difficulty level. Since preparing items is a difficult and time-consuming task, good items can be re-used for future tests. Among items with lower performances, instead, some should be discarded, while some can be modified and then re-used. This paper presents a Web-based e-testing system which detects defective question items and, when possible, provides the tutors with advice to improve their quality. The system detects defective items by firing rules. Rules are evaluated by a fuzzy logic inference engine. The proposed system has been used in a course at the University of Salerno.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Woodford, K., Bancroft, P.: Multiple Choice Items Not Considered Harmful. In: 7th Australian conference on Computing education, Newcastle, Australia, pp. 109–116 (2005)
Hambleton, R.K., Swaminathan, H.: Item Response Theory– Principles und Applications, Kluwer Academic Publishers Group, Netherlands (1985)
Zadeh, L.A.: Fuzzy Sets and Their Applications to Pattern Classification and Clustering. World Scientific Publishing Co. Inc, River Edge, NJ, USA (1977)
Bardossy, A., Duckstein, L.: Fuzzy Rule-Based Modeling with Applications to Geophysical, Biological, and Engineering Systems. CRC Press, Boca Raton, USA (1995)
Lloyd, S.: Least Squares Quantization in PCM. IEEE Transactions on Information Theory 28 (2), 129–137 (1982)
Costagliola, G., Ferrucci, F., Fuccella, V., Gioviale, F.: A Web-based Tool for Assessment and Self-Assessment, In: 2nd International Conference on Information Technology: Research and Education, pp. 131–135 (2004)
Stage, C.: A Comparison Between Item Analysis Based on Item Response Theory and Classical Test Theory. A Study of the SweSAT Subtest READ (1999), http://www.umu.se/edmeas/publikationer/pdf/enr3098sec.pdf
Massey: The Relationship Between the Popularity of Questions and Their Difficulty Level in Examinations Which Allow a Choice of Question. Occasional Publication of The Test Dev. and Res. Unit, Cambridge
Civanlar, M.R., Trussel, H.J.: Constructing membership functions using statistical data. Fuzzy Sets and Systems 18, 1–14 (1986)
jFuzzyLogic: Open Source Fuzzy Logic (Java), http://jfuzzylogic.sourceforge.net/html/index.html
FCL: Fuzzy Control Prog. Committee Draft CD 1.0 (Rel. 19 Jan 97), http://www.fuzzytech.com/binaries/ieccd1.pdf
Hibernate, http://www.hibernate.org
ECMAScript, Standard ECMA-262, ECMAScript Language Specification, http://www.ecma-international.org/publications/files/ECMA-ST/Ecma.262.pdf
Moodle, http://moodle.org
Blackboard, http://www.blackboard.com
Questionmark, http://www.questionmark.com
Hsieh, C.T., Shih, T.K., Chang, W.C., Ko, W.C.: Feedback and Analysis from Assessment Metadata in E-learning. In: 17th International Conference on Advanced Information Networking and Applications, Xi’an, China, pp. 155–158 (2003)
Ho, R.G., Yen, Y.C.: Design and Evaluation of an XML-Based Platform-Independent Computerized Adaptive TestingSystem. IEEE Transactions on Education 48(2), 230–237 (2005)
Chen, C.M., Duh, L.J., Liu, C.Y.: A Personalized Courseware Recommendation System Based on Fuzzy Item Response Theory. In: IEEE Int. Conf. on e-Technology, e-Commerce and e-Service, Taipei, Taiwan, pp. 305–308 (2004)
Sun, K.T.: An Effective Item Selection Method for Educational Measurement. In: International Workshop on Advanced Learning Technologies, pp. 105–106 (1967)
Hung, J.C., Lin, L.J., Chang, W.C., Shih, T.K., Hsu, H.H., Chang, H.B., Chang, H.P., Huang, K.H.: A Cognition Assessment Authoring System for E-Learning. In: 24th Int. Conf. on Distributed Computing Systems Workshops, pp. 262–267 (2004)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Costagliola, G., Ferrucci, F., Fuccella, V. (2008). A Web-Based E-Testing System Supporting Test Quality Improvement. In: Leung, H., Li, F., Lau, R., Li, Q. (eds) Advances in Web Based Learning – ICWL 2007. ICWL 2007. Lecture Notes in Computer Science, vol 4823. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78139-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-540-78139-4_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78138-7
Online ISBN: 978-3-540-78139-4
eBook Packages: Computer ScienceComputer Science (R0)