Abstract
Marking of a huge number of essays is a very burdensome and tedious task for the teacher and/or trainer. Studies have shown that their efficiency decreases significantly when continuously marking essays over a given period of time. An Automated Essay Grading (AEG) system would be most desirable in such a scenario to reduce the workload of the teacher and/or trainer and to increase the efficiency of the marking process. Almost all the existing AEG systems assume that the relationship between the features of the essay and the essay grade is linear, which may not necessarily be the case. In cases where the relationship between the feature vector and the essay grade is non-linear, none of the existing methods provides a mechanism to capture that and determine an accurate essay grade. This paper proposes a new AEG system, the OzEgrader, that aims to capture both the linear and non-linear relationships between the essay features and its grade, and explains the methodology for noise reduction in the essay dataset.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hardy, R.A.: Examining the cost of performance assessment. Applied Measurement in Education 8, 121–134 (1995)
Valenti, S., Neri, F., Cucchiarelli, A.: An overview of current research on automated essay grading. Journal of Information Technology Education 2, 319–330 (2003)
Stalnaker, J.M.: The problem of the English examination. Education Record 17, 41 (1936)
Rudner, L., Gagne., P.: An overview of three approaches to scoring written essays by computer. Practical Assessment, Research & Evaluation 7(26) (2001)
Kakkonen, T.: Computer Assisted Assessment of Essays. Department of Computer Science, Master’s. University of Joensuu, Finland (2003)
Page, E.B., Petersen, N.S.: The computer moves into essay grading. Phi Delta Kappa 76(7), 561–565 (1995)
Page, E.B.: Computer grading of student prose, using modern concepts and software. Journal of Experimental Education 62, 127–142 (1994)
Darus, S., Stapa, S., Hussin, S.: Experimenting a Computer-Based Essay Marking System at Universiti Kebangsaan Malaysia. Jurnal Teknologi 39(E), 1–18 (2003)
Haswell, R.H.: Automated text-checkers: A chronology and a bibliography of commentary. Computers and Composition Online (2005)
Burstein, J.: The e-rater scoring engine: Automated Essay Scoring with natural language processing. In: Shermis, M.D., Burstein, J.C. (eds.) Automated Essay Scoring: A Cross Disciplinary Approach. Lawrence Erlbaum Associates, Mahwah (2003)
Rudner, L.M., Liang, T.: Automated essay scoring using Bayes’ Theorem. The Journal of Technology, Learning and Assessment 1(2), 3–21 (2002)
Page, E.B.: The imminence of grading essays by computer. Phi Delta Kappa 47, 238–243 (1966)
Burstein, J., Leacock, C., Swartz, R.: Automated evaluation of essay and short answers. In: Danson, M. (ed.) Sixth International Computer Assisted Assessment Conference. Loughborough University, Loughborough (2001)
Kakkonen, T., Myller, N., Suttinen, E., Timonen, J.: Comparison of Dimension Reduction Methods for Automated Essay Grading. Educational Technology & Society 11(3), 275–288 (2008)
Landauer, T.K., Laham, D., Rehder, B., Schreiner, M.E.: How well can passage meaning be derived without using word order? A comparison of Latent Semantic Analysis and humans. In: Conference How Well Can Passage Meaning Be Derived without Using Word Order? A Comparison of Latent Semantic Analysis and Humans, pp. 412–417. Erlbaum (1991)
Whittington, D., Hunt, H.: Approaches to the computerized assessment of free text responses. In: Danson, M. (ed.) Sixth International Computer Assisted Assessment Conference. Loughborough University, UK (1999)
Mitchell, T., Russel, T., Broomhead, P., Aldridge, N.: Towards robust computerized marking of free-text responses. In: Danson, M. (ed.) Sixth International Computer Assisted Assessment Conference. Loughborough University, Loughborough (2002)
Johnson, R.: Elementary Statistics. PWS-Kent Publishers (1988)
Yang, Y.: An evaluation of statistical approaches to text categorization. Carnegie Mellon University (1997)
Christie, J.R.: Automated essay marking-for both style and content. In: Danson, M. (ed.) Third Annual Computer Assisted Assessment Conference. Loughborough University, Loughborough (1999)
Ming, P.Y., Mikhailov, A.A., Kuan, T.L.: Intelligent Essay Marking System. Learners Together (2000)
Mason, O., Stephenson, I.-G.: Automated free text marking with Paperless School. In: Danson, M. (ed.) Sixth International Computer Assisted Assessment Conference. Loughborough University, Loughborough (2002)
Dikli, S.: An overview of automated scoring of essays. The Journal of Technology, Learning, and Assessment 5(1) (2006)
Williams, R., Dreher, H.: Automatically grading essays with Markit©. Journal of Issues in Informing Science and Information Technology 1, 693–700 (2004)
Futagi, Y.: The effects of learner errors on the development of a collocation detection tool. In: Fourth Workshop on Analytics for Noisy Unstructured Text Data, pp. 27–34. ACM, Toronto (2010)
Department of Education: Narrative Marking Guide 2010, National Assessment Program-Literacy and Numeracy. Government of Western Australia (2010)
Dillon, T.S., Niebur, D.: Neural networks applications in power systems. CRL Publishing Ltd., Market Harborough, UK (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fazal, A., Dillon, T., Chang, E. (2011). Noise Reduction in Essay Datasets for Automated Essay Grading. In: Meersman, R., Dillon, T., Herrero, P. (eds) On the Move to Meaningful Internet Systems: OTM 2011 Workshops. OTM 2011. Lecture Notes in Computer Science, vol 7046. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25126-9_60
Download citation
DOI: https://doi.org/10.1007/978-3-642-25126-9_60
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25125-2
Online ISBN: 978-3-642-25126-9
eBook Packages: Computer ScienceComputer Science (R0)