Abstract
Although writing is an integral part of education, there is limited knowledge on how assigned topics influence writing quality both in terms of micro-level linguistic features and macro-level subjective evaluations by human judges. We addressed this question by conducting a study in which 44 students wrote short essays on three different topics: traditional academic-based topics such as the ones used in standardized tests, personal emotional experiences, and socially charged topics. The essays were automatically scored on five linguistic dimensions (narrativity, situation model cohesion, referential cohesion, syntactic complexity, and word abstractness). They were also manually scored by human judges based on a rubric focusing on macro-level dimensions (i.e., introduction, thesis, and conclusion). The results indicated that topic-related differences were observed on both the rubric-based and linguistic assessments, although there were weak relationships between these two measures.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beers, S.F., Nagy, W.: Syntactic Complexity as a Predictor of Adolescent Writing Quality: Which Measures? Which Genre? Reading and Writing: An Interdisciplinary Journal 22, 185–200 (2009)
Graesser, A.C., McNamara, D.S., Louwerse, M.M., Cai, Z.: Coh-Metrix: Analysis of Text on Cohesion and Language. Behavior Research Methods, Instruments, and Computers 36, 193–202 (2004)
McNamara, D.S., Crossley, S.A., McCarthy, P.M.: Linguistic Features of Writing Quality. Written Communication 27, 57–86 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dowell, N., D’Mello, S.K., Mills, C., Graesser, A. (2011). Does Topic Matter? Topic Influences on Linguistic and Rubric-Based Evaluation of Writing. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds) Artificial Intelligence in Education. AIED 2011. Lecture Notes in Computer Science(), vol 6738. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21869-9_66
Download citation
DOI: https://doi.org/10.1007/978-3-642-21869-9_66
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21868-2
Online ISBN: 978-3-642-21869-9
eBook Packages: Computer ScienceComputer Science (R0)