Skip to main content
SpringerLink
Log in

Predicting Human Scores of Essay Quality Using Computational Indices of Linguistic and Textual Features

  • Conference paper
Artificial Intelligence in Education (AIED 2011)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6738))

Included in the following conference series:

Abstract

This study assesses the potential for computational indices to predict human ratings of essay quality. The results demonstrate that linguistic indices related to type counts, given/new information, personal pronouns, word frequency, conclusion n-grams, and verb forms predict 43% of the variance in human scores of essay quality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abbott, R., Berninger, V., Fayol, M.: Longitudinal relationships of levels of language in writing and between writing and reading in grades 1 to 7. Journal of Educational Psychology 102, 281–298 (2002)

    Article  Google Scholar 

  2. Berninger, V., Mizoka, D., Bragg, R.: Theory-based diagnosis and remediation of writing disabilities. Journal of School Psychology 29, 57–79 (1991)

    Article  Google Scholar 

  3. McNamara, D.S., Crossley, S.A., McCarthy, P.M.: Linguistic features of writing quality. Written Communication 27, 57–86 (2010)

    Article  Google Scholar 

  4. Graesser, A.C., McNamara, D.S., Louwerse, M.M., Cai, Z.: Coh-Metrix: Analysis of text on cohesion and language. Behavioral Research Methods, Instruments, and Computers 36, 193–202 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Applied Linguistics, Georgia State University, 34 Peachtree St. Suite 1200, One Park Tower Building, Atlanta, GA, 30303, USA

    Scott A. Crossley

  2. Institute for Intelligent Systems, The University of Memphis, FedEx Institute of Technology, Memphis, TN, 38152, USA

    Rod Roscoe & Danielle S. McNamara

Authors
  1. Scott A. Crossley
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rod Roscoe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Danielle S. McNamara
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. EECS Department/ISIS, Vanderbilt University, TN 37235, Nashville, USA

    Gautam Biswas

  2. Electronic, Electrical and Computer Engineering, University of Birmingham, U.K.

    Susan Bull

  3. School of Information Technologies, University of Sydney, 1 Cleveland Street, 2006, Sydney, Australia

    Judy Kay

  4. College of Engineering, Department of Computer Science and Software Engineering, University of Canterbury, Private Bag 4800, 8140, Christchurch, New Zealand

    Antonija Mitrovic

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Crossley, S.A., Roscoe, R., McNamara, D.S. (2011). Predicting Human Scores of Essay Quality Using Computational Indices of Linguistic and Textual Features. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds) Artificial Intelligence in Education. AIED 2011. Lecture Notes in Computer Science(), vol 6738. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21869-9_62

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-21869-9_62

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-21868-2

  • Online ISBN: 978-3-642-21869-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation