Skip to main content

Automatic scoring system for short descriptive answer written in Korean using lexico-semantic pattern

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The researches on the automatic scoring system for English descriptive answers have been actively performed, but there are not so many researches on the automatic scoring system for Korean descriptive answers. In this paper, we propose an scoring method based on lexico-semantic pattern (LSP), which is known to be a good solution for the morphologically rich Korean language. In the proposed method, postposition information is utilized as an important tool for finding the meaning differences in Korean. In addition to using LSP, we also applied a synonym dictionary as a meaning extension approach to improve recall performance in scoring student’s answer. Our experimental result shows that the proposed system performs better than the existing noun-keyword-based system by 0.137. Also, the best performance could be obtained by using a synonym dictionary.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Burrows S, Gurevych I, Stein B (2015) The eras and trends of automatic short answer grading. Int J Artif Intell Educ 25(1):60–117

    Article  Google Scholar 

  • Burstein J, Chodorow M (1999) Automated essay scoring for nonnative English speakers. In: Proceeding ASSESSEVALNLP ’99 proceedings of a symposium on computer mediated language assessment and evaluation in natural language processing, pp 68–75

  • Bae B-G (2013) Automatic-scoring method for Korean free-text answer through predicate normalization. M.A. dissertation, KookMin University

  • Callear D, Jerrams-Smith J, Soh V (2001) CAA of short non-MCQ answers. In: Proceeding of the 5th international CAA conference

  • Chakrabartty S, Cauwenberghs G (2007) Gini support vector machine: quadratic entropy based robust multi-class probability regression. J Mach Learn Res 8:813–839

    MATH  Google Scholar 

  • Cho W, Oh J, Lee J, Kim Y-S (2005) An intelligent marking system based on semantic kernel and Korean WordNet. KIPS Trans Part A 12A(6):539–546

    Article  Google Scholar 

  • Clariana RB, Wallace P (2007) A computer-based approach for deriving and measuring individual and team knowledge structure from essay questions. J Educ Comput Res 37(3):211–227

    Article  Google Scholar 

  • Cruse DA (1986) Lexical semantics. Cambridge University Press, Cambridge

    Google Scholar 

  • Dobrov BV, Loukachevitch NV, Yudina TN (1997) Conceptual indexing using thematic representation of texts. In: TREC-6, pp 403–413

  • ETRI (2013) ETRI Korean phoneme converter. Speech Language Information Research Department

  • Jacobs PS, Krupka GR, Rau LF (1991) Lexico-semantic pattern matching as a companion to parsing in text understanding. In: Proceeding HLT ’91 proceedings of the workshop on speech and natural language, pp 337–341

  • Jadidinejad AH, Mahmoudi F (2014) Unsupervised short answer grading using spreading activation over an associative network of concepts. Can J Inf Library Sci 38:287–303

    Article  Google Scholar 

  • Jang ES, Kang SS, Noh EH, Kim MH, Sung KH, Seong TJ (2014) KASS: Korean automatic scoring system for short-answer questions. In: Proceedings of the 6th international conference on computer supported education: CSEDU, Barcelona, Spain, vol 2, pp 226–230

  • Kim JE, Chae JM, Jung SY (2014) Automatic scoring system based on Korean lexico-semantic pattern. Int J Appl Eng Res 9(22):14499–14510

    Google Scholar 

  • Loukachevitch NV, Dobrov BV (2002) Evaluation of thesaurus on sociopolitical life as information-retrieval tool. In: Gonzalez Rodriguez M, Paz Suarez Araujo C (eds) The third international conference on linguistic resources and evaluation (LREC-2002), Gran Canaria, Spain, vol 1

  • Valenti S, Neri F, Cucchiarelli R (2003) An overview of current research on automated essay grading. J Inf Technol Educ 2:319–330

    Google Scholar 

Download references

Acknowledgements

This research was supported by the Special Research Fund of College of Education, Korea University in 2013.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Soon-Young Jung.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interests.

Additional information

Communicated by J. Park.

Appendix: POS tag set

Appendix: POS tag set

 

Clasificar

Subclass

 

Uninflected word

Noun

Nondeclarative noun

ncn

Predicative movement noun

ncpa

Predicative state noun

ncps

Proper noun

nq

Non-measure dependent noun

nbn

Measure dependent noun

nbu

Pronoun

 

np

Rhetoric

 

nng

Predicate

Verb

 

pv

Adjective

 

pa

Auxiliary predicate

 

px

Flourish word

Determiner

General determiner

mmg

Number determiner

mmc

Adverb

General adverb

Mag

Conjunctive adverb

mac

Independence word

Exclamation

 

i

Relative word

Postposition

Subjective postposition

jcs

Prenominal postposition

jcm

Objective postposition

jco

Adverbial postposition

jca

Auxiliary postposition

Jx

Conjunctive postposition

jcj

Dependence form

Ending

Prefinal ending

ep

Final ending

ef

Connective ending

ec

Auxiliary connective ending

ecx

Noun changing ending

etn

Adjective changing ending

etm

Suffix

Noun derivation suffix

xsn

Verb derivation suffix

xsv

Adjective derivation suffix

xsm

Adverb derivation suffix

xsa

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, JE., Park, K., Chae, JM. et al. Automatic scoring system for short descriptive answer written in Korean using lexico-semantic pattern. Soft Comput 22, 4241–4249 (2018). https://doi.org/10.1007/s00500-017-2772-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-017-2772-7

Keywords