ABSTRACT
This paper proposes to use dialogue systems to assess language learners' productive vocabulary. We introduce a new task where dialogue systems try to induce learners to use specific words during a natural conversation to assess their productive vocabulary. To investigate the feasibility of the dialogue systems that are capable of this task, we performed two kinds of experiments.
- Laura K Allen and Danielle S McNamara. 2015. You Are Your Words: Modeling Students' Vocabulary Knowledge with Natural Language Processing Tools. International Educational Data Mining Society (2015).Google Scholar
- Jonathan C Brown, Gwen A Frishkoff, and Maxine Eskenazi. 2005. Automatic question generation for vocabulary assessment. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 819--826.Google ScholarDigital Library
- Keelan Evanini, Sandeep Singh, Anastassia Loukina, Xinhao Wang, and Chong Min Lee. 2015. Content-based automated assessment of non-native spoken language proficiency in a simulated conversation. In NIPS Workshop on Machine Learning for Spoken Language Understanding and Interaction .Google Scholar
- Luke Fryer and Rollo Carpenter. 2006. Emerging Technologies. Language Learning & Technology , Vol. 10, 3 (2006), 8--14.Google Scholar
- Itsuko Fujimura, Shoju Chiba, and Mieko Ohso. 2012. Lexical and grammatical features of spoken and written Japanese in contrast: Exploring a lexical profiling approach to comparing spoken and written corpora. In Proceedings of the VIIth GSCP International Conference. Speech and Corpora. 393--398.Google Scholar
- Michael Heilman and Maxine Eskenazi. 2007. Application of automatic thesaurus extraction for computer generation of vocabulary questions. In Workshop on Speech and Language Technology in Education .Google Scholar
- Jin-Xia Huang, Kyung-Soon Lee, Oh-Woog Kwon, and Young-Kil Kim. 2017. A chatbot for a dialogue-based second language learning system. CALL in a climate of change: adapting to turbulent global conditions (2017), 151.Google Scholar
- Stephen D Krashen and Tracy D Terrell. 1983. The natural approach: Language acquisition in the classroom .Alemany Press.Google Scholar
- Batia Laufer and Zahava Goldstein. 2004. Testing vocabulary knowledge: Size, strength, and computer adaptiveness. Language learning , Vol. 54, 3 (2004), 399--436.Google Scholar
- Batia Laufer and Paul Nation. 1995. Vocabulary size and use: Lexical richness in L2 written production. Applied linguistics , Vol. 16, 3 (1995), 307--322.Google Scholar
- Batia Laufer and Paul Nation. 1999. A vocabulary-size test of controlled productive ability. Language testing , Vol. 16, 1 (1999), 33--51.Google Scholar
- Akira Matsumura. 2006. Daijirin .Sanseidô.Google Scholar
- Paul Meara and Tess Fitzpatrick. 2000. Lex30: An improved method of assessing productive vocabulary in an L2. System , Vol. 28, 1 (2000), 19--30.Google ScholarCross Ref
- John Morton. 1979. Word recognition. Psycholinguistics: Series 2. Structures and processes (1979), 107--156.Google Scholar
- David Suendermann-Oeft, Vikram Ramanarayanan, Zhou Yu, Yao Qian, Keelan Evanini, Patrick Lange, Xinhao Wang, and Klaus Zechner. 2017. A Multimodal Dialog System for Language Assessment: Current State and Future Directions. ETS Research Report Series , Vol. 2017, 1 (2017), 1--7.Google ScholarCross Ref
- Wen-Ta Tseng. 2016. Measuring English vocabulary size via computerized adaptive testing. Computers & Education , Vol. 97 (2016), 69--85.Google ScholarDigital Library
- Stuart Webb. 2008. Receptive and productive vocabulary sizes of L2 learners. Studies in Second language acquisition , Vol. 30, 1 (2008), 79--95.Google Scholar
Index Terms
- Dialogue Systems for the Assessment of Language Learners' Productive Vocabulary
Recommendations
A corpus augmentation approach for improving the performance of dialogue systems in the Greek language
SETN 2020: 11th Hellenic Conference on Artificial IntelligenceOne of the main challenges in dialogue systems is their efficiency when trained with small corpora. Although this problem has been solved for dialogue systems in the English language, as there are many corpora available in the literature, there are ...
From vocal to multimodal dialogue management
ICMI '06: Proceedings of the 8th international conference on Multimodal interfacesMultimodal, speech-enabled systems pose different research problems when compared to unimodal, voice-only dialogue systems. One of the important issues is the question of how a multimodal interface should look like in order to make the multimodal ...
Can machines talk? Comparison of Eliza with modern dialogue systems
To find if current dialogue systems use the same, psychotherapist questioning technique as Joseph Weizenbaum's 1960 natural language understanding programme, Eliza, the authors carried out an original experiment comparing five successful artificial ...
Comments