skip to main content
10.1145/3349537.3352772acmconferencesArticle/Chapter ViewAbstractPublication PageshaiConference Proceedingsconference-collections
poster

Dialogue Systems for the Assessment of Language Learners' Productive Vocabulary

Published:25 September 2019Publication History

ABSTRACT

This paper proposes to use dialogue systems to assess language learners' productive vocabulary. We introduce a new task where dialogue systems try to induce learners to use specific words during a natural conversation to assess their productive vocabulary. To investigate the feasibility of the dialogue systems that are capable of this task, we performed two kinds of experiments.

References

  1. Laura K Allen and Danielle S McNamara. 2015. You Are Your Words: Modeling Students' Vocabulary Knowledge with Natural Language Processing Tools. International Educational Data Mining Society (2015).Google ScholarGoogle Scholar
  2. Jonathan C Brown, Gwen A Frishkoff, and Maxine Eskenazi. 2005. Automatic question generation for vocabulary assessment. In Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 819--826.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Keelan Evanini, Sandeep Singh, Anastassia Loukina, Xinhao Wang, and Chong Min Lee. 2015. Content-based automated assessment of non-native spoken language proficiency in a simulated conversation. In NIPS Workshop on Machine Learning for Spoken Language Understanding and Interaction .Google ScholarGoogle Scholar
  4. Luke Fryer and Rollo Carpenter. 2006. Emerging Technologies. Language Learning & Technology , Vol. 10, 3 (2006), 8--14.Google ScholarGoogle Scholar
  5. Itsuko Fujimura, Shoju Chiba, and Mieko Ohso. 2012. Lexical and grammatical features of spoken and written Japanese in contrast: Exploring a lexical profiling approach to comparing spoken and written corpora. In Proceedings of the VIIth GSCP International Conference. Speech and Corpora. 393--398.Google ScholarGoogle Scholar
  6. Michael Heilman and Maxine Eskenazi. 2007. Application of automatic thesaurus extraction for computer generation of vocabulary questions. In Workshop on Speech and Language Technology in Education .Google ScholarGoogle Scholar
  7. Jin-Xia Huang, Kyung-Soon Lee, Oh-Woog Kwon, and Young-Kil Kim. 2017. A chatbot for a dialogue-based second language learning system. CALL in a climate of change: adapting to turbulent global conditions (2017), 151.Google ScholarGoogle Scholar
  8. Stephen D Krashen and Tracy D Terrell. 1983. The natural approach: Language acquisition in the classroom .Alemany Press.Google ScholarGoogle Scholar
  9. Batia Laufer and Zahava Goldstein. 2004. Testing vocabulary knowledge: Size, strength, and computer adaptiveness. Language learning , Vol. 54, 3 (2004), 399--436.Google ScholarGoogle Scholar
  10. Batia Laufer and Paul Nation. 1995. Vocabulary size and use: Lexical richness in L2 written production. Applied linguistics , Vol. 16, 3 (1995), 307--322.Google ScholarGoogle Scholar
  11. Batia Laufer and Paul Nation. 1999. A vocabulary-size test of controlled productive ability. Language testing , Vol. 16, 1 (1999), 33--51.Google ScholarGoogle Scholar
  12. Akira Matsumura. 2006. Daijirin .Sanseidô.Google ScholarGoogle Scholar
  13. Paul Meara and Tess Fitzpatrick. 2000. Lex30: An improved method of assessing productive vocabulary in an L2. System , Vol. 28, 1 (2000), 19--30.Google ScholarGoogle ScholarCross RefCross Ref
  14. John Morton. 1979. Word recognition. Psycholinguistics: Series 2. Structures and processes (1979), 107--156.Google ScholarGoogle Scholar
  15. David Suendermann-Oeft, Vikram Ramanarayanan, Zhou Yu, Yao Qian, Keelan Evanini, Patrick Lange, Xinhao Wang, and Klaus Zechner. 2017. A Multimodal Dialog System for Language Assessment: Current State and Future Directions. ETS Research Report Series , Vol. 2017, 1 (2017), 1--7.Google ScholarGoogle ScholarCross RefCross Ref
  16. Wen-Ta Tseng. 2016. Measuring English vocabulary size via computerized adaptive testing. Computers & Education , Vol. 97 (2016), 69--85.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Stuart Webb. 2008. Receptive and productive vocabulary sizes of L2 learners. Studies in Second language acquisition , Vol. 30, 1 (2008), 79--95.Google ScholarGoogle Scholar

Index Terms

  1. Dialogue Systems for the Assessment of Language Learners' Productive Vocabulary

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        HAI '19: Proceedings of the 7th International Conference on Human-Agent Interaction
        September 2019
        341 pages
        ISBN:9781450369220
        DOI:10.1145/3349537

        Copyright © 2019 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 September 2019

        Check for updates

        Qualifiers

        • poster

        Acceptance Rates

        HAI '19 Paper Acceptance Rate25of68submissions,37%Overall Acceptance Rate121of404submissions,30%
      • Article Metrics

        • Downloads (Last 12 months)5
        • Downloads (Last 6 weeks)0

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader