skip to main content
10.1145/2666242.2666248acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

Robo fashion world: a multimodal corpus of multi-child human-computer interaction

Published: 16 November 2014 Publication History

Abstract

We present a retrospective view on our experience with small groups of more than 175 children (ages 4 to 10) playing versions of a language-based game hosted by an animated character. After describing the task, the audio-visual annotations used for modeling, and the regularities we see in the children's communicative behavior, we conclude with observations and challenges for other researchers interested in autonomous HCI and HRI with this population.

References

[1]
Andrist, S., Leite, I., and Lehman, J. 2013. In Proceedings of the 12th International Conference on Interaction Design and Children. IDC '13, ACM, 352--355.
[2]
Anguera, M., Bozonnet, S., Evans, N., Fredouille, C., Friedland, G., and Vinyals, O. 2012. Speaker diarization: A review of recent research. IEEE Transactions on Audio, Speech, and Language Processing. 20, 2 (Feb. 2012). IEEE, 356--370.
[3]
Bakx, I, van Turnhout, K., and Terken, J. 2003. Facial orientation during multi-party interaction with information kiosks. In Proceedings of IFIP TC13 International Conference on Human-Computer Interaction. Interact '03. IOS Press, 701--704.
[4]
Chang, C. and Lin, C. 2011. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technologies. 2, 3. ACM 1--27.
[5]
Fellbaum, C. 1998 (editor). WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA, USA.
[6]
Gerosa, M., Giuliani, D., Narayanan, S. and Potamianos, A. 2009. A review of ASR technologies for children's speech. In Proceedings of the 2nd Workshop on Child, Computer and Interaction. WOCCI '09. Article 7, 8 pages.
[7]
Gustafson, J. and Sjolander, K. 2002. Voice transformations for improving children's speech recognition in a publicly available dialogue system. In Proceedings of ICSLP 2002. ICSLP, 297--300.
[8]
Hajishirzi, H., Lehman, J. F., and Hodgins, J. 2012. Using group history to identify character-directed utterances in multi-child interactions. In Proceedings of the 13th Annual Meeting on Discourse and Dialogue. SIGDIAL '12. ACL, 207--216.
[9]
Leite, I., Hajishirzi, H., Andrist, S. and Lehman, J. 2013. Managing chaos: Models of turn-taking in character-multichild interactions. In Proceedings of the 15th International Conference on Multimodal Interaction. ICMI '13. ACM, 43--50.
[10]
Russell, M. and D'Arcy, S. 2007. Challenges for computer recognition of children's speech. In Proceedings of Speech and Language Technology in Education. SLaTE-2007. ISCA, 108--111.
[11]
Singh, Rita. 2004. The Sphinx Speech Recognition Systems. In The Encyclopedia of Human Computer Interaction. W. Bainbridge, Editor. Berkshire Publishing Group.

Cited By

View all
  • (2021)Automatic Speech Recognition for Indoor HRI ScenariosACM Transactions on Human-Robot Interaction10.1145/344262910:2(1-30)Online publication date: 8-Mar-2021
  • (2018)DNN-HMM based Automatic Speech Recognition for HRI ScenariosProceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3171221.3171280(150-159)Online publication date: 26-Feb-2018
  • (2017)Child Speech Recognition in Human-Robot InteractionProceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction10.1145/2909824.3020229(82-90)Online publication date: 6-Mar-2017
  • Show More Cited By

Index Terms

  1. Robo fashion world: a multimodal corpus of multi-child human-computer interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UM3I '14: Proceedings of the 2014 workshop on Understanding and Modeling Multiparty, Multimodal Interactions
    November 2014
    58 pages
    ISBN:9781450306522
    DOI:10.1145/2666242
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 November 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. addressee identification
    2. child-character dialog
    3. multimodal interaction
    4. multiparty interaction
    5. spoken dialog

    Qualifiers

    • Research-article

    Conference

    ICMI '14
    Sponsor:

    Acceptance Rates

    UM3I '14 Paper Acceptance Rate 8 of 8 submissions, 100%;
    Overall Acceptance Rate 8 of 8 submissions, 100%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)Automatic Speech Recognition for Indoor HRI ScenariosACM Transactions on Human-Robot Interaction10.1145/344262910:2(1-30)Online publication date: 8-Mar-2021
    • (2018)DNN-HMM based Automatic Speech Recognition for HRI ScenariosProceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3171221.3171280(150-159)Online publication date: 26-Feb-2018
    • (2017)Child Speech Recognition in Human-Robot InteractionProceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction10.1145/2909824.3020229(82-90)Online publication date: 6-Mar-2017
    • (2016)Turn‐Taking, Children, and the Unpredictability of FunAI Magazine10.1609/aimag.v37i4.268537:4(55-62)Online publication date: Dec-2016
    • (2015)Design and Architecture of a Robot-Child Speech-Controlled GameProceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts10.1145/2701973.2702041(79-80)Online publication date: 2-Mar-2015
    • (2015)Regulating Turn-Taking in Multi-child Spoken InteractionIntelligent Virtual Agents10.1007/978-3-319-21996-7_40(363-374)Online publication date: 1-Aug-2015

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media