Skip to main content
Springer Nature Link
Log in

Tailoring the Interpretation of Spatial Utterances for Playing a Board Game

  • Conference paper
Artificial Intelligence: Methodology, Systems, and Applications (AIMSA 2008)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5253))

  • 1020 Accesses

Abstract

In order to build an intelligent system that allows human beings to cooperate with a computing machine to perform a given task it is important to account for the individual characteristics of each user. In this work, we describe a flexible and adaptive user interface that is capable of interpreting spatial linguistic expressions according to the peculiar preferences and use of language of the user. As a proof of concept, we have implemented a graphics board game in which players can move, remove and spatially manipulate in 2D various game pieces on the computer screen by issuing speech commands during a dialogue session with the application. After an initial guided interaction, the system analyzes on the fly subjective interpretations of several linguistic relationships that form the basis for spatial expressions to tune a set of system’s parameters. We tested the system with different human subjects. Automatic judgment of spatial expressions based on each user’s interaction behavior over-performed sentence interpretation of a model that we previously created to tailor the characteristics of some abstract typical player. Post interaction informal talks also indicated a higher level of user satisfaction in subjects playing with the customized application rather than the more general one.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Ardito, C., Pederson, T., Costabile, M.F.: CHAT - Towards a General-purpose Infrastructure for Multimodal Situation-adaptive User Assistance. In: Proc. ACM MobileHCI Workshop on Modelling and Designing User Assistance in Intelligent Envs, Espoo, Finland (2006)

    Google Scholar 

  2. Benyon, D.R.: Accommodating Individual Differences through an Adaptive User Interface. In: Schneider-Hufschmidt, M., Kühme, T., Malinowski, U. (eds.) Adaptive User Interfaces - Results and Prospects. Elsevier Science Publications, Amsterdam (1993)

    Google Scholar 

  3. Celentano, A., Gaggi, O.: Context-aware Design of Adaptable Multimodal Documents. Multimedia Tools Applications 29(1), 7–28 (2006)

    Article  Google Scholar 

  4. Corradini, A.: A Computational Model for Spatial Expression Resolution. In: Proceedings of the Ninth International Conference on Multimodal Interfaces, Nagoya, Japan, pp. 67–70 (2007)

    Google Scholar 

  5. Corradini, A., Samuelsson, C.: A Generic Spoken Dialogue Manager Applied to an Interactive 2D Game. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds.) PIT 2008. LNCS (LNAI), vol. 5078, pp. 3–13. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. De Bra, P., Brusilovsky, P., Houben, G.J.: Adaptive Hypermedia: From Systems to Framework. ACM Computing Surveys 31, 1–6 (1999)

    Google Scholar 

  7. Dey, A.K.: Understanding and Using Context. Personal Ubiquitous Computing 5(1), 4–7 (2001)

    Article  Google Scholar 

  8. Dusan, S., Flanagan, J.: Adaptive Dialog Based upon Multimodal Language Acquisition. In: Proceedings of the Fourth IEEE International Conference on Multimodal Interfaces, Pittsburgh, PA, USA, pp. 135–140 (2002)

    Google Scholar 

  9. Fink, J., Kobsa, A., Nill, A.: Adaptable and Adaptive Information Provision for All Users, including Disabled and Elderly People. The New Review of Hypermedia e Multimedia 4, 163–188 (1998)

    Article  Google Scholar 

  10. Fischer, G.: User Modeling in Human-Computer Interaction. In: User Modeling and User-Adapted Interaction, vol. 11, pp. 65–86. Kluwer Academic Publishers, Dordrecht (2001)

    Google Scholar 

  11. Gavalda, M., Waibel, A.: Growing Semantic Grammars. In: Proceedings of the ACL International Conference on Computational Linguistics, Montreal, Canada (1998)

    Google Scholar 

  12. Gorin, A.L., Riccardi, G., Wright, J.H.: How I Help You? Speech Communication. Speech Communication 23, 113–127 (1997)

    Article  Google Scholar 

  13. Harter, A., Hopper, A., Steggles, P., Ward, A., Webster, P.: The Anatomy of a Context-aware Application. In: Proceedings of the 5th Annual ACM/IEEE International Conference on Mobile Computing and Networking, Seattle, WA, USA, pp. 59–68 (1999)

    Google Scholar 

  14. Horvitz, E., Breese, J., Heckerman, D., Hovel, D., Rommelse, K.: The Lumiere Project: Bayesian User Modeling for Inferring the Goals and the Needs of Software Users. In: Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence, Madison, WI, USA, pp. 256–265 (1998)

    Google Scholar 

  15. Horvitz, E.: Users are Individuals: Individualizing User Models. In: Proceedings of the ACM CHI, Pittsburgh, PA, USA, pp. 159–166 (1999)

    Google Scholar 

  16. Johnston, M., Bangalore, S., Vasireddy, G., Stent, A., Ehlen, P., Walker, M., Whittaker, S., Maloor, P.: MATCH: An Architecture for Multimodal Dialogue Systems. In: Proc. of Annual Meeting of Association for Computational Linguistics, Philadelphia, PA, USA (2002)

    Google Scholar 

  17. Kaiser, E.: Using redundant speech and handwriting for learning new vocabulary and understanding abbreviations. In: Proceedings of the International Conference on Multimodal Interfaces, Banff, Alberta, Canada, pp. 347–356 (2006)

    Google Scholar 

  18. Kobsa, A.: Generic User Modeling Systems. In: User Modeling and User-Adapted Interaction, pp. 49–63. Kluwer Academic Publishers, Dordrecht (2001)

    Google Scholar 

  19. Kobsa, A., Wahlster, W.: User Models in Dialog Systems. Springer, New York (1989)

    MATH  Google Scholar 

  20. Natarajan, P., Prasad, R., Suhm, B., McCarthy, D.: Speech Enabled Natural Language Call Routing: BBN Call Director. In: Proceedings of the International Conference on Spoken Language Processing, Denver, CO, USA (2002)

    Google Scholar 

  21. Oviatt, S.L., Darrell, T., Flickner, M.: Multimodal Interfaces that Flex, Adapt, and Persist. Communications of the ACM, 30–33 (2004)

    Google Scholar 

  22. Pieraccini, R., Lubensky, D.: Spoken Language Communication with Machines: The Long and Winding Road from Research to Business. In: Proceedings of the 18th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, Bari, Italy, pp. 6–15 (2005)

    Google Scholar 

  23. Panttaja, E., Reitter, D., Cummins, F.: The evaluation of adaptable multimodal system outputs. In: Proceedings of the DUMAS Workshop on Robust and Adaptive Information Processing for Mobile Speech Interfaces (2004)

    Google Scholar 

  24. Rich, E.: Principles of Mixed-Initiative User Interfaces. International Journal of Man-Machine Sciences 18, 199–214 (1981)

    Article  Google Scholar 

  25. Schmidt, A., Beigl, M., Gellersen, H.-W.: There is more to Context than Location. Computers and Graphics 23(6), 893–901 (1999)

    Article  Google Scholar 

  26. Stent, A., Walker, M., Whittaker, S., Maloor, P.: User-Tailored Generation for Spoken Dialogue: An Experiment. In: Proceedings of International Conference on Spoken Language Processing, Denver, CO, USA, pp. 1281–1284 (2002)

    Google Scholar 

  27. Strik, H., Russel, A., van den Heuvel, H., Cucchiarini, C., Boves, L.: A Spoken Dialogue System for the Dutch Public Transport Information Service. International Journal on Speech Technology 2(2), 119–129 (1997)

    Google Scholar 

  28. Walker, M., Rudnicky, A., Prasad, R., Aberdeen, J., Bratt, E., Garofolo, J., Hastie, H., Le, A., Pellom, B., Potamianos, A., Passonneau, R., Roukos, S., Sanders, G., Seneff, S., Stallard, D.: Darpa Communicator: Cross-system Results for the 2001. In: Proceedings of the International Conference on Spoken Language Processing, Denver, CO, USA (2002)

    Google Scholar 

  29. Walker, W., Lamere, P., Kwok, P.: FreeTTS – A Performance Case Study. Technical Report SMLI TR-2002-114, Sun Microsystems Inc. (2002)

    Google Scholar 

  30. Walker, W., Lamere, P., Kwok, P., Raj, B., Singh, R., Gouvea, E., Wolf, P., Woelfel, J.: Sphinx-4: A Flexible Open Source Framework for Speech Recognition. Technical Report SMLI TR-2004-0811, Sun Microsystems Inc. (2004)

    Google Scholar 

  31. Webb, G.I., Pazzani, M.J., Billsus, D.: Machine Learning for User Modeling. In: User Modeling and User-Adapted Interaction, vol. 11, pp. 19–29. Kluwer Academic Pubs., Dordrecht (2001)

    Google Scholar 

  32. Zukerman, I., Litman, D.: Natural Language Processing and User Modeling: Synergies and Limitations. User Modeling and User-Adapted Interaction 11(1-2), 129–158 (2001)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Business Communication and Information Science, University of Southern Denmark, 6000, Kolding, Denmark

    Andrea Corradini

Authors
  1. Andrea Corradini
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Danail Dochev Marco Pistore Paolo Traverso

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Corradini, A. (2008). Tailoring the Interpretation of Spatial Utterances for Playing a Board Game. In: Dochev, D., Pistore, M., Traverso, P. (eds) Artificial Intelligence: Methodology, Systems, and Applications. AIMSA 2008. Lecture Notes in Computer Science(), vol 5253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85776-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85776-1_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85775-4

  • Online ISBN: 978-3-540-85776-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics