Skip to main content
Springer Nature Link
Log in

Automated Generation of Plausible Agent Object Interactions

  • Conference paper
  • First Online:
Intelligent Virtual Agents (IVA 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9238))

Included in the following conference series:

  • 2148 Accesses

Abstract

To interact in a virtual environment, an agent must be aware of its available actions and the objects that can participate in these actions. Work such as Kallmann’s SmartObjects allows for this information to be encoded by a simulation author, but these encodings tend to be constrained to individual graphical models. Furthermore, there may not be agreement on the proper operational information between simulation authors. To create consistent object operational information, we have devised a method that uses natural language lexical databases to parse and assemble this information. The method uses a two step process: 1. The names of motion clips are disambiguated using their name and a list of keywords; 2. Objects are connected to the actions by resolving the operational elements of a given verb. This method is tested on several common, publicly available action sets and the accuracy and coverage of our method are measured.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Also found online at http://wordnet.princeton.edu.

  2. 2.

    Also found online at https://framenet.icsi.berkeley.edu.

  3. 3.

    The definition and synonym lists can be seen in the additional materials.

  4. 4.

    The list of leaf objects can be seen in the additional materials.

  5. 5.

    The full example along with others can be found in the accompanying video.

References

  1. Baker, C.F., Fillmore, C.J., Lowe, J.B.: The Berkeley FrameNet project. In: Proceedings of the 17th International Conference on Computational Linguistics - COLING 1998, vol. 1, pp. 86–90. Association for Computational Linguistics, Stroudsburg (1998). http://dx.doi.org/10.3115/980451.980860

  2. Botvinick, M.M., Niv, Y., Barto, A.C.: Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective. Cognition 113(3), 262–280 (2008)

    Article  Google Scholar 

  3. Donikian, S., Paris, S.: Towards embodied and situated virtual humans. In: Egges, A., Kamphuis, A., Overmars, M. (eds.) MIG 2008. LNCS, vol. 5277, pp. 51–62. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Fernández, C., Baiget, P., Roca, F.X., Gonzílez, J.: Augmenting video surveillance footage with virtual agents for incremental event evaluation. Pattern Recogn. Lett. 32(6), 878–889 (2011). http://dx.doi.org/10.1016/j.patrec.2010.09.027

    Article  Google Scholar 

  5. Flotyski, J., Walczak, K.: Conceptual knowledge-based modeling of interactive 3d content. Vis. Comput., 1–20 (2014)

    Google Scholar 

  6. Gibson, J.: Perceiving, acting and knowing. In: The Theory of Affordances. Lawrence Erlbaum (1977)

    Google Scholar 

  7. Guerra-Filho, G., Biswas, A.: The human motion database: a cognitive and parametric sampling of human motion. Image Vis. Comput. 30, 251–261 (2012)

    Article  Google Scholar 

  8. Heckel, F.W.P., Youngblood, G.M.: Contextual affordances for intelligent virtual characters. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS, vol. 6895, pp. 202–208. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  9. Kallmann, M., Thalmann, D.: Direct 3d interaction with smart objects. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 1999, pp. 124–130. ACM, New York (1999). http://doi.acm.org/10.1145/323663.323683

  10. US Bureau of Labor Statistics, B.: American time use survey. Technical report (2010). http://www.bls.gov/news.release/atus.nr0.htm

  11. Laparra, E., Rigau, G.: Integrating wordnet and framenet using a knowledge-based word sense disambiguation algorithm. In: Proceedings of the International Conference RANLP-2009, pp. 208–213. Association for Computational Linguistics, Borovets, September 2009. http://www.aclweb.org/anthology/R09-1039

  12. Lugrin, J.L., Cavazza, M.: Making sense of virtual environments: action representation, grounding and common sense. In: Proceedings of the 12th International Conference on Intelligent User Interfaces, IUI 2007, pp. 225–234. ACM, New York (2007). http://doi.acm.org/10.1145/1216295.1216336

  13. Navigli, R.: Word sense disambiguation: a survey. ACM Comput. Surv. 41(2), 10:1–10:69 (2009)

    Article  Google Scholar 

  14. van Oijen, J., Dignum, F.: Scalable perception for bdi-agents embodied in virtual environments. In: IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), 2011, vol. 2, pp. 46–53, August 2011

    Google Scholar 

  15. Pelkey, C., Allbeck, J.M.: Populating virtual semantic environments. Comput. Anim. Virtual Worlds 24(3), 405–414 (2014)

    Google Scholar 

  16. Peters, C., Dobbyn, S., MacNamee, B., O’Sullivan, C.: Smart objects for attentive agents. In: Proceedings of 11th International Conference in Central Europe on Computer Graphics (2003)

    Google Scholar 

  17. Sequeira, P., Vala, M., Paiva, A.: What can i do with this?: Finding possible interactions between characters and objects. In: Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2007, pp. 5:1–5:7. ACM, New York (2007). http://doi.acm.org/10.1145/1329125.1329132

  18. Shi, L., Mihalcea, R.F.: Putting pieces together: combining FrameNet, VerbNet and WordNet for robust semantic parsing. In: Gelbukh, A. (ed.) CICLing 2005. LNCS, vol. 3406, pp. 100–111. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  19. Thiebaux, M., Marsella, S., Marshall, A.N., Kallmann, M.: Smartbody: behavior realization for embodied conversational agents. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008, vol. 1, pp. 151–158. International Foundation for Autonomous Agents and Multiagent Systems, Richland (2008). http://dl.acm.org/citation.cfm?id=1402383.1402409

  20. Princeton University: About wordnet. Technical report, Princeton University (2010). http://wordnet.princeton.edu

  21. Wu, Z., Palmer, M.: Verbs semantics and lexical selection. In: Proceedings of the 32nd Annual Meeting on Association for Computational Linguistics, ACL 1994, pp. 133–138. Association for Computational Linguistics, Stroudsburg (1994). http://dx.doi.org/10.3115/981732.981751

Download references

Acknowledgments

This work was partially supported by a grant from the U.S. Army Night Vision and Electronic Sensor Directorate (W15P7T-06-D-E402) and software licenses from Autodesk. We would also like to acknowledge Shib Duman for the creation of 3D models used in our examples and John Mooney and Jessica Randall for their contributions in refining the presentation of this research.

Author information

Authors and Affiliations

  1. Laboratory for Games and Intelligent Agents, George Mason University, 4400 University Drive, MSN 4A5, Fairfax, VA, 22030, USA

    Tim Balint & Jan M. Allbeck

Authors
  1. Tim Balint
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jan M. Allbeck
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jan M. Allbeck .

Editor information

Editors and Affiliations

  1. Delft University of Technology, Delft, The Netherlands

    Willem-Paul Brinkman

  2. Delft University of Technology, Delft, The Netherlands

    Joost Broekens

  3. University of Twente, Enschede, The Netherlands

    Dirk Heylen

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Balint, T., Allbeck, J.M. (2015). Automated Generation of Plausible Agent Object Interactions. In: Brinkman, WP., Broekens, J., Heylen, D. (eds) Intelligent Virtual Agents. IVA 2015. Lecture Notes in Computer Science(), vol 9238. Springer, Cham. https://doi.org/10.1007/978-3-319-21996-7_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-21996-7_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-21995-0

  • Online ISBN: 978-3-319-21996-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics