Skip to main content

Generalizability of Goal Recognition Models in Narrative-Centered Learning Environments

  • Conference paper
User Modeling, Adaptation, and Personalization (UMAP 2014)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8538))

Abstract

Recent years have seen growing interest in automated goal recognition. In user-adaptive systems, goal recognition is the problem of recognizing a user’s goals by observing the actions the user performs. Models of goal recognition can support student learning in intelligent tutoring systems, enhance communication efficiency in dialogue systems, or dynamically adapt software to users’ interests. In this paper, we describe an approach to goal recognition that leverages Markov Logic Networks (MLNs)—a machine learning framework that combines probabilistic inference with first-order logical reasoning—to encode relations between problem-solving goals and discovery events, domain-specific representations of user progress in narrative-centered learning environments. We investigate the impact of discovery event representations on goal recognition accuracy and efficiency. We also investigate the generalizability of discovery event-based goal recognition models across two corpora from students interacting with two distinct narrative-centered learning environments. Empirical results indicate that discovery event-based models outperform previous state-of-the-art approaches on both corpora.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gal, Y., Reddy, S., Shieber, S.M., Rubin, A., Grosz, B.J.: Plan Recognition in Exploratory Domains. Artif. Intell. 176, 2270–2290 (2012)

    Article  MathSciNet  Google Scholar 

  2. Blaylock, N., Allen, J.: Hierarchical Instantiated Goal Recognition. In: Kaminka, G., Pynadath, D.V., Geib, C.W. (eds.) Proceedings of the Workshop on Modeling Others from Observations, pp. 8–15. AAAI Press, Menlo Park (2006)

    Google Scholar 

  3. Gold, K.: Training Goal Recognition Online from Low-Level Inputs in an Action-Adventure Game. In: Youngblood, G.M., Bulitko, V. (eds.) Proceedings of the Sixth Conference on Artificial Intelligence in Interactive Digital Entertainment, pp. 21–26. AAAI Press, Menlo Park (2010)

    Google Scholar 

  4. Kabanza, F., Bellefeuille, P., Bisson, F., Benaskeur, A.R., Irandoust, H.: Opponent Behaviour Recognition for Real-Time Strategy Games. In: Sukthankar, G., Geib, C.W., Pynadath, D.V., Bui, H.H. (eds.) Proceedings of the Workshop on Plan, Activity, and Intent Recognition, pp. 29–36. AAAI Press, Menlo Park (2010)

    Google Scholar 

  5. Rowe, J.P., Shores, L.R., Mott, B.W., Lester, J.C.: Integrating Learning, Problem Solving, and Engagement in Narrative-Centered Learning Environments. Int. J. Artif. Intell. Educ. 21, 115–133 (2011)

    Google Scholar 

  6. Thomas, J.M., Young, R.M.: Annie: Automated Generation of Adaptive Learner Guidence for Fun Serious Games. IEEE Trans. Learn. Technol. 3, 329–343 (2010)

    Article  Google Scholar 

  7. Domingos, P., Kok, S., Poon, H., Richardson, M., Singla, P.: Unifying Logical and Statistical AI. In: Gil, Y., Mooney, R.J. (eds.) Proceedings of the Twenty-First National Conference on Artificial Intelligence, pp. 2–7. AAAI Press, Menlo Park (2006)

    Google Scholar 

  8. Kautz, H.A., Allen, J.F.: Generalized Plan Recognition. In: Kehler, T. (ed.) Proceedings of the Fifth National Conference on Artificial Intelligence, pp. 32–37. Morgan Kaufmann, San Francisco (1986)

    Google Scholar 

  9. Ng, H.T., Mooney, R.J.: Abductive Plan Recognition and Diagnosis: A Comprehensive Empirical Evaluation. In: Third International Conference on Principles of Knowledge Representation and Reasoning, Cambridge, MA, pp. 499–508 (1992)

    Google Scholar 

  10. Geib, C.W., Goldman, R.P.: A Probabilistic Plan Recognition Algorithm Based on Plan Tree Grammars. Artif. Intell. 173, 1101–1132 (2009)

    Article  MathSciNet  Google Scholar 

  11. Charniak, E., Goldman, R.P.: A Bayesian Model of Plan Recognition (1993)

    Google Scholar 

  12. Pynadath, D.V., Wellman, M.P.: Probabilistic State-Dependent Grammars for Plan Recognition. In: Boutilier, C., Goldszmidt, M. (eds.) Proceedings of the Sixteenth Conference on Uncertainty in Artificial Intelligence, pp. 507–514. IUAI Press, Corvallis (2000)

    Google Scholar 

  13. Geib, C.W.: Delaying Commitment in Plan Recognition Using Combinatory Categorial Grammars. In: Boutilier, C. (ed.) Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, pp. 1702–1707. AAAI Press, Menlo Park (2009)

    Google Scholar 

  14. Wu, T., Lian, C., Hsu, J.Y.: Joint Recognition of Multiple Concurrent Activities using Factorial Conditional Random Fields. In: Pynadath, D.V., Geib, C.W. (eds.) Proceedings of the Workshop on Plan, Activity, and Intent Recognition, pp. 82–88. AAAI Press, Menlo Park (2007)

    Google Scholar 

  15. Sadilek, A., Kautz, H.: Location-Based Reasoning about Complex Multi-Agent Behavior. J. Artif. Intell. Res. 43, 87–133 (2012)

    MATH  MathSciNet  Google Scholar 

  16. Carberry, S.: Techniques for Plan Recognition. User Model. User-adapt. Interact. 11, 31–48 (2001)

    Article  MATH  Google Scholar 

  17. Albrecht, D.W., Zukerman, I., Nicholson, A.E., Bud, A.: Towards a Bayesian Model for Keyhole Plan Recognition in Large Domains. In: Jameson, A., Paris, C., Tasso, C. (eds.) Proceedings of the Sixth International Conference on User Modeling, pp. 365–376. Springer, New York (1997)

    Google Scholar 

  18. Laviers, K., Sukthankar, G.: A Real-Time Opponent Modeling System for Rush Football. In: Walsh, T. (ed.) Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, pp. 2476–2481. AAAI Press, Menlo Park (2011)

    Google Scholar 

  19. Singla, P., Mooney, R.J.: Abductive Markov Logic for Plan Recognition. In: Burgard, W., Roth, D. (eds.) Twenty-Fifth National Conference on Artificial Intelligence, pp. 1069–1075. AAAI Press, Menlo Park (2011)

    Google Scholar 

  20. Ha, E.Y., Rowe, J.P., Mott, B.W., Lester, J.C.: Goal Recognition with Markov Logic Networks for Player-Adaptive Games. In: Bulitko, V., Riedl, M.O. (eds.) Proceedings of the Seventh Conference on Artificial Intelligence in Interactive Digital Entertainment, pp. 32–39. AAAI Press, Menlo Park (2011)

    Google Scholar 

  21. Baikadi, A., Rowe, J.P., Mott, B.W., Lester, J.C.: Improving Goal Recognition in Interactive Narratives with Models of Narrative Discovery Events. In: Si, M., Cavazza, M., Zook, A. (eds.) Proceedings of the Sixth Workshop on Intelligent Narrative Technologies, AAAI Press, Menlo Park (2013)

    Google Scholar 

  22. Riedel, S.: Improving the Accuracy and Efficiency of MAP Inference for Markov Logic. In: McAllester, D.A., Myllymäki, P. (eds.) Proceedings of the Twenty-Fourth Annual Conference on Uncertainty in Artificial Intelligence, pp. 468–475. IUAI Press, Corvallis (2008)

    Google Scholar 

  23. Lester, J.C., Spires, H.A., Nietfeld, J.L., Minogue, J., Mott, B.W., Lobene, E.V.: Designing Game-Based Learning Environments for Elementary Science Education: A Narrative-Centered Learning Perspective. Information Sciences 264, 4–18 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Baikadi, A., Rowe, J., Mott, B., Lester, J. (2014). Generalizability of Goal Recognition Models in Narrative-Centered Learning Environments. In: Dimitrova, V., Kuflik, T., Chin, D., Ricci, F., Dolog, P., Houben, GJ. (eds) User Modeling, Adaptation, and Personalization. UMAP 2014. Lecture Notes in Computer Science, vol 8538. Springer, Cham. https://doi.org/10.1007/978-3-319-08786-3_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08786-3_24

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08785-6

  • Online ISBN: 978-3-319-08786-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics