Skip to main content

A Method for Transferring Probabilistic User Models between Environments

  • Conference paper
Interactive Storytelling (ICIDS 2011)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7069))

Included in the following conference series:

  • 3942 Accesses

Abstract

Chief among the inputs to decision making algorithms in narrative or game environments is a model of player or opponent decision making. A challenge that will always face designers is to specify that model ahead of time, when actual data from the environment is likely not to be available. Absent corpora of data, designers must intuit these models as best they can, incorporating domain or expert knowledge when available. To make this process more precise, we derive a theoretically grounded technique to transfer an observed user model from one domain to another. We answer the question: “How can a model obtained from observations of one environment inform a model for another environment?” We verify the accuracy of our techniques using data from previous user studies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bates, J.: Virtual Reality, Art, and Entertainment. Presence: The Journal of Teleoperators and Virtual Environments 2, 133–138 (1992)

    Article  Google Scholar 

  2. Cialdini, R.B.: Influence: The Psychology of Persuasion. Collins (1998)

    Google Scholar 

  3. Falmagne, J.C.: Foundations of Fechnerian Psychophysics. In: Krantz, D.H., Atkinson, R.C., Luce, R.D., Suppes, P. (eds.) Contemporary Developments in Mathematical Psychology. Freeman (1974)

    Google Scholar 

  4. Folkes, V.S., Martin, I.M., Gupta, K.: When to Say When: Effects of Supply on Usage. Journal of Consumer Research 20, 467–477 (1993)

    Article  Google Scholar 

  5. Guilford, J.P.: Psychometric Methods, 2nd edn. Macmillan (1954)

    Google Scholar 

  6. Johnson, E.J., Bellman, S., Lohse, G.: Defaults, framing and privacy: Why opting in ≠ opting out. Marketing Letters 13(1), 5–15 (2002)

    Article  Google Scholar 

  7. Laurel, B.: Toward the Design of a Computer-Based Interactive Fantasy System. Ph.D. thesis, Drama department, Ohio State University (1986)

    Google Scholar 

  8. Luce, R.D.: Individual Choice Behavior. Wiley (1959)

    Google Scholar 

  9. Luce, R.D., Galanter, E.: Discrimination. In: Luce, R.D., Bush, R.R., Galanter, E. (eds.) Handbook of Mathematical Psychology, vol. 1, pp. 191–243 (1963)

    Google Scholar 

  10. Mateas, M.: An Oz-Centric Review of Interactive Drama and Believable Agents. In: Veloso, M.M., Wooldridge, M.J. (eds.) Artificial Intelligence Today. LNCS (LNAI), vol. 1600, pp. 297–328. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  11. Nelson, M.J., Mateas, M., Roberts, D.L., Isbell, C.L.: Declarative Optimization-Based Drama Management in the Interactive Fiction Anchorhead. IEEE Computer Graphics and Applications (Special Issue on Interactive Narrative) 26(3), 30–39 (2006)

    Google Scholar 

  12. Nelson, M.J., Roberts, D.L., Isbell, C.L., Mateas, M.: Reinforcement Learning for Declarative Optimization-Based Drama Management. In: Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2006 (2006)

    Google Scholar 

  13. Regan, D.T.: Effects of a Favor and Liking on Compliance. J. of Experimental Social Psychology 7, 627–639 (1971)

    Article  Google Scholar 

  14. Roberts, D.L.: Computational Approaches for Reasoning About and Shaping Player Experiences in Interactive Narratives. Ph.D. thesis, Georgia Tech. (2010)

    Google Scholar 

  15. Roberts, D.L., Bhat, S., Clair, K.S., Isbell, C.L.: Authorial Idioms for Target Distributions in TTD-MDPs. In: Proc. of the 22nd Conf. on Artificial Intelligence, AAAI 2007 (2007)

    Google Scholar 

  16. Roberts, D.L., Furst, M.L., Isbell, C.L., Dorn, B.: Using Influence and Persuasion to Shape Player Experiences. In: 2009 Sandbox: ACM SIGGRAPH Video Game Proceedings, SIGGRAPH Sandbox (2009)

    Google Scholar 

  17. Roberts, D.L., Isbell, C.L.: A Survey and Qualitative Analysis of Recent Advances in Drama Management. International Transactions on Systems Science and Applications, Special Issue on Agent Based Systems for Human Learning 3(1), 61–75 (2008)

    Google Scholar 

  18. Roberts, D.L., Nelson, M.J., Isbell, C.L., Mateas, M., Littman, M.L.: Targeting Specific Distributions of Trajectories in MDPs. In: Proceedings of the 21st National Conference on Artificial Intelligence, AAAI 2006 (2006)

    Google Scholar 

  19. Sullivan, A., Chen, S., Mateas, M.: Integrating Drama Management into an Adventure Game. In: Proc. of the Fourth Conf. on Artificial Intelligence and Interactive Digital Entertainment (AIIDE 2008). AAAI Press (2008)

    Google Scholar 

  20. Sullivan, A., Chen, S., Mateas, M.: From Abstraction to Reality: Integrating Drama Management into a Playable Game Experience. In: Proc. of the 2009 AAAI Spring Symposium on Intelligent Narrative Technologies II (2009)

    Google Scholar 

  21. Thurstone, L.L.: A Law of Comparative Judgement. Psych. Review 34, 273–286 (1927)

    Article  Google Scholar 

  22. Thurstone, L.L.: Psychophysical Analysis. American J. of Psychology 38, 368–389 (1927)

    Article  Google Scholar 

  23. Weyhrauch, P.: Guiding Interactive Drama. Ph.D. thesis, School of Computer Science (1997)

    Google Scholar 

  24. Zermelo, E.: Die berechnung der turnier-ergebnisse als ein maximumproblem der wahrscheinlichkeitsrechnung. Mathematische Zeitschrift 29 (1929)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Roberts, D.L., Roberts, F. (2011). A Method for Transferring Probabilistic User Models between Environments. In: Si, M., Thue, D., André, E., Lester, J.C., Tanenbaum, T.J., Zammitto, V. (eds) Interactive Storytelling. ICIDS 2011. Lecture Notes in Computer Science, vol 7069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25289-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-25289-1_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-25288-4

  • Online ISBN: 978-3-642-25289-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics