Abstract
Interactive storytelling systems are capable of producing many variants of stories. A major challenge in designing storytelling systems is the evaluation of the resulting narrative. Ideally every variant of the resulting story should be seen and evaluated, but due to combinatorial explosion of the story space, this is unfeasible in all but the smallest domains. However, the system designer still needs to have control over the generated stories and his input cannot be replaced by a computer. In this paper we propose a general methodology for semi-automatic evaluation of narrative systems based on tension curve extraction and clustering of similar stories. Our preliminary results indicate that a straightforward approach works well in simple scenarios, but for complex story spaces further improvements are necessary.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mateas, M., Stern, A.: Fac̨ade: An experiment in building a fully-realized interactive drama. In: Game Developer’s Conference: Game Design Track (2003)
McCoy, J., Treanor, M., Samuel, B.: Prom Week: social physics as gameplay. In: Proceedings of the 6th International Conference on Foundations of Digital Games, pp. 319–321 (2011)
Aylett, R., Kriegel, M., Lim, M.: ORIENT: interactive agents for stage-based role-play. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, vol. 2, pp. 1371–1372 (2009)
Endrass, B., Rehm, M., André, E.: Planning Small Talk behavior with cultural influences for multiagent systems. Computer Speech & Language 25(2), 158–174 (2011)
Aylett, R., Vala, M., Sequeira, P., Paiva, A.: FearNot! – an emergent narrative approach to virtual dramas for anti-bullying education. In: Cavazza, M., Donikian, S. (eds.) ICVS 2007. LNCS, vol. 4871, pp. 202–205. Springer, Heidelberg (2007)
Cavazza, M., Lugrin, J., Pizzi, D., Charles, F.: Madame bovary on the holodeck: immersive interactive storytelling. In: Proceedings of the 15th International Conference on Multimedia, pp. 651–660 (2007)
Schoenau-Fog, H.: Hooked! – evaluating engagement as continuation desire in interactive narratives. In: Si, M., Thu, D., André, E., Lester, J., Tanenbaum, T.J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 219–230. Springer, Heidelberg (2011)
Bída, M., Brom, C., Popelová, M.: To date or not to date? A minimalist affect-modulated control architecture for dating virtual characters. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS, vol. 6895, pp. 419–425. Springer, Heidelberg (2011)
Brewer, W., Lichtenstein, E.: Stories are to entertain: A structural-affect theory of stories. Journal of Pragmatics (1982)
y Pérez, P., Sharples, M.: MEXICA: A computer model of a cognitive account of creative writing. Journal of Experimental & Theoretical Artificial Intelligence 13(2), 119–139 (2001)
Ware, S.G., Young, R.M., Harrison, B., Roberts, D.L.: Four quantitative metrics describing narrative conflict. In: Oyarzun, D., Peinado, F., Young, R.M., Elizalde, A., Méndez, G. (eds.) ICIDS 2012. LNCS, vol. 7648, pp. 18–29. Springer, Heidelberg (2012)
Weyhrauch, P., Bates, J.: Guiding interactive drama. PhD. Thesis (1997)
Ontañón, S., Zhu, J.: On the role of domain knowledge in analogy-based story generation. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, pp. 1717–1722 (2011)
Forbus, K., Gentner, D., Law, K.: MAC/FAC: A model of similarity-based retrieval. Cognitive Science 19(2), 141–205 (1995)
Cheong, Y., Jhala, A., Bae, B., Young, R.: Automatically generating summary visualizations from game logs. In: Proc. AIIDE, pp. 167–172 (2008)
Rabe, F., Wachsmuth, I.: An Event Metric and an Episode Metric for a Virtual Guide. In: Proceedings of the 5th International Conference on Agents and Artificial Intelligence, vol. 2, pp. 543–546 (2013)
Zwaan, R.A., Langston, M.C., Graesser, A.C.: The construction of situation models in narrative comprehension: An event-indexing model. Psychological Science 6(5), 292–297 (1995)
Porteous, J., Charles, F., Cavazza, M.: NetworkING: using character relationships for interactive narrative generation. In: Proceedings of the 2013 International Conference on Autonomous Agents and Multi-Agent Systems, pp. 595–602. IFAAMAS (2013)
Aylett, R., Louchart, S.: If I were you - Double appraisal in affective agents. In: Proc. of 7th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2008), pp. 1233–1236 (2008)
Kadlec, R., Čermák, M., Behan, Z., Brom, C.: Generating Corpora of Activities of Daily Living and towards Measuring the Corpora’s Complexity. In: Dignum, F., Brom, C., Hindriks, K., Beer, M., Richards, D. (eds.) CAVE 2012. LNCS, vol. 7764, pp. 149–166. Springer, Heidelberg (2013)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning. Springer, New York (2001)
Freytag, G.: Technique of the Drama: An Exposition of Dramatic Composition and Art (1863)
Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Cambridge University Press, Cambridge (1988)
Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady 10(8), 707–710 (1966)
Jaccard, P.: Étude comparative de la distribution florale dans une portion des Alpes et des Jura. Bulletin de la Société Vaudoise des Sciences Naturelles 37, 547–579 (1901) (in French)
Winkler, W.: String Comparator Metrics and Enhanced Decision Rules in the Fellegi-Sunter Model of Record Linkage. In: Proceedings of the Section on Survey Research Methods (American Statistical Association), pp. 354–359 (1990)
Bída, M., Černý, M., Brom, C.: SimDate3D – Level Two. In: Koenitz, H., Sezen, T.I., Ferri, G., Haahr, M., Sezen, D., Çatak, G. (eds.) ICIDS 2013. LNCS, vol. 8230, pp. 128–131. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bída, M., Černý, M., Brom, C. (2013). Towards Automatic Story Clustering for Interactive Narrative Authoring. In: Koenitz, H., Sezen, T.I., Ferri, G., Haahr, M., Sezen, D., C̨atak, G. (eds) Interactive Storytelling. ICIDS 2013. Lecture Notes in Computer Science, vol 8230. Springer, Cham. https://doi.org/10.1007/978-3-319-02756-2_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-02756-2_11
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02755-5
Online ISBN: 978-3-319-02756-2
eBook Packages: Computer ScienceComputer Science (R0)