Skip to main content
SpringerLink
Log in

ShapeShifting TV: interactive screen media narratives

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

This paper presents a paradigm, called ShapeShifting TV, for the realisation of interactive TV narratives or, more generally, of interactive screen-media narratives. These are productions whose narrations respond on the fly (i.e. in real time) to interaction from active viewers. ShapeShifting TV refers to productions made mainly with pre-recorded time-based material, in which variation is achieved by selecting and rearranging atomic elements of content (e.g. video clips) into individual narrations. The aimed quality of the productions (e.g. narrative continuity and aesthetics) is at least that of good traditional linear TV programmes. The artefact which determines the way individual stories unfold, called the narrative space, is authored and tested by experts before the delivery of the programme. However, the adaptation of narrations to input, at delivery time, is automatic. ShapeShifting TV is a generic paradigm; it is neither production nor genre specific. Furthermore, it is not confined to television; it is about screen media in general. ShapeShifting TV is founded on a computational language called Narrative Structure Language (NSL) and is accompanied by a comprehensive software system for authoring and delivery (which implements NSL). These were successfully employed to the creation of a number of ShapeShifting TV productions, which extended genres such as drama, documentary and news with interactivity. This paper defines the ShapeShifting TV paradigm, outlines NSL and the associated software, and presents two ShapeShifting TV productions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Agmanolis S. and Boye M. Jr. (2003). Viper: a framework for responsive television. IEEE Multimedia 10(1): 88–98

    Article  Google Scholar 

  2. Barry, B.: Mindful documentary. PhD thesis, Media Lab MIT, Massachusetts, USA (2005)

  3. Bocconi, S., Nack, F.: Vox Populi: Automatic Generation of Biased Video Sequences. In: ACM Multimedia Workshop Proceedings of Story Representation Mechanisms and Context, New York, pp. 9–16 (2004)

  4. Bulterman D.C.A. and Hardman L. (2005). Structured multimedia authoring. ACM Trans. Multimedia Comput. Commun. Appl. 1(1): 89–109

    Article  Google Scholar 

  5. Cavazza, M., Charles, F., Mead, S.J.: Character-based interactive storytelling. IEEE Intell. Syst., Special Issue on AI in Interactive Entertainment, pp. 17–24 (2002)

  6. Cavazza, M., Charles, F.: Dialogue generation in character-based interactive storytelling. In: Proceedings of AAAI First Annual Artificial Intelligence and Interactive Digital Entertainment Conference, Marina del Rey, California, USA. AAI Press, New York (2005)

  7. Gordon, A., van Lent, M., van Velsen, M., Carpenter, M., Jhala, A.: Branching storylines in virtual reality environments for leadership development. In: Proceedings of the Sixteenth Innovative Applications of Artificial Intelligence Conference (IAAI-04), San Jose, CA, Menlo Park, CA, USA. AAAI Press, New York (2004)

  8. Jensen, J.F.: Interactive television: new genres, new format, new content. In: Proceedings of the Second Australasian Conference on Interactive Environment, Sydney, Australia, pp. 89–96 (2005)

  9. Lu, K.Y.: Interaction design principles for interactive television. MSc Thesis, Georgia Institute of Technology, USA (2005)

  10. Lugrin, J.L., Cavazza, M.: AI-based world behaviour for emergent narratives. In: Proceedings of the ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, Hollywood, CA, USA. ACE, New York (2006)

  11. Manovich L. (2001). The Language of the New Media. MIT Press, Cambridge

    Google Scholar 

  12. Mateas, M., Sengers, P.: Narrative intelligence: an introduction to the NI symposium. In: Working notes of the Narrative Intelligence Symposium. AAAI Fall Symposium Series, Menlo Park, CA. AAAI Press, New York (1999)

  13. Mateas, M., Vanouse, P., Domike, S.: Generation of ideologically-based historical documentaries. In: Proceedings of AAAI 2000, Austin, TX, pp. 36–42 (2000)

  14. Mateas, M., Stern, A.: Structuring content in the Façade interactive drama architecture. In: Proceedings of AAAI First Annual Artificial Intelligence and Interactive Digital Entertainment Conference, Marina del Rey, CA, USA. AAAI Press, New York (2005)

  15. Murray, J.: Hamlet on the Holodeck: The Future of Narrative in Cyberspace. MIT Press, Cambridge (1997)

    Google Scholar 

  16. Pellinen, T.: Aquarium (‘Akvaario’), Media Lab, Helsinki University of Art and Design Finland, broadcast by YLE, The Finnish Broadcasting Company (2000)

  17. Ramis, H.: Groundhog Day. Columbia Pictures Corporation, USA (1993)

    Google Scholar 

  18. Riedl, M., Young, R.M.: From linear story generation to branching story graphs. IEEE J. Comput. Graphics Appl. (May/June) 23–31 (2006)

  19. Rieser M. and Zapp A. (2002). The New Screen Media: Cinema/Art/Narrative. BFI Film Classics, London

    Google Scholar 

  20. Ryan, M.-L. (ed.): Narrative Across Media: The Language of Storytelling. University of Nebraska Press, Lincoln (2004)

    Google Scholar 

  21. Sagas: Writing Interactive Fiction, Results 2000 Phase IV. http://www.sagasnet.de/sagaswif/page.php?id=18. (2007) Accessed Oct 2007

  22. Tuomola, M.L., Saarinen, L.E., Nurminen, M.J.: Accidental Lovers (‘Sydän Kierroksella’), Crucible Studio, Helsinki University of Art and Design Finland, broadcast on Channel TV1 by YLE, The Finnish Broadcasting Company (2006/2007)

  23. Ursu, M.F., Cook, J.J.: D5.9: Languages for the Representation of Visual narratives, Project deliverable (restricted access) in the EU FP6 Integrated Project IST-2003-004124 “NM2: New Media, New Millennium” (permission required) (2006)

  24. Ursu, M.F., Cook, J.J., Zsombori, V., Zimmer, R., Kegel, I., Williams, D., Thomas, M., Wyver, J., Mayer, H.: Conceiving ShapeShifting TV: a computational language for truly-interactive TV. In: Cesar, P. et al. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 96–106 (2007)

  25. Ursu, M.F., Cook. J.J., Zsombori, V., Kegel, I., Williams, D., Hausenblas, M., Tuomola, M.L.: ShapeShifting screen media: a declarative computational model for interactive reconfigurable moving image narratives. In: Proceedings of the AAAI Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE 07), Stanford, USA, pp. 101–104 (2007)

  26. Ursu, M.F., Thomas, M., Tuomola, M.L., Wright, T., Williams,~D., Zsombori, V.: Interactivity and narrativity in screen media. In: Proceedings of the IEEE International Symposium on Multimedia (ISM2007), Taichung, Taiwan, pp. 227–232 (2007)

  27. Wages, R., Grützmacher, B., Conrad, S.: Learning from the movie industry: adapting production processes for storytelling in VR. In: Göbel, S., Spierling, U., Hoffmann, A., et al. (eds.) Technologies for Interactive Digital Storytelling and Entertainment: Second International Conference, TIDSE 2004, Darmstadt, Germany. LNCS, vol. 3105, Springer, Berlin, pp. 119–125 (2004)

  28. Young, M.R.: An overview of the Mimesis architecture: integrating intelligent narrative control into an existing gaming environment. In: Working Notes of the AAAI Spring Symposium on Artificial Intelligence and Interactive Entertainment, Stanford, USA (2001)

Download references

Author information

Authors and Affiliations

  1. Goldsmiths, University of London, Lewisham Way, London, SE14 6NW, UK

    Marian F. Ursu & Vilmos Zsombori

  2. Future Content Group, BT, Adastral Park, Ipswich, IP5 3RE, UK

    Ian C. Kegel & Doug Williams

  3. Darwin College, University of Cambridge, Silver Street, Cambridge, CB3 9EU, UK

    Maureen Thomas

  4. Joanneum Research Institute, Steyrergasse 17-19, 25a, 8010, Graz, Austria

    Harald Mayer

  5. Crucible Studio, University of Arts and Design Helsinki, Hämeentie 135 C, FIN-00560, Helsinki, Finland

    Mika L. Tuomola

  6. School of Arts and Communication, Malmo University, 20506, Malmo, Sweden

    Henrik Larsson

  7. Illuminations, 19-20 Rheidol Mews, Rheidol Terrace, Islington, London, N1 8NU, UK

    John Wyver

Authors
  1. Marian F. Ursu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ian C. Kegel
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Doug Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maureen Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Harald Mayer
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Vilmos Zsombori
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mika L. Tuomola
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Henrik Larsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. John Wyver
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marian F. Ursu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ursu, M.F., Kegel, I.C., Williams, D. et al. ShapeShifting TV: interactive screen media narratives. Multimedia Systems 14, 115–132 (2008). https://doi.org/10.1007/s00530-008-0119-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-008-0119-z

Keywords

Search

Navigation