Skip to main content
Log in

Multimedia tool suite for the visualization of drama heritage metadata

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a multimedia tool suite for, on the one hand, the annotation of metadata that encode the dramatic qualities of cultural heritage items, and, on the other, the visualization of such metadata for drama analysis and didactics. The tool suite relies upon an ontology of drama to devise an annotation schema for the metadata concerning the dramatic qualities. The two major modules of the tool suite are a web-based platform, that allows for the insertion of the annotation metadata, and a visualization program for the interactive exploration of such metadata, respectively. The tool suite was tested on the cross-media studies of drama analysis and teaching of drama structure through the application to classical examples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. http://www.tei-c.org/

  2. http://www.europeana.eu/

  3. http://maphub.github.io/api/

  4. http://googleancientplaces.wordpress.com/about/

  5. http://pelagios-project.blogspot.it/p/about-pelagios.html

  6. http://www.imdb.com/

  7. http://www.contextus.net/stories

  8. http://visual.ly/memento-scene-timeline

  9. http://visual.ly/inception-timeline-visualisation

  10. See, e.g., the commercial products Final Draft, Movie Magic, Celtix, Script It!

  11. http://www.writersstore.com/dramatica-pro-story-development-software/

  12. See [29] for an introduction to computational ontologies.

  13. This example is also interesting to point out that the decision to annotate a fragment of drama hinges on the interpretation of the annotator. Other dialogues, even in a shakespearian drama, are annotated as a single incident; but in this case, that is the climax of scene, the two incidents result from a complex decision making process of the two characters and so the annotator decided to keep them apart, though, as we see below, they are connected through the two goals in conflict.

  14. See the portal http://www.ontologyportal.org

  15. CADMOS is an acronym for Character–centred Annotation of Dramatic Media ObjectS. Project description at the http://cadmos.di.unito.it.

  16. http://www.ontotext.com/owlim.

  17. http://www.w3schools.com/rdf/rdf_reference.asp).

  18. We have used Pellet, http://clarkparsia.com/pellet/.

  19. http://d3js.org/

  20. http://processing.org/

  21. http://bl.ocks.org/mbostock/1005873

  22. Synsets are groups of words that can be viewed as cognitive synonyms. Each synset expresses a distinct concept.

  23. http://www.readwritethink.org/

  24. http://www.readwritethink.org/classroom-resources/student-interactives/drama-30012.html?tab=2#tabs

  25. Nevertheless our visualization could be more effective if the timeline were expressed also in terms of frames and timecode to give teachers and students a more direct access to the audiovisual document.

  26. In Fig. 10, (X) and (Y) represent two different characters

References

  1. Addison AC, De Luca L, Guidi G, Pescarin S (eds) (2013) 2013 Digital Heritage International Congress, vol 2, Institute of Electrical and Electronics Engineers

  2. Agirre E, Barrena A, de Lacalle OL, Soroa A, Fernando S, Stevenson M (2012) Matching cultural heritage items to wikipedia. In: Chair) NCC, Choukri K, Declerck T, Doğan MU, Maegaard B, Mariani J, Odijk J, Piperidis S (eds) Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), European Language Resources Association (ELRA), Istanbul, Turkey

  3. Aristotele (2008) Poetica. Einaudi

  4. Aristotle (2013) Poetics. Oxford University Press

  5. Baikadi A, Goth J, Mitchell CM, Ha EY, Mott BW, Lester JC (2011) Towards a computational model of narrative visualization. In: AIIDE 2011 - AAAI Workshops at the Seventh Artificial Intelligence and Interactive Digital Entertainment Conference, pp 2–9

  6. Baker C, Fillmore C, Lowe J (1998) The berkeley framenet project. In: Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics-Volume 1, Association for Computational Linguistics, pp 86–90

  7. Bellini P, Nesi P, Serena M (2011) MyStoryPlayer: Semantic audio Visual Annotation and Navigation Tool. In: The 17th International Conference on Distributed Multimedia Systems, Florence, URL http://www.ksi.edu/seke/Proceedings/dms11/DMS/23_Pierfrancesco_Bellini.pdf

  8. Bordwell D, Thompson K (2006) Film art : an introduction. McGraw Hill, Boston

    Google Scholar 

  9. Bratman M (1987) Intention, Plans, and Practical Reason. Harvard University Press, Cambridge

    Google Scholar 

  10. Brooks C, Heilmann RB (1946) Understanding Drama. G.G. Harrap

  11. Bruner J (1991) The narrative construction of reality. Crit Inq 18(1):1–21

    Article  Google Scholar 

  12. Card SK, Suh B, Pendleton B, Heer J, Bodnar JW (2006) Timetree: Exploring time changing hierarchies. In: IEEE Symposium on Visual Analytics Science and Technology (VAST)

  13. Carlson M (1984) Theories of the theatre : a historical and critical survey from the Greeks to the present. Cornell University Press, Ithaca

    Google Scholar 

  14. Carroll N (2001) Beyond Esthetics: Philosophical Essays. Cambridge University Press, New York, Cambridge

    Book  Google Scholar 

  15. Carson C (1997) Drama and theatre studies in the multimedia age:’reviewing the situation’. Literary and Linguistic Computing 12 (4):269–275, DOI 10.1093/llc/12.4.269, URL http://llc.oxfordjournals.org/content/12/4/269.abstract, http://llc.oxfordjournals.org/content/12/4/269.full.pdf + html

  16. Cataldi M, Damiano R, Lombardo V, Pizzo A (2012) Lexical mediation for ontology-based annotation of multimedia. In: Oltramari A, Vossen P, Qin L, Hovy E (eds) New Trends of Research in Ontologies and Lexical Resources, Theory and Applications of Natural Language Processing Series, Springer

  17. De Melo G, Suchanek F, Pease A (2008) Integrating yago into the suggested upper merged ontology. In: Tools with Artificial Intelligence, 2008. ICTAI’08. 20th IEEE International Conference on, IEEE, vol 1, pp 190–193

  18. Diderot D (1966) Selected Writings. Classics in the history of thought. Crocker L (ed.), Macmillan, URL http://books.google.it/books?id = RJBcAAAAMAAJ

  19. Egri L (1946) The Art of Dramatic Writing. Simon and Schuster, New York

    Google Scholar 

  20. Elam K (1980 (1987)) The Semiotics of Theatre and Drama. Methuen, London and New York

  21. Elson DK (2012) Dramabank: Annotating agency in narrative discourse. In: Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012), Istanbul, Turkey

  22. Esslin M (1988 (1987)) The Field of Drama. Methuen, London

  23. Field S (2003) The definitive guide to screen writing. Ebury Press, London

    Google Scholar 

  24. Fisher D, Hoff A, Robertson GG, Hurst M (2008) Narratives: A visualization to track narrative events as they develop. In: Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (IEEE VAST 2008), Columbus, Ohio, USA, vol 01

  25. Freytag G (2004) Technique of the Drama: An Exposition of Dramatic Composition and Art. University Press of the Pacific

  26. Gangemi A, Presutti V (2009) Ontology design patterns. Handbook on Ontologies 221–243

  27. Genette G (1983) Narrative Discourse: An Essay in Method. Cornell University Press

  28. Graham M, Kennedy JB (2010) A survey of multiple tree visualisation. Inf Vis 9(4):235–252

    Article  Google Scholar 

  29. Guarino N, Oberle D, Staab S (2009) What is an ontology? In: Handbook on Ontologies, 2nd edn, Springer

  30. Hatcher J (1996) The Art and Craft of Playwriting. Story Press, Cincinnati

    Google Scholar 

  31. Heath T, Bizer C (2011) Linked data: Evolving the web into a global data space. Synthesis Lectures on the Semantic Web: Theory and Technology pp 1–136

  32. Hegel G (1885) Hegel’s Aesthetics. S.C. Griggs and Company

  33. Kipper K (2005) VerbNet: A broad-coverage, comprehensive verb lexicon. PhD Thesis, University of Pennsylvania

  34. Kurin R (2004) Safeguarding intangible cultural heritage in the 2003 UNESCO convention: a critical appraisal. Museum International 56 (1/2):66–77, URL http://search.ebscohost.com/login.aspx?direct = true&db = aph&AN = 13537907&site = ehost-live

  35. Lavandier Y (1994) La dramaturgie. Le clown et l’enfant, Cergy

  36. Lessing GE (1962) Hamburg Dramaturgy. Dover Publications

  37. Lombardo V, Damiano R (2012) Commonsense knowledge for the collection of ground truth data on semantic descriptors. In: Proceedings of the 2012 I.E. International Symposium on Multimedia (ISM 2012), IEEE Computer Society, pp 78–83

  38. Lombardo V, Pizzo A (2013) Ontologies for the metadata annotation of stories. In: Digital Heritage, ACM, Marseille, France

  39. Mamber S (2003) Narrative mapping. In: Caldwell J (ed) Everett A. New Media, Routledge, pp 145–158

    Google Scholar 

  40. Mamet D (1998) Three Uses of the Knife: On the Nature and Purpose of Drama. The Columbia Lectures on American Culture, Columbia University Press, URL http://books.google.it/books?id = YZRODCVYACsC

  41. McKee R (1997) Story. Harper Collins, New York

  42. Miller G (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41

    Article  Google Scholar 

  43. Naphade M, Smith JR, Tesic J, Chang SF, Hsu W, Kennedy L, Hauptmann A, Curtis J (2006) Large-scale concept ontology for multimedia. IEEE MultiMedia 13:86–91

    Article  Google Scholar 

  44. Norling E, Sonenberg L (2004) Creating Interactive Characters with BDI Agents. In: Proceedings of the Australian Workshop on Interactive Entertainment IE2004

  45. Ortony A, Clore G, Collins A (1988) The Cognitive Structure of Emotions. Press, Cambrigde

    Book  Google Scholar 

  46. Pease A, Niles I, Li J (2002) The suggested upper merged ontology: A large ontology for the semantic web and its applications. In: Working Notes of the AAAI-2002 Workshop on Ontologies and the Semantic Web, Edmonton, Canada, vol 28

  47. Peinado F, Cavazza M, Pizzi D (2008) Revisiting Character-based Affective Storytelling under a Narrative BDI Framework. In: Proc. of ICIDIS08, Erfurt, Germany

  48. Pfister M (1991) The Theory and Analysis of Drama. European Studies in English Literature, Cambridge University Press, URL http://books.google.it/books?id = 2BxOGkheiHMC

  49. Pianta E, Bentivogli L, Girardi C (2002) Multiwordnet: developing an aligned multilingual database. In: Proceedings of the First International Conference on Global WordNet, URL http://multiwordnet.fbk.eu/paper/MWN-India-published.pdf

  50. Polti G (1895) Les trente-six situations dramatiques. Mercure de France, Paris

    Google Scholar 

  51. Propp V (1968) Morphology of the Folktale. Press, Texas

    Google Scholar 

  52. Rimmon-Kenan S (1983) Narrative Fiction: Contemporary Poetics. Routledge

  53. Ryan M (2006) Avatars of Story. Press, Minnesota

    Google Scholar 

  54. Ryngaert J (2008) Introduction à l’analyse du théâtre. Collection Cursus. Série Littérature, Armand Colin, URL http://books.google.it/books?id = WldsIAAACAAJ

  55. Smith GM (2003) Film Structure and the Emotion System. Cambridge University Press, Cambridge

    Book  Google Scholar 

  56. Smith L, Akagawa N (2008) Intangible Heritage. Key Issues in Cultural Heritage, Taylor & Francis, URL http://books.google.it/books?id = voan0ESUzgAC

  57. Snoek CG, Worring M, van Gemert JC, Geusebroek JM, Smeulders AW (2006) The challenge problem for automated detection of 101 semantic concepts in multimedia. Proceedings of ACM Multimedia, Santa Barbara, pp 421–430

    Google Scholar 

  58. Spencer S (2002) The Playwright’s Guidebook: An Insightful Primer on the Art of Dramatic Writing. Faber & Faber, URL http://books.google.it/books?id = nDrHmckSqi4C

  59. Strauss A, Corbin J (1990) Basics of qualitative research: grounded theory procedures and techniques. Sage Publications, Calif

    Google Scholar 

  60. Suchanek F, Kasneci G, Weikum G (2007) Yago: a core of semantic knowledge. In: Proceedings of the 16th international conference on World Wide Web, ACM, pp 697–706

  61. Szondi P (1983) Theory of the moderna drama parts i-ii. boundary 2 11 (3):191–230

  62. van Riemsdijk M, Dastani M, Winikoff M (2008) Goals in Agent Systems: A Unifying Framework. In: Proceedings of AAMAS’08

  63. Vecco M (2010) A definition of cultural heritage: From the tangible to the intangible. Journal of Cultural Heritage 11 (3):321 – 324, DOI 10.1016/j.culher.2010.01.006, URL http://www.sciencedirect.com/science/article/pii/S1296207410000361

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vincenzo Lombardo.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lombardo, V., Pizzo, A. Multimedia tool suite for the visualization of drama heritage metadata. Multimed Tools Appl 75, 3901–3932 (2016). https://doi.org/10.1007/s11042-014-2066-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2066-3

Keywords

Navigation