Abstract
This paper presents a multimedia tool suite for, on the one hand, the annotation of metadata that encode the dramatic qualities of cultural heritage items, and, on the other, the visualization of such metadata for drama analysis and didactics. The tool suite relies upon an ontology of drama to devise an annotation schema for the metadata concerning the dramatic qualities. The two major modules of the tool suite are a web-based platform, that allows for the insertion of the annotation metadata, and a visualization program for the interactive exploration of such metadata, respectively. The tool suite was tested on the cross-media studies of drama analysis and teaching of drama structure through the application to classical examples.










Similar content being viewed by others
Notes
See, e.g., the commercial products Final Draft, Movie Magic, Celtix, Script It!
See [29] for an introduction to computational ontologies.
This example is also interesting to point out that the decision to annotate a fragment of drama hinges on the interpretation of the annotator. Other dialogues, even in a shakespearian drama, are annotated as a single incident; but in this case, that is the climax of scene, the two incidents result from a complex decision making process of the two characters and so the annotator decided to keep them apart, though, as we see below, they are connected through the two goals in conflict.
See the portal http://www.ontologyportal.org
CADMOS is an acronym for Character–centred Annotation of Dramatic Media ObjectS. Project description at the http://cadmos.di.unito.it.
We have used Pellet, http://clarkparsia.com/pellet/.
Synsets are groups of words that can be viewed as cognitive synonyms. Each synset expresses a distinct concept.
Nevertheless our visualization could be more effective if the timeline were expressed also in terms of frames and timecode to give teachers and students a more direct access to the audiovisual document.
In Fig. 10, (X) and (Y) represent two different characters
References
Addison AC, De Luca L, Guidi G, Pescarin S (eds) (2013) 2013 Digital Heritage International Congress, vol 2, Institute of Electrical and Electronics Engineers
Agirre E, Barrena A, de Lacalle OL, Soroa A, Fernando S, Stevenson M (2012) Matching cultural heritage items to wikipedia. In: Chair) NCC, Choukri K, Declerck T, Doğan MU, Maegaard B, Mariani J, Odijk J, Piperidis S (eds) Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), European Language Resources Association (ELRA), Istanbul, Turkey
Aristotele (2008) Poetica. Einaudi
Aristotle (2013) Poetics. Oxford University Press
Baikadi A, Goth J, Mitchell CM, Ha EY, Mott BW, Lester JC (2011) Towards a computational model of narrative visualization. In: AIIDE 2011 - AAAI Workshops at the Seventh Artificial Intelligence and Interactive Digital Entertainment Conference, pp 2–9
Baker C, Fillmore C, Lowe J (1998) The berkeley framenet project. In: Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics-Volume 1, Association for Computational Linguistics, pp 86–90
Bellini P, Nesi P, Serena M (2011) MyStoryPlayer: Semantic audio Visual Annotation and Navigation Tool. In: The 17th International Conference on Distributed Multimedia Systems, Florence, URL http://www.ksi.edu/seke/Proceedings/dms11/DMS/23_Pierfrancesco_Bellini.pdf
Bordwell D, Thompson K (2006) Film art : an introduction. McGraw Hill, Boston
Bratman M (1987) Intention, Plans, and Practical Reason. Harvard University Press, Cambridge
Brooks C, Heilmann RB (1946) Understanding Drama. G.G. Harrap
Bruner J (1991) The narrative construction of reality. Crit Inq 18(1):1–21
Card SK, Suh B, Pendleton B, Heer J, Bodnar JW (2006) Timetree: Exploring time changing hierarchies. In: IEEE Symposium on Visual Analytics Science and Technology (VAST)
Carlson M (1984) Theories of the theatre : a historical and critical survey from the Greeks to the present. Cornell University Press, Ithaca
Carroll N (2001) Beyond Esthetics: Philosophical Essays. Cambridge University Press, New York, Cambridge
Carson C (1997) Drama and theatre studies in the multimedia age:’reviewing the situation’. Literary and Linguistic Computing 12 (4):269–275, DOI 10.1093/llc/12.4.269, URL http://llc.oxfordjournals.org/content/12/4/269.abstract, http://llc.oxfordjournals.org/content/12/4/269.full.pdf + html
Cataldi M, Damiano R, Lombardo V, Pizzo A (2012) Lexical mediation for ontology-based annotation of multimedia. In: Oltramari A, Vossen P, Qin L, Hovy E (eds) New Trends of Research in Ontologies and Lexical Resources, Theory and Applications of Natural Language Processing Series, Springer
De Melo G, Suchanek F, Pease A (2008) Integrating yago into the suggested upper merged ontology. In: Tools with Artificial Intelligence, 2008. ICTAI’08. 20th IEEE International Conference on, IEEE, vol 1, pp 190–193
Diderot D (1966) Selected Writings. Classics in the history of thought. Crocker L (ed.), Macmillan, URL http://books.google.it/books?id = RJBcAAAAMAAJ
Egri L (1946) The Art of Dramatic Writing. Simon and Schuster, New York
Elam K (1980 (1987)) The Semiotics of Theatre and Drama. Methuen, London and New York
Elson DK (2012) Dramabank: Annotating agency in narrative discourse. In: Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012), Istanbul, Turkey
Esslin M (1988 (1987)) The Field of Drama. Methuen, London
Field S (2003) The definitive guide to screen writing. Ebury Press, London
Fisher D, Hoff A, Robertson GG, Hurst M (2008) Narratives: A visualization to track narrative events as they develop. In: Proceedings of the IEEE Symposium on Visual Analytics Science and Technology (IEEE VAST 2008), Columbus, Ohio, USA, vol 01
Freytag G (2004) Technique of the Drama: An Exposition of Dramatic Composition and Art. University Press of the Pacific
Gangemi A, Presutti V (2009) Ontology design patterns. Handbook on Ontologies 221–243
Genette G (1983) Narrative Discourse: An Essay in Method. Cornell University Press
Graham M, Kennedy JB (2010) A survey of multiple tree visualisation. Inf Vis 9(4):235–252
Guarino N, Oberle D, Staab S (2009) What is an ontology? In: Handbook on Ontologies, 2nd edn, Springer
Hatcher J (1996) The Art and Craft of Playwriting. Story Press, Cincinnati
Heath T, Bizer C (2011) Linked data: Evolving the web into a global data space. Synthesis Lectures on the Semantic Web: Theory and Technology pp 1–136
Hegel G (1885) Hegel’s Aesthetics. S.C. Griggs and Company
Kipper K (2005) VerbNet: A broad-coverage, comprehensive verb lexicon. PhD Thesis, University of Pennsylvania
Kurin R (2004) Safeguarding intangible cultural heritage in the 2003 UNESCO convention: a critical appraisal. Museum International 56 (1/2):66–77, URL http://search.ebscohost.com/login.aspx?direct = true&db = aph&AN = 13537907&site = ehost-live
Lavandier Y (1994) La dramaturgie. Le clown et l’enfant, Cergy
Lessing GE (1962) Hamburg Dramaturgy. Dover Publications
Lombardo V, Damiano R (2012) Commonsense knowledge for the collection of ground truth data on semantic descriptors. In: Proceedings of the 2012 I.E. International Symposium on Multimedia (ISM 2012), IEEE Computer Society, pp 78–83
Lombardo V, Pizzo A (2013) Ontologies for the metadata annotation of stories. In: Digital Heritage, ACM, Marseille, France
Mamber S (2003) Narrative mapping. In: Caldwell J (ed) Everett A. New Media, Routledge, pp 145–158
Mamet D (1998) Three Uses of the Knife: On the Nature and Purpose of Drama. The Columbia Lectures on American Culture, Columbia University Press, URL http://books.google.it/books?id = YZRODCVYACsC
McKee R (1997) Story. Harper Collins, New York
Miller G (1995) Wordnet: a lexical database for english. Commun ACM 38(11):39–41
Naphade M, Smith JR, Tesic J, Chang SF, Hsu W, Kennedy L, Hauptmann A, Curtis J (2006) Large-scale concept ontology for multimedia. IEEE MultiMedia 13:86–91
Norling E, Sonenberg L (2004) Creating Interactive Characters with BDI Agents. In: Proceedings of the Australian Workshop on Interactive Entertainment IE2004
Ortony A, Clore G, Collins A (1988) The Cognitive Structure of Emotions. Press, Cambrigde
Pease A, Niles I, Li J (2002) The suggested upper merged ontology: A large ontology for the semantic web and its applications. In: Working Notes of the AAAI-2002 Workshop on Ontologies and the Semantic Web, Edmonton, Canada, vol 28
Peinado F, Cavazza M, Pizzi D (2008) Revisiting Character-based Affective Storytelling under a Narrative BDI Framework. In: Proc. of ICIDIS08, Erfurt, Germany
Pfister M (1991) The Theory and Analysis of Drama. European Studies in English Literature, Cambridge University Press, URL http://books.google.it/books?id = 2BxOGkheiHMC
Pianta E, Bentivogli L, Girardi C (2002) Multiwordnet: developing an aligned multilingual database. In: Proceedings of the First International Conference on Global WordNet, URL http://multiwordnet.fbk.eu/paper/MWN-India-published.pdf
Polti G (1895) Les trente-six situations dramatiques. Mercure de France, Paris
Propp V (1968) Morphology of the Folktale. Press, Texas
Rimmon-Kenan S (1983) Narrative Fiction: Contemporary Poetics. Routledge
Ryan M (2006) Avatars of Story. Press, Minnesota
Ryngaert J (2008) Introduction à l’analyse du théâtre. Collection Cursus. Série Littérature, Armand Colin, URL http://books.google.it/books?id = WldsIAAACAAJ
Smith GM (2003) Film Structure and the Emotion System. Cambridge University Press, Cambridge
Smith L, Akagawa N (2008) Intangible Heritage. Key Issues in Cultural Heritage, Taylor & Francis, URL http://books.google.it/books?id = voan0ESUzgAC
Snoek CG, Worring M, van Gemert JC, Geusebroek JM, Smeulders AW (2006) The challenge problem for automated detection of 101 semantic concepts in multimedia. Proceedings of ACM Multimedia, Santa Barbara, pp 421–430
Spencer S (2002) The Playwright’s Guidebook: An Insightful Primer on the Art of Dramatic Writing. Faber & Faber, URL http://books.google.it/books?id = nDrHmckSqi4C
Strauss A, Corbin J (1990) Basics of qualitative research: grounded theory procedures and techniques. Sage Publications, Calif
Suchanek F, Kasneci G, Weikum G (2007) Yago: a core of semantic knowledge. In: Proceedings of the 16th international conference on World Wide Web, ACM, pp 697–706
Szondi P (1983) Theory of the moderna drama parts i-ii. boundary 2 11 (3):191–230
van Riemsdijk M, Dastani M, Winikoff M (2008) Goals in Agent Systems: A Unifying Framework. In: Proceedings of AAMAS’08
Vecco M (2010) A definition of cultural heritage: From the tangible to the intangible. Journal of Cultural Heritage 11 (3):321 – 324, DOI 10.1016/j.culher.2010.01.006, URL http://www.sciencedirect.com/science/article/pii/S1296207410000361
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lombardo, V., Pizzo, A. Multimedia tool suite for the visualization of drama heritage metadata. Multimed Tools Appl 75, 3901–3932 (2016). https://doi.org/10.1007/s11042-014-2066-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2066-3