Abstract
This paper presents the results of a joint effort of a group of multimodality researchers and tool developers to improve the interoperability between several tools used for the annotation and analysis of multimodality. Each of the tools has specific strengths so that a variety of different tools, working on the same data, can be desirable for project work. However this usually requires tedious conversion between formats. We propose a common exchange format for multimodal annotation, based on the annotation graph (AG) formalism, which is supported by import and export routines in the respective tools. In the current version of this format the common denominator information can be reliably exchanged between the tools, and additional information can be stored in a standardized way.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anvil website, http://www.anvil-software.de/
ATLAS Website: http://sourceforge.net/projects/jatlas/
Barras, C., Geoffrois, E., Wu, Z., Liberman, M.: Transcriber: Development and Use of a Tool for Assisting Speech Corpora Production. Speech Communication 33, 5–22 (2000)
Bird, S., Liberman, M.: A formal framework for linguistic annotation. Speech Communication 33, 23–60 (2001)
Boersma, P., Weenik, D.: PRAAT, a system for doing phonetics by computer, version 3.4. Institute of Phonetic Sciences of the University of Amsterdam, Report 132, 182 pages (1996)
Brugman, H., Russel, A.: Annotating Multimedia/Multi-modal resources with ELAN. In: Proceedings of LREC 2004, Fourth International Conference on Language Resources and Evaluation (2004)
C-BAS website, http://www.cmi.arizona.edu/go.spy?xml=cbas.xml
Cochran, M., Good, J., Loehr, D., Miller, S.A., Stephens, S., Williams, B., Udoh, I.: Report from TILR Working Group 1: Tools interoperability and input/output formats (2007), http://tilr.mseag.org/wiki/index.php?title=Working_Group_1
ELAN website, http://www.lat-mpi.eu/tools/tools/elan
EXMARaLDA website, http://www.exmaralda.org
Kipp, M.: Anvil - A generic annotation tool for multimodal dialogue. In: Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech), Aalborg, pp. 1367–1370 (2001)
Kipp, M.: Gesture Generation by Imitation – From human behavior to computer character animation, Boca Raton, Florida: Dissertation.com (2004)
Laprun, C., Fiscus, J., Garofolo, J., Pajot, S.: Recent Improvements to the ATLAS Architecture. In: Proceedings of HLT 2002, Second International Conference on Human Language Technology, San Francisco (2002)
MacVissta website, http://sourceforge.net/projects/macvissta/
Milde, J.-T., Gut, U.: The TASX Environment: An XML-Based Toolset for Time Aligned Speech Corpora. In: Proceedings of the Third International Conference on Language Resources and Evaluation (LREC 2002), Gran Canaria (2002)
Website of the multimodal annotation workshop (2007), http://www.multimodal-annotation.org
Rohlfing, K., Loehr, D., Duncan, S., Brown, A., Franklin, A., Kimbara, I., Milde, J.-T., Parrill, F., Rose, T., Schmidt, T., Sloetjes, H., Thies, A., Wellinghoff, S.: Comparison of multimodal annotation tools: workshop report. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion (7), 99–123 (2006)
MacVissta website, http://sourceforge.net/projects/macvissta/
Maeda, K., Bird, S., Ma, X., Lee, H.: Creating Annotation Tools with the Annotation Graph Toolkit. In: Proceedings of the Third International Conference on Language Resources and Evaluation. European Language Resources Association, Paris (2002)
NITE XML Toolkit Website, http://www.ltg.ed.ac.uk/NITE/
Rose, T.: MacVisSTA: A System for Multimodal Analysis of Human Communication and Interaction. Master’s thesis, Virginia Tech. (2007)
Rose, T., Quek, F., Shi, Y.: MacVisSTA: A System for Multimodal Analysis. In: Proceedings of the 6th International Conference on Multimodal Interfaces (2004)
Schmidt, T.: Time-Based data models and the TEI guidelines for transcriptions of speech. Working papers in Multilingualism (56), Hamburg (2005)
Schmidt, T., Wörner, K.: EXMARaLDA – Creating, analysing and sharing spoken language corpora for pragmatic research. In: Pragmatics (to appear, 2009)
Theme website, http://www.noldus.com/site/doc200403003
Transformer website, http://www.oliverehmer.de/transformer/
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., Sloetjes, H.: ELAN: a Professional Framework for Multimodality Research. In: Proceedings of LREC 2006, Fifth International Conference on Language Resources and Evaluation (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Schmidt, T. et al. (2009). An Exchange Format for Multimodal Annotations. In: Kipp, M., Martin, JC., Paggio, P., Heylen, D. (eds) Multimodal Corpora. MMCorp 2008. Lecture Notes in Computer Science(), vol 5509. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04793-0_13
Download citation
DOI: https://doi.org/10.1007/978-3-642-04793-0_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04792-3
Online ISBN: 978-3-642-04793-0
eBook Packages: Computer ScienceComputer Science (R0)