Abstract
The paper presents a web-based multimodal and multilingual dictionary of gestures. Its current version contains several hundreds of gestures represented by a still image, a description of the gesture and its meaning, and optional sound and video records. The current version includes language and culture dependent content for American English, Slovak, Italian, and Mongolian. Entries for Japanese, Chinese, and Hungarian are being implemented. The primary motivation for database creation is to build a research tool that will facilitate identifying problems in research on nonverbal speech displays and their intercultural and intermodal aspects, and help in testing proposed solutions to these problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ward, N.: Non-Lexical Conversational Sounds in American English. Pragmatics & Cognition 14(1), 129–182 (2006)
Stewart, O.W., Corley, M.: Hesitation disfluencies in spontaneous speech: The meaning of um. Language and Linguistics Compass 4, 589–602 (2008)
Clark, H.H., Fox Tree, J.E.: Using uh and um in spontaneous speaking. Cognition 84, 73–111 (2002)
Laskowski, K.: Finding emotionally involved speech using implicitly proximity-annotated laughter. In: Int. Conf. on Acoustics, Speech, and Signal Processing, pp. 5226–5229 (2010)
Ruch, W.: Ekman, p.: The expressive pattern of laughter. In: Kaszniak, A. (ed.) Emotion, Qualia and Consciousness. World Scientific, Tokyo (2001)
Gravano, A., Hirschberg, J., Beňuš, Š.: Affirmative cure words in task-oriented dialogues. Computational Linguistics (in press)
Benus, S., Gravano, A., Hirschberg, J.: The prosody of backchannels in American English. In: Proceedings of ICPhS, pp. 1065–1068 (2007)
Rusko, M., Juhár, J.: Towards Annotation of Nonverbal Vocal Gestures in Slovak. In: Esposito, A., Bourbakis, N.G., Avouris, N., Hatzilygeroudis, I. (eds.) HH and HM Interaction. LNCS (LNAI), vol. 5042, pp. 255–265. Springer, Heidelberg (2008)
Kendon, A.: Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge (2004)
Knapp, M.L., Hall, J.A.: Nonverbal communication in human action. Wadsworth, Belmont (2001)
Campbell, N.: On the Use of Non Verbal Speech Sounds in Human Communication. In: Esposito, A., Faundez-Zanuy, M., Keller, E., Marinaro, M. (eds.) COST Action 2102. LNCS (LNAI), vol. 4775, pp. 117–128. Springer, Heidelberg (2007)
Ružičková, E.: Picture dictionary of gestures (American, Slovak, Japanese, and Chinese). Comenius University Publishing House, Bratislava (2001)
Ekman, P.: Universals and Cultural Differences in Facial Expression of Emotion. In: Cole, J. (ed.) Nebraska Symposium on Motivation, pp. 207–283. University of Nebraska Press, Lincoln (1972)
McNeill, D.: So you think gestures are nonverbal? Psychological Review 92, 350–371 (1985)
Pizzuto, E., Catenacci, C.: Signed Languages, Verbal languages, Coverbal Gestures: Analysis and Representation, http://www.loa-cnr.it/iliks/Pizzuto-Catenacci06.pdf (accessed December 15, 2010)
Rossini, N.: The Analysis of Gesture: Establishing a Set of Parameters. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 124–131. Springer, Heidelberg (2004)
Allwood, J., Cerrato, L., Jokinen, K., Navaretta, C., Paggio, P.: The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena. Language Resources & Evaluation 41, 273–287 (2007)
Boersma, P., Weenink, D.: Praat: doing phonetics by computer (Version 5.1.05) (Computer program), http://www.praat.org/ (retrieved May 1, 2009)
Beckman, M.E., Hirschberg, J.: The ToBI Annotation Conventions, http://www.ling.ohio-state.edu/~tobi/ame_tobi/annotation_conventions.html (retrieved November 1, 2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rusko, M., Beňuš, Š. (2011). Multimodal Multilingual Dictionary of Gestures: DiGest. In: Esposito, A., Vinciarelli, A., Vicsi, K., Pelachaud, C., Nijholt, A. (eds) Analysis of Verbal and Nonverbal Communication and Enactment. The Processing Issues. Lecture Notes in Computer Science, vol 6800. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25775-9_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-25775-9_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25774-2
Online ISBN: 978-3-642-25775-9
eBook Packages: Computer ScienceComputer Science (R0)