Abstract
This paper investigates the linguistic and modal aspects of responses made by subjects in a Wizard of Oz experiment to repetition requests made by the ‘Wizard.’ English-speaking ‘clients’ participating in a task-oriented cooperative dialogue with Japanese-speaking ‘agents’ were asked to clarify utterances that were complex or lengthy. The discourse, syntactic, and modal structures of these clarifications are examined. While linguistic factors are characterizable as ‘reducing’ and ‘converging,’ media use in these responses does not exhibit a clear pattern. Implications are drawn for future investigations into the use of multimedia configurations and for the integration of multimedia technologies in automatic speech processing.
The authors would like to thank Tsuyoshi Morimoto and Yasuhiro Yamazaki for their continued support.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Blanchon, H., Loken-Kim, K.H., Fais, L. and Morimoto, T.(1995) A pattern-based approach for interactive clarification of natural language utterances. Proc. Information Processing Society of Japan SIG-NL Workshop, Tokyo. May 25–26.
Boitet, C. (1993) Practical speech translation systems will integrate human expertise, multimodal communication, and interactive disambiguation. Proc. MTS-IV, Kobe.
Fais, L. and Loken-Kim, K. H. (1994) Effects of mode on spontaneous English speech in EMMI. ATRTechnical Report TR-IT-0059. Kyoto: ATR Interpreting Telecommunications Research Laboratories.
Loken-Kim, K. H., Yato, F., Fais, L. and Morimoto, T. (1994) (Linguistic and par-alinguistic differences of telephone-only and multi-modal dialogues. Proc. ICSLP, Yokohama, September.
Loken-Kim, K.H.F. Yato, F., Kurihara, K., Fais, F. and Furukawa, R. (1993) EMMI-ATR environment for multi-modal interactions. ATRTechnical Report TR-IT-0018.Kyoto: ATR Interpreting Telecommunications Research Laboratories.
Park, Y. D., Loken-Kim, K. H. and Fais L (1994) An experiment for telephone versus multimedia multimodal interpretation: Methods and subjects' behavior. ATRTechnical Report TR-IT-0087. Kyoto: ATR Interpreting Telecommunications Research Laboratories.
Park, Y. D., Loken-Kim, K. H., Fais, L. and Mizunashi, S. (1995) Analysis of gesture behavior in a multimedia/multimodal interpreting experiment; Human vs. Wizard of Oz interpretation method. ATRTechnical Report TR-IT-0091. Kyoto: ATR Interpreting Telecommunications Research Laboratories.
Seligman, M., Fais, L. and Tomokiyo, M. (1994) A bilingual set of Communicative Act labels for spontaneous dialogues. ATRTechnical Report TR-IT-0081. Kyoto: ATR Interpreting Telecommunications Research Laboratories.
Zoltan-Ford, E. (1991) How to get people to say and type what computers can understand. International Journal of Man-Machine Studies 34.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag
About this paper
Cite this paper
Fais, L., Loken-Kim, Kh., Park, Y.D. (1998). Speakers' responses to requests for repetition in a multimedia language processing environment. In: Bunt, H., Beun, RJ., Borghuis, T. (eds) Multimodal Human-Computer Communication. CMC 1995. Lecture Notes in Computer Science, vol 1374. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0052323
Download citation
DOI: https://doi.org/10.1007/BFb0052323
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64380-7
Online ISBN: 978-3-540-69764-0
eBook Packages: Springer Book Archive