Abstract
In this study we investigate miscommunications in interactions between human pilots and a virtual wingman, represented by our virtual agent Ashley. We made an inventory of the type of problems that occur in such interactions using recordings of Ashley in flight briefings with pilots and designed a perception experiment to find evidence of human pilots providing cues on the occurrence of miscommunications. In this experiment, stimuli taken from the recordings are rated by naive participants on successfulness. Results show the largest part of miscommunications concern floor management. Participants are able to correctly assess the success of interactions, thus indicating cues for such judgment are present, though successful interactions are better recognized. Moreover, we see stimulus modality (audio, visual or combined) does not influence the ability of participants to judge the success of the interactions. From these results, we present recommendations for further developing virtual wingmen.
Chapter PDF
Similar content being viewed by others
Keywords
References
Edlund, J., Gustafson, J., Heldnera, M., Hjalmarsson, A.: Towards human-like spoken dialogue systems. Speech Communication 50, 630–645 (2008)
Gratch, J., Rickel, J., Andre, E., Cassell, J., Petajan, E., Badler, N.: Creating interactive virtual humans: some assembly required. IEEE Intelligent Systems 17(4), 54–63 (2002)
Sandercock, J.: Lessons learned for construction of military simulations: A comparison of artificial intelligence to human-controlled agents. DSTOTR-1614, Defence Science and Technology Organisation Systems Sciences Laboratory, Adelaide, South Australia (2004)
Swartout, W., Gratch, J., Hill, A., Hovy, E., Marsella, S., Rickel, J., Traum, D.: Toward virtual humans. AI Magazine 27, 96–108 (2006)
van Doesburg, W., Looije, R., Melder, W., Neerincx, M.: Face to face interaction with an intelligent virtual agent: The effect on learning tactical picture compilation. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 490–491. Springer, Heidelberg (2008)
Martinovsky, B., Traum, D.: The error is the clue: breakdown in human-machin interaction. In: Proceedings of the ISCA Tutorial and Research Workshop Error Handling in Spoken Dialogue Systems. Château d’Oex, Vaud, Switzerland (2003)
Skantze, G.: Exploring human error handling strategies: implications for spoken dialogue systems. In: Proceedings of ISCA Tutorial and Research Workshop on Error Handling in Spoken Dialogue Systems, pp. 71–76 (2003)
Walker, M.A., Litman, D.J., Kamm, A.A., Abella, A.: Evaluating spoken dialogue agents with paradise: Two case studies. Computer Speech and Language (1998)
Dral, J., Heylen, D.K.J., op den Akker, H.J.A.: Detecting uncertainty in spoken dialogues: an explorative research to the automatic detection of a speakers’ uncertainty by using prosodic markers. In: Sentiment analysis: Emotion, Metaphor, Ontology and Terminology, Marrakech, Marocco, May 27, pp. 72–78. ELRA (2008)
Cassell, J.: Embodied conversational interface agents. Communications of the ACM 43(4), 70–78 (2000)
Barkhuysen, P., Krahmer, E., Swerts, M.: The interplay between the auditory and visual modality for end-of-utterance detection. The Journal of the Acoustical Society of America 123(1), 354–365 (2008)
Bulyko, I., Kirchhoff, K., Ostendorf, M., Goldberg, J.: Error-correction detection and response generation in a spoken dialogue system. Speech Communication 45(3), 271–288 (2005)
ter Maat, M., Heylen, D.: Turn management or impression management? In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009, vol. 5773, ch. 51, pp. 467–473. Springer, Berlin (2009)
Swerts, M., Krahmer, E.: Audiovisual prosody and feeling of knowing. Journal of Memory and Language 53(1), 81–94 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nauts, P., van Doesburg, W., Krahmer, E., Cremers, A. (2011). Taking Turns in Flying with a Virtual Wingman. In: Jacko, J.A. (eds) Human-Computer Interaction. Interaction Techniques and Environments. HCI 2011. Lecture Notes in Computer Science, vol 6762. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21605-3_63
Download citation
DOI: https://doi.org/10.1007/978-3-642-21605-3_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21604-6
Online ISBN: 978-3-642-21605-3
eBook Packages: Computer ScienceComputer Science (R0)