Ge Gao
Naomi Yamashita
Ari M.J. Hautasaari
Susan R. Fussell
ABSTRACT
Conversational grounding, or establishing mutual knowledge that messages have been understood as intended, can be difficult to achieve when some conversational participants are using a non-native language. These difficulties in grounding can be challenging for native speakers to detect. In this paper, we examine the value of signaling potential grounding problems to native speakers (NS) by displaying how non-native speakers (NNS) use automated transcripts and bilingual dictionaries. We conducted a laboratory experiment in which NS and NNS of English collaborated via audio conferencing on a map navigation task. Triads of one NS guider, one NS follower, and one NNS follower performed the task using one of three awareness displays: (a) a no awareness display that showed only the automated transcripts, (b) a general awareness display that showed whether each follower was reading the automated transcripts and/or translating a word; or (c) a detailed awareness display that showed which line of the transcripts a follower was reading and/or which words he/she was translating. NS guiders and NNS followers collaborated most successfully with the detailed awareness display, while NS guiders and NS followers performed equally across conditions. Our findings suggest several ways to improve systems to support multilingual collaboration.
- Anderson, A., Bader, M., Bard, E., et al. (1991). The HCRC Map Task Corpus. Language and Speech, 34, 351--366.Google Scholar
Cross Ref
- Bardram, J. E., Hansen, T. R., & Soegaard, M. (2006). AwareMedia- A shared interative display supporting social, temporal, and spatial awareness in surgery. Proc. of CSCW 2006, 109--118. Google ScholarDigital Library
- Beebe, L.M., & Giles, H. (1984). Speechaccommodation theories: A discussion in terms of second-language acquisition. International Journal of the Sociology of Language, 46, 5--32,Google Scholar
- Birnholtz, J., & Ibara, S. (2012). Tracking changes in collaborative writing: Edits, visibility, and group maintenance. Proc. of CSCW 2012, 809--818. Google ScholarDigital Library
- Carter, J., & Dewan, P. (2010). Are you having difficulty? Proc. of CSCW 2010, 211--214. Google ScholarDigital Library
- Cheung, V., Chang, Y. L. B., & Scott, S. D. (2012). Communication channels and awareness cues in collocated collaborative time-critical gaming. Proc. of CSCW 2012, 569--578. Google ScholarDigital Library
- Clark, H.H. (1996). Using Language. Cambridge Press.Google ScholarCross Ref
- Clark, H. H., & Brennan, S. E. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley, (Eds.). Perspectives on Socially Shared Cognition (pp. 127--149). APA Press.Google ScholarCross Ref
- Dabbish, L., & Kraut, R. (2008). Awareness displays and social motivation for coordinating communication. Information Systems Research, 19, 221--238. Google ScholarDigital Library
- Diamant, E.I., Fussell, S. R., & Lo, F. L. (2008). Where did we turn wrong? Unpacking the effects of culture and technology on attributions of team performance. Proc. CSCW 2008, 383--391. Google ScholarDigital Library
- Dourish, P., & Bellotti, V. (1992). Awareness and coordination in shared workspaces. Proc. of CSCW 1992, 107--114. Google ScholarDigital Library
- Feely, A. J., & Harzing, A. W. K. (2003). Language management in multinational companies. CrossCultural Management: An Intl'l Journal, 10, 27--52.Google Scholar
- Fung, L., & Carter, R. (2007). Discourse markers and spoken English: Native and learner use in pedagogic settings. Applied Linguistics, 28, 410--439.Google ScholarCross Ref
- Gao, G., Yamashita, N., Hautasaari, A., Echenique, A., & Fussell, S. R. (2014). Effects of public vs. private automated transcripts on multiparty communication between native and non-native English speakers. Proc. of CHI 2014, 843--852. Google ScholarDigital Library
- Gergle, D., Kraut, R. E., & Fussell, S. R. (2013). Using visual information for grounding and awareness in collaborative tasks. Human-Computer Interaction, 28, 1--39.Google Scholar
- Gibson, C. B., & Gibbs, J. L. (2006). Unpacking the concept of virtuality: The effects of geographic dispersion, electronic dependence, dynamic structure, and national diversity on team innovation. Administrative Science Quarterly, 51, 451--495.Google ScholarCross Ref
- Hart, S. G., & Staveland, L. E. (1998). Development of NASA-TLX: Results of empirical and theoretical research. Advances in Psychology, 52, 139--183.Google ScholarCross Ref
- Henderson, J.K. (2005). Language diversity in international management teams. International Studies of Management and Organization, 35, 66--82.Google ScholarCross Ref
- Ishida, T. (2011). The language grid. Springer Press.Google ScholarCross Ref
- Kraut, R. E., Fussell, S. R., & Siegel, J. (2003). Visual information as a conversational resource in collaborative physical tasks. Human Computer Interaction, 18, 13--49. Google ScholarDigital Library
- Li, H. Z., Yum, Y., Yates, R., Aguilera, L., Mao, Y., & Zheng, Y. (2005). Interruption and involvement in discourse: Can intercultural interlocutors be trained? J. Intercultural Communication Research, 34, 233--254.Google Scholar
- Li, H. Z. (1999). Grounding and information communication in intercultural and intracultural dyadic discourse. Discourse Processes, 28, 195--215.Google ScholarCross Ref
- Lim, B. Y., Brdiczka, O., & Bellotti, V. (2010). Show me a good time: Using content to provide activity awareness to collaborators with Activity Spotter. Proc. of GROUP 2010, 263--272. Google ScholarDigital Library
- Reynolds, L., Birnholtz, J., & Lee, A. (2012). The effect of communication channel and visual awareness display on coordination in online tasks. Proc. iConference 2012, 120--128 Google ScholarDigital Library
- Rogerson-Revell, P. (2008). Participation and performance in international business meetings. English for Specific Purposes, 27, 338--360.Google ScholarCross Ref
- Setlock, L. D., Fussell, S. R., & Neuwirth, C. (2004). Taking it out of context: Collaborating within and across cultures in face-to-face settings and via instant messaging. Proc. CSCW 2004, 604--613. Google ScholarDigital Library
- Takano, Y., & Noda, A. (1993). A temporary decline of thinking ability during foreign language processing. Journal of Cross-Cultural Psychology, 24, 445--462.Google ScholarCross Ref
- Tange, H., & Lauring, J. (2009). Language management and social interaction within the multilingual workplace. J. Communication Management, 13, 218--232.Google ScholarCross Ref
- Wang, H. C., Fussell, S. R., & Cosley, D. (2013). Machine translation vs. common language: Effects on idea exchange in cross-lingual groups. Proc. of CSCW 2013, 935--944. Google ScholarDigital Library
- Wang, H-C., Fussell, S. R. & Setlock, L. D. (2009). Cultural difference and adaptation of communication styles in computer-mediated group brainstorming. Proc. CHI 2009, 669--678. Google ScholarDigital Library
- Wong, J. (2000). The token" yeah" in nonnative speaker English conversation. Research on Language and Social Interaction, 33, 39--67.Google ScholarCross Ref
- Yamashita, N., Echenique, A., Ishita, T., & Hautasaari, A. (2013). Lost in translation: How transmission lag enhances and deteriorates multilingual collaboration. In Proc. of CSCW 2013, 923--934. Google ScholarDigital Library
Index Terms
- Improving Multilingual Collaboration by Displaying How Non-native Speakers Use Automated Transcripts and Bilingual Dictionaries
Recommendations
Effects of public vs. private automated transcripts on multiparty communication between native and non-native english speakers
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsReal-time transcripts generated by automated speech recognition (ASR) technologies have the potential to facilitate communication between native speakers (NS) and non-native speakers (NNS). Previous studies of ASR have focused on how transcripts aid NNS ...
Multilingual recognition of non-native speech using acoustic model transformation and pronunciation modeling
This article presents an approach for the automatic recognition of non-native speech. Some non-native speakers tend to pronounce phonemes as they would in their native language. Model adaptation can improve the recognition rate for non-native speakers, ...
Investigating the impact of automated transcripts on non-native speakers' listening comprehension
ICMI '16: Proceedings of the 18th ACM International Conference on Multimodal InteractionReal-time transcripts generated by automatic speech recognition (ASR) technologies hold potential to facilitate non-native speakers’ (NNSs) listening comprehension. While introducing another modality (i.e., ASR transcripts) to NNSs provides ...
Comments