Abstract
Previous studies have suggested many technologies to support non-native speaker comprehension in real-time communication. However, such technologies may impose an extra burden on non-native speakers (NNSs) if they do not match their current needs. To design a system that adapts to the changing needs of NNSs, we need to understand the types of problems NNSs face and how these problems are perceived by them. To explore such issues, we conducted a laboratory experiment with 40 NNSs (and 20 native speakers as a control group) who engaged in a listening task. During the task, the participants pressed a button whenever they encountered a comprehension problem. Next they explained each problem, the point at which they recognized the problem, and for how long it persisted. Our analysis identified twelve types of listening comprehension problems, which we further classified into three patterns based on their persistence and the time taken to perceive them. Our findings have implications for designing adaptive technologies to support listening comprehension of NNSs in real-time communication.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Anderson, J.R.: Cognitive psychology and its implications, 4th edn. Freeman, New York (1995)
Bloomfield, A., Wayland, S.C., Rhoades, E., Blodgett, A., Linck, J., Ross, S.: What makes listening difficult? factors affecting second language listening comprehension. Technical report, DTIC Document (2010)
Cox, T.H., Blake, S.: Managing cultural diversity: Implications for organizational competitiveness. Executive 5, 45–56 (1991)
Feely, A.J., Harzing, A.W.: Language management in multinational companies. Cross Cult. Manag. Int. J. 10(2), 37–52 (2003)
Feigh, K.M., Dorneich, M.C., Hayes, C.C.: Toward a characterization of adaptive systems a framework for researchers and system designers. Hum. Factors: J. Hum. Factors Ergon. Soc. 54(6), 1008–1024 (2012)
Gao, G., Yamashita, N., Hautasaari, A.M., Echenique, A., Fussell, S.R.: Effects of public vs. private automated transcripts on multiparty communication between native and non-native english speakers. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 843–852. ACM (2014)
Gao, G., Yamashita, N., Hautasaari, A.M., Fussell, S.R.: Improving multilingual collaboration by displaying how non-native speakers use automated transcripts and bilingual dictionaries. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3463–3472. ACM (2015)
Goh, C.: How much do learners know about the factors that influence their listening comprehension? Hong Kong J. Appl. Linguist. 4(1), 17–40 (1999)
Goh, C.C.: A cognitive perspective on language learners’ listening comprehension problems. System 28(1), 55–75 (2000)
Goh, C.C.: Exploring listening comprehension tactics and their interaction patterns. System 30(2), 185–206 (2002)
Hautasaari, A., Yamashita, N.: Do automated transcripts help non-native speakers catch up on missed conversation in audio conferences? In: Proceedings of the 5th ACM International Conference on Collaboration Across Boundaries: Culture, Distance and Technology, pp. 65–72. ACM (2014)
Höök, K.: Steps to take before intelligent user interfaces become real. Interact. Comput. 12(4), 409–426 (2000)
Ishida, T.: Language grid: An infrastructure for intercultural collaboration. In: International Symposium on Applications and the Internet, 2006. SAINT 2006, p. 5. IEEE (2006)
Johnson, S.C.: Hierarchical clustering schemes. Psychometrika 32(3), 241–254 (1967)
Kalnikaitė, V., Ehlen, P., Whittaker, S.: Markup as you talk: establishing effective memory cues while still contributing to a meeting. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pp. 349–358. ACM (2012)
Lotfi, G.: A questionnaire of beliefs on english language listening comprehension problems: Development and validation. World Appl. Sci. J. 16(4), 508–515 (2012)
Marschan, R., Welch, D., Welch, L.: Language: The forgotten factor in multinational management. Eur. Manag. J. 15(5), 591–598 (1997)
Nakamura, S., Markov, K., Nakaiwa, H., Kikui, G.I., Kawai, H., Jitsuhiro, T., Zhang, J.S., Yamamoto, H., Sumita, E., Yamamoto, S.: The ATR multilingual speech-to-speech translation system. IEEE Trans. Audio Speech Lang. Process. 14(2), 365–376 (2006)
Neeley, T., Hinds, P.J., Cramton, C.D.: Walking through jelly: language proficiency, emotions, and disrupted collaboration in global work. Harvard Business School Organizational Behavior Unit Working Paper (09–138) (2009)
Otten, M., Van Berkum, J.J.: Does working memory capacity affect the ability to predict upcoming words in discourse? Brain Res. 1291, 92–101 (2009)
Pan, Y., Jiang, D., Yao, L., Picheny, M., Qin, Y.: Effects of automated transcription quality on non-native speakers’ comprehension in real-time computer-mediated communication. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1725–1734. ACM (2010)
Pérez, L.C.: Foreign language productivity in synchronous versus asynchronous computer-mediated communication. CALICO J. 21, 89–104 (2003)
Pickering, M.J., Garrod, S.: Do people use language production to make predictions during comprehension? Trends Cogn. Sci. 11(3), 105–110 (2007)
Rubin, J.: A review of second language listening comprehension research. Mod. Lang. J. 78(2), 199–221 (1994)
Takano, Y., Noda, A.: A temporary decline of thinking ability during foreign language processing. J. Cross-Cult. Psychol. 24(4), 445–462 (1993)
Tucker, S., Kyprianou, N., Whittaker, S.: Time-compressing speech: asr transcripts are an effective way to support gist extraction. In: Popescu-Belis, A., Stiefelhagen, R. (eds.) MLMI 2008. LNCS, vol. 5237, pp. 226–235. Springer, Heidelberg (2008)
Van Petten, C., Luka, B.J.: Prediction during language comprehension: Benefits, costs, and ERP components. Int. J. Psychophysiol. 83(2), 176–190 (2012)
Vandergrift, L.: Recent developments in second and foreign language listening comprehension research. Lang. Teach. 40(03), 191–210 (2007)
Wahlster, W.: Verbmobil: Foundations of Speech-to-Speech Translation. Springer, Heidelberg (2013)
Yagang, F.: Listening: problems and solutions. Engl. Teach. Forum 31, 16–19 (1993). Teacher Development, Making the Right Movies
Yamashita, N., Echenique, A., Ishida, T., Hautasaari, A.: Lost in transmittance: how transmission lag enhances and deteriorates multilingual collaboration. In: Proceedings of The 2013 Conference on Computer Supported Cooperative Work, pp. 923–934. ACM (2013)
Yao, L., Pan, Y.-x., Jiang, D.-n.: Effects of automated transcription delay on non-native speakers’ comprehension in real-time computer-mediated communication. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part I. LNCS, vol. 6946, pp. 207–214. Springer, Heidelberg (2011)
Zekveld, A.A., Kramer, S.E., Festen, J.M.: Pupil response as an indication of effortful listening: The influence of sentence intelligibility. Ear Hear. 31(4), 480–490 (2010)
Zekveld, A.A., Kramer, S.E., Kessens, J.M., Vlaming, M.S., Houtgast, T.: The influence of age, hearing, and working memory on the speech comprehension benefit derived from an automatic speech recognition system. Ear Hear. 30(2), 262–272 (2009)
Acknowledgments
This research was partially supported by a Grant-in-Aid for Scientific Research (S) (24220002, 2012-2016) from Japan Society for the Promotion of Science (JSPS).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Science+Business Media Singapore
About this paper
Cite this paper
Cao, X., Yamashita, N., Ishida, T. (2016). How Non-native Speakers Perceive Listening Comprehension Problems: Implications for Adaptive Support Technologies. In: Yoshino, T., Chen, GD., Zurita, G., Yuizono, T., Inoue, T., Baloian, N. (eds) Collaboration Technologies and Social Computing. CollabTech 2016. Communications in Computer and Information Science, vol 647. Springer, Singapore. https://doi.org/10.1007/978-981-10-2618-8_8
Download citation
DOI: https://doi.org/10.1007/978-981-10-2618-8_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-2617-1
Online ISBN: 978-981-10-2618-8
eBook Packages: Computer ScienceComputer Science (R0)