Skip to main content

How Non-native Speakers Perceive Listening Comprehension Problems: Implications for Adaptive Support Technologies

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 647))

Abstract

Previous studies have suggested many technologies to support non-native speaker comprehension in real-time communication. However, such technologies may impose an extra burden on non-native speakers (NNSs) if they do not match their current needs. To design a system that adapts to the changing needs of NNSs, we need to understand the types of problems NNSs face and how these problems are perceived by them. To explore such issues, we conducted a laboratory experiment with 40 NNSs (and 20 native speakers as a control group) who engaged in a listening task. During the task, the participants pressed a button whenever they encountered a comprehension problem. Next they explained each problem, the point at which they recognized the problem, and for how long it persisted. Our analysis identified twelve types of listening comprehension problems, which we further classified into three patterns based on their persistence and the time taken to perceive them. Our findings have implications for designing adaptive technologies to support listening comprehension of NNSs in real-time communication.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Anderson, J.R.: Cognitive psychology and its implications, 4th edn. Freeman, New York (1995)

    Google Scholar 

  2. Bloomfield, A., Wayland, S.C., Rhoades, E., Blodgett, A., Linck, J., Ross, S.: What makes listening difficult? factors affecting second language listening comprehension. Technical report, DTIC Document (2010)

    Google Scholar 

  3. Cox, T.H., Blake, S.: Managing cultural diversity: Implications for organizational competitiveness. Executive 5, 45–56 (1991)

    Article  Google Scholar 

  4. Feely, A.J., Harzing, A.W.: Language management in multinational companies. Cross Cult. Manag. Int. J. 10(2), 37–52 (2003)

    Article  Google Scholar 

  5. Feigh, K.M., Dorneich, M.C., Hayes, C.C.: Toward a characterization of adaptive systems a framework for researchers and system designers. Hum. Factors: J. Hum. Factors Ergon. Soc. 54(6), 1008–1024 (2012)

    Article  Google Scholar 

  6. Gao, G., Yamashita, N., Hautasaari, A.M., Echenique, A., Fussell, S.R.: Effects of public vs. private automated transcripts on multiparty communication between native and non-native english speakers. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 843–852. ACM (2014)

    Google Scholar 

  7. Gao, G., Yamashita, N., Hautasaari, A.M., Fussell, S.R.: Improving multilingual collaboration by displaying how non-native speakers use automated transcripts and bilingual dictionaries. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 3463–3472. ACM (2015)

    Google Scholar 

  8. Goh, C.: How much do learners know about the factors that influence their listening comprehension? Hong Kong J. Appl. Linguist. 4(1), 17–40 (1999)

    Google Scholar 

  9. Goh, C.C.: A cognitive perspective on language learners’ listening comprehension problems. System 28(1), 55–75 (2000)

    Article  Google Scholar 

  10. Goh, C.C.: Exploring listening comprehension tactics and their interaction patterns. System 30(2), 185–206 (2002)

    Article  MathSciNet  Google Scholar 

  11. Hautasaari, A., Yamashita, N.: Do automated transcripts help non-native speakers catch up on missed conversation in audio conferences? In: Proceedings of the 5th ACM International Conference on Collaboration Across Boundaries: Culture, Distance and Technology, pp. 65–72. ACM (2014)

    Google Scholar 

  12. Höök, K.: Steps to take before intelligent user interfaces become real. Interact. Comput. 12(4), 409–426 (2000)

    Article  Google Scholar 

  13. Ishida, T.: Language grid: An infrastructure for intercultural collaboration. In: International Symposium on Applications and the Internet, 2006. SAINT 2006, p. 5. IEEE (2006)

    Google Scholar 

  14. Johnson, S.C.: Hierarchical clustering schemes. Psychometrika 32(3), 241–254 (1967)

    Article  Google Scholar 

  15. Kalnikaitė, V., Ehlen, P., Whittaker, S.: Markup as you talk: establishing effective memory cues while still contributing to a meeting. In: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pp. 349–358. ACM (2012)

    Google Scholar 

  16. Lotfi, G.: A questionnaire of beliefs on english language listening comprehension problems: Development and validation. World Appl. Sci. J. 16(4), 508–515 (2012)

    Google Scholar 

  17. Marschan, R., Welch, D., Welch, L.: Language: The forgotten factor in multinational management. Eur. Manag. J. 15(5), 591–598 (1997)

    Article  Google Scholar 

  18. Nakamura, S., Markov, K., Nakaiwa, H., Kikui, G.I., Kawai, H., Jitsuhiro, T., Zhang, J.S., Yamamoto, H., Sumita, E., Yamamoto, S.: The ATR multilingual speech-to-speech translation system. IEEE Trans. Audio Speech Lang. Process. 14(2), 365–376 (2006)

    Article  Google Scholar 

  19. Neeley, T., Hinds, P.J., Cramton, C.D.: Walking through jelly: language proficiency, emotions, and disrupted collaboration in global work. Harvard Business School Organizational Behavior Unit Working Paper (09–138) (2009)

    Google Scholar 

  20. Otten, M., Van Berkum, J.J.: Does working memory capacity affect the ability to predict upcoming words in discourse? Brain Res. 1291, 92–101 (2009)

    Article  Google Scholar 

  21. Pan, Y., Jiang, D., Yao, L., Picheny, M., Qin, Y.: Effects of automated transcription quality on non-native speakers’ comprehension in real-time computer-mediated communication. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1725–1734. ACM (2010)

    Google Scholar 

  22. Pérez, L.C.: Foreign language productivity in synchronous versus asynchronous computer-mediated communication. CALICO J. 21, 89–104 (2003)

    Google Scholar 

  23. Pickering, M.J., Garrod, S.: Do people use language production to make predictions during comprehension? Trends Cogn. Sci. 11(3), 105–110 (2007)

    Article  Google Scholar 

  24. Rubin, J.: A review of second language listening comprehension research. Mod. Lang. J. 78(2), 199–221 (1994)

    Article  Google Scholar 

  25. Takano, Y., Noda, A.: A temporary decline of thinking ability during foreign language processing. J. Cross-Cult. Psychol. 24(4), 445–462 (1993)

    Article  Google Scholar 

  26. Tucker, S., Kyprianou, N., Whittaker, S.: Time-compressing speech: asr transcripts are an effective way to support gist extraction. In: Popescu-Belis, A., Stiefelhagen, R. (eds.) MLMI 2008. LNCS, vol. 5237, pp. 226–235. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  27. Van Petten, C., Luka, B.J.: Prediction during language comprehension: Benefits, costs, and ERP components. Int. J. Psychophysiol. 83(2), 176–190 (2012)

    Article  Google Scholar 

  28. Vandergrift, L.: Recent developments in second and foreign language listening comprehension research. Lang. Teach. 40(03), 191–210 (2007)

    Article  Google Scholar 

  29. Wahlster, W.: Verbmobil: Foundations of Speech-to-Speech Translation. Springer, Heidelberg (2013)

    MATH  Google Scholar 

  30. Yagang, F.: Listening: problems and solutions. Engl. Teach. Forum 31, 16–19 (1993). Teacher Development, Making the Right Movies

    Google Scholar 

  31. Yamashita, N., Echenique, A., Ishida, T., Hautasaari, A.: Lost in transmittance: how transmission lag enhances and deteriorates multilingual collaboration. In: Proceedings of The 2013 Conference on Computer Supported Cooperative Work, pp. 923–934. ACM (2013)

    Google Scholar 

  32. Yao, L., Pan, Y.-x., Jiang, D.-n.: Effects of automated transcription delay on non-native speakers’ comprehension in real-time computer-mediated communication. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part I. LNCS, vol. 6946, pp. 207–214. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  33. Zekveld, A.A., Kramer, S.E., Festen, J.M.: Pupil response as an indication of effortful listening: The influence of sentence intelligibility. Ear Hear. 31(4), 480–490 (2010)

    Article  Google Scholar 

  34. Zekveld, A.A., Kramer, S.E., Kessens, J.M., Vlaming, M.S., Houtgast, T.: The influence of age, hearing, and working memory on the speech comprehension benefit derived from an automatic speech recognition system. Ear Hear. 30(2), 262–272 (2009)

    Article  Google Scholar 

Download references

Acknowledgments

This research was partially supported by a Grant-in-Aid for Scientific Research (S) (24220002, 2012-2016) from Japan Society for the Promotion of Science (JSPS).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xun Cao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Science+Business Media Singapore

About this paper

Cite this paper

Cao, X., Yamashita, N., Ishida, T. (2016). How Non-native Speakers Perceive Listening Comprehension Problems: Implications for Adaptive Support Technologies. In: Yoshino, T., Chen, GD., Zurita, G., Yuizono, T., Inoue, T., Baloian, N. (eds) Collaboration Technologies and Social Computing. CollabTech 2016. Communications in Computer and Information Science, vol 647. Springer, Singapore. https://doi.org/10.1007/978-981-10-2618-8_8

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2618-8_8

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2617-1

  • Online ISBN: 978-981-10-2618-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics