Xiaojuan Ma
ABSTRACT
Language is a barrier for many non-native English speaking users to benefit from huge resources of information via the Internet. Many approaches have been tried to enhance web content comprehension, including the use of pictorial support. In this paper, we present a two-step exploration of whether augmenting ordinary text content with multiple imagery representations could foster people's process of online information. The first step consisted of two studies, i.e. a food - ingredient matching study and a treatment - illness matching study, which evaluated the efficacy of a combination of text and pictures in facilitating information discrimination and decision making. In the second step, we assessed participants' comprehension and recall of complex scenarios in medical care for online self-diagnoses with the help of image sequences. We used non-native English speakers to resemble language barriers. Results showed that participants' performance was improved significantly with the multi-picture support when people's language skills are limited.
- Ariew, R. A template to generate hypertext and hypermedia reading materials: design and associate research findings. The Reading Matrix. (2006). 6 (3), 195--209.Google Scholar
- Bodemer, D., & Plotzner, R. Encouraging the active integration of information during learning with multiple and interactive representations. In R. Plotzner (Ed.) Int'l Workshop Dynamic Visualizations and Learning. (2002).Google Scholar
- Daemen, E. (2007) Designing a Free Style, Indirect, and Interactive Storytelling Application for People with Aphasia. In Proc. INTERACT'07. (2007), 221--234. Google ScholarDigital Library
- Gibbson, J. J. The ecological approach to visual perception. (1986).Google Scholar
- Houts. P., Doak, C. Doak, L., and Loscalzo, M. The Role of Pictures in Improving Health Communication: A Review of Research on Attention, Comprehension, Recall, and Adherence. Patient Education and Counseling. (2006). 61(2): 173--190.Google Scholar
- Internet Usage Statistics. http://www.internetworldstats.com/. Accessed in 2013.Google Scholar
- Katz, M. G., Kripalani, S., Weiss, B. D. Use of Pictorial Aids in Medication Instructions: A Review of the Literature. Amer J Health Syst Pharm.63 (23):2391--7. 2006.Google Scholar
- Kjelldahl, L. A Survey of Some Perceptual Features for Computer Graphics and Visualization. In Proc. Linkoping Electronic Conference. (2003).Google Scholar
- Kralisch, A. and Berendt, B. Language-sensitive search behaviour and the role of domain knowledge. New Review of Hypermedia and Multimedia. (2005). 11(2).Google Scholar
- Lingraphica. http://www.aphasia.com/. Accessed in 2012.Google Scholar
- Ma, X., Boyd-Graber, J., Nikolova, S. and Cook, PR Speaking through pictures: images vs. icons. In Proc. Assets '09. ACM Press, (2009). 163--170. Google ScholarDigital Library
- MedlinePlus. http://www.nlm.nih.gov/medline plus/. Accessed in 2013.Google Scholar
- Proloquo2Go. http://www.proloquo2go.com/. Accessed in 2013.Google Scholar
- Sankey, M. D. Visual and multiple representation in learning materials: an issue of literacy. Presented at the Create.ed 2003: eLearning for the Creative Industries, Melbourne, Australia. (2003).Google Scholar
- Schloman, B. Information Resources: "Breaking through the Foreign Language Barrier: Resources on the Web." Online Journal of Issues in Nursing. (2000).Google Scholar
- Wright, A. Pictures for Language Learning, Cambridge University Press, Cambridge, U. K., (1990).Google Scholar
Index Terms
- Augmenting text with multiple pictures can facilitate online information processing across language barriers
Recommendations
Synthesized speech intelligibility and persuasion: Speech rate and non-native listeners
This experiment assessed the effect of variation in speech rate on comprehension and persuasiveness of a message presented in text-to-speech (TTS) synthesis to native and non-native listeners. Eighty non-native speakers of English and 80 native speakers ...
Mining comparable bilingual text corpora for cross-language information integration
KDD '05: Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data miningIntegrating information in multiple natural languages is a challenging task that often requires manually created linguistic resources such as a bilingual dictionary or examples of direct translations of text. In this paper, we propose a general cross-...
Text analysis and language identification for polyglot text-to-speech synthesis
In multilingual countries, text-to-speech synthesis systems often have to deal with texts containing inclusions of multiple other languages in form of phrases, words, or even parts of words. In such multilingual cultural settings, listeners expect a ...
Comments