Abstract
This study investigated how readers interacted with different visual elements of AR books and examined specifically the function of pictorial representations of scientific illustration and photography in scientific reading. Four visual elements, namely the original Latin texts, original botanical illustration, augmented Chinese translation, and augmented color photograph, were arranged in four different layouts. The valid eye movement data from 29 college students in reading botanical floras were analyzed. The participants were assigned into 4 groups to read the AR book with different layouts. Descriptive results of participants’ reading behaviors regarding their gazes associated with the position and distance of the visual elements were reported and discussed. The preliminary findings of the study supported that color photography was a complementary aid to participants’ reading of botanical illustrations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Fennell, F., Rowan, T.: Representation: an important process for teaching and learning mathematics. Teach. Child. Math. 7, 288–292 (2001)
Höffler, T.N., Prechtl, H., Nerdel, C.: The influence of visual cognitive style when learning from instructional animations and static pictures. Learn. Individ. Differ. 20, 479–483 (2010)
Mason, L., Pluchino, P., Tornatora, M.C.: Using eye-tracking technology as an indirect instruction tool to improve text and picture processing and learning. Br. J. Edu. Technol. 47, 1083–1095 (2016)
Mason, L., Tornatora, M.C., Pluchino, P.: Integrative processing of verbal and graphical information during re-reading predicts learning from illustrated text: an eye-movement study. Read. Writ. 28(6), 851–872 (2015). https://doi.org/10.1007/s11145-015-9552-5
Mayer, R., Mayer, R.E.: The Cambridge Handbook of Multimedia Learning. Cambridge University Press, Cambridge (2005)
Witteveen, J.: Naming and contingency: the type method of biological taxonomy. Biol. Philos. 30(4), 569–586 (2014). https://doi.org/10.1007/s10539-014-9459-6
Lin, W., Chang, H.-J.: Understanding taxonomical botanist’s usage of special collection in the academic library: a bibliometrics study of NTU Tanaka collection. J. Libr. Inf. Stud. 20, 101–129 (2022)
Walton, C., Morris, A.: A bibliometric study of taxonomic botany. J. Doc. 69, 435–451 (2013)
Hickman, E.J., Yates, C.J., Hopper, S.D.: Botanical illustration and photography: a southern hemisphere perspective. Aust. Syst. Bot. 30, 291–325 (2017)
Simpson, N., Barnes, P.G.: Photography and contemporary botanical illustration. Curtis’s Bot. Mag. 25, 258–280 (2008)
Berger, S.E.: Rare Books and Special Collections. Facet Publishing, London (2014)
McDonald, S., Stevenson, R.J.: Effects of text structure and prior knowledge of the learner on navigation in hypertext. Hum. Factors 40, 18–27 (1998)
Vincent, H.: The library and the display of text. In: World Library and Information Congress: 78th IFLA General Conference and Assembly. IFLA, Helsinki, Finland (2012)
Bell, B., Cottrell, T.: Hands-free augmented reality: impacting the library future. In: Varnum, K.J. (ed.) The Top Technologies Every Librarian Needs to Know, pp. 13–26. American Library Association, Chicago (2014)
Armstrong, G., Hodgson, J., Manista, F., Ramirez, M.: The SCARLET project: augmented reality in special collections. SCONUL Focus 54, 52–57 (2012)
Cheng, K.-H.: Reading an augmented reality book: an exploration of learners’ cognitive load, motivation, and attitudes. Australas. J. Educ. Technol. 33, (2017)
Lin, W., Lo, W.-T., Yueh, H.-P.: Effects of learner control design in an AR-based exhibit on visitors’ museum learning. PLoS ONE 17, e0274826 (2022)
Grasset, R., Dünser, A., Billinghurst, M.: Edutainment with a mixed reality book: a visually augmented illustrative children’s book. In: Advances in Computer Entertainment Technology, Yokohama, Japan (2008)
Grasset, R., Dunser, A., Billinghurst, M.: The design of a mixed-reality book: Is it still a real book? In: 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 99–102 (2008)
Lin, W., Kotakehara, Y., Hirota, Y., Murakami, M., Kakusho, K., Yueh, H.P.: Modeling reading behaviors: an automatic approach to eye movement analytics. IEEE Access 9, 63580–63590 (2021)
Avicenna, S.: De Virtutibus Herbarum. Gioãni Andrea Vauassore, Venetia (1524)
https://help.tobii.com/hc/en-us/articles/212818309-Specifications-for-EyeX
Arthur, D., Vassilvitskii, S.: k-means++: the advantages of careful seeding. In: SODA 2007 Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1027–1035. ACM Society for Industrial and Applied Mathematics (2007)
Rix, M.: The Golden Age of Botanical Art. Andre Deutsch, Carlton Publishing Group, London (2012)
Mason, L., Pluchino, P., Tornatora, M.C., Ariasi, N.: An eye-tracking study of learning from science text with concrete and abstract illustrations. J. Exp. Educ. 81, 356–384 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lin, W., Masumoto, K., Kakusho, K., Yueh, HP. (2023). How Scientific Illustration and Photography Aid Learners’ Reading – Evidence from Eye Movements. In: Rau, PL.P. (eds) Cross-Cultural Design. HCII 2023. Lecture Notes in Computer Science, vol 14024. Springer, Cham. https://doi.org/10.1007/978-3-031-35946-0_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-35946-0_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35945-3
Online ISBN: 978-3-031-35946-0
eBook Packages: Computer ScienceComputer Science (R0)