Abstract
Much of the wealth of industrialized societies is based on knowledge that is laid down and communicated in scientific/technical/engineering/mathematical documents: highly structured documents that contain diagrams, images, and – most daunting to many readers – mathematical formulae. It seems clear that digital, interactive documents have the potential to improve reading these kind of documents, and thus learning and applying this kind of knowledge.
To understand how such improvements could be designed, we explore how formula understanding interacts with the surrounding text in mathematical documents. We report on an eye-tracking experiment with 23 engineering students reading a “solved problem” based on a simple differential equation. We observe for instance that – triggered by formulae – readers backjump to previously identified semantic loci and that this behavior is independent of depth of understanding in mathematically trained readers. Based on our observations, we propose novel in-document interactions that could potentially enhance reading efficiency.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Document triage refers to readers’ practice of rapidly evaluating documents to determine whether they contain wanted information or not.
- 2.
Figures 12 and 15 together show the full document content, see https://kwarc.info/people/mkohlhase/data/DuStd-18/radiocarbon.html for the transcription.
- 3.
This has been unsuccessful, it seems that the English/Thai language barrier combined with a cultural reluctance to speak without preparation together with the unfamiliar situation induced prohibitive cognitive load which prevented students from speaking. When we realized this, we asked one student to “think aloud in Thai”, but this largely only resulted in a translation of the document, in particular not in the desired stream of cognition, so we dropped this idea.
- 4.
The eye moves discontinuously, making short stops (called fixations; we count any stop that is longer than 60 ms) and separating by rapid jumps (called saccades).
- 5.
There is of course the practical problem of how to determine whether F is focused. We could use in-place-and-time eye-tracking data instead of forcing the reader to e.g. hover the mouse over F to “focus” it, as this might be too distracting.
References
Baur, J.: Syntax und Semantik mathematischer Texte - ein Prototyp. MA thesis. Fachrichtung Computerlinguistik, Universität des Saarlandes, Saarbrücken, Germany (1999)
Buchanan, G., Loizides, F.: Investigating document triage on paper and electronic media. In: Kovács, L., Fuhr, N., Meghini, C. (eds.) ECDL 2007. LNCS, vol. 4675, pp. 416–427. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74851-9_35
Mozaffari Chanijani, S.S., et al.: An eye movement study on scientific papers using wearable eye tracking technology. In: 2016 Ninth International Conference on Mobile Computing and Ubiquitous Networking (ICMU), pp. 1–6. IEEE (2016). https://doi.org/10.1109/ICMU.2016.7742085
Edmondson, A., McManus, S.: Methodological fit in management field research. Acad. Manag. Rev. 32, 1155–1179 (2007)
Hevner, A., Chatterjee, S.: Design Research in Information Systems: Theory and Practice, 1st edn. Springer, New York (2010). https://doi.org/10.1007/978-1-4419-5653-8
Henderson, J.M., Weeks Jr., P.A., Hollingworth, A.: The effects of semantic consistency on eye movements during complex scene viewing. J. Exp. Psychol. Hum. Percept. Perform. 25(1), 210–228 (1999). https://doi.org/10.1037/0096-1523.25.1.210
Kohlhase, A., Fürsich, M.: Understanding mathematical expressions: an eye-tracking study. In: Kohlhase, A., Libbrecht, P. (eds.) Mathematical User Interfaces Workshop, July 2016. http://ceur-ws.org/Vol-1785/M2.pdf
Kohlhase, A., Kohlhase, M., Fürsich, M.: Visual structure in mathematical expressions. In: Geuvers, H., England, M., Hasan, O., Rabe, F., Teschke, O. (eds.) CICM 2017. LNCS (LNAI), vol. 10383, pp. 208–223. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62075-6_15
Kohlhase, M., et al.: The planetary system: Web 3.0 & active documents for STEM. In: Procedia Comput. Sci. 4 (2011). (Special issue: In: Sato, M., et al. (eds.) Proceedings of the International Conference on Computational Science (ICCS), pp. 598–607. https://doi.org/10.1016/j.procs.2011.04.063)
Kreyszig, E.: Advanced Engineering Mathematics, 9th edn. Wiley, Hoboken (2006)
Kristianto, G.Y., et al.: Extracting definitions of mathematical expressions in scientific papers. In: The 26th Annual Conference of the Japanese Society for Artificial Intelligence (2012). https://kaigi.org/jsai/webprogram/2012/pdf/719.pdf
Marshall, C.C.: Reading and Writing the Electronic Book. Morgan and Claypool Publishers, San Rafael (2009)
Martínez-Gómez, P., Aizawa, A.: Recognition of understanding level and language skill using measurements of reading behavior. In: Proceedings of the 19th International Conference on Intelligent User Interfaces, IUI 2014, pp. 95–104. ACM, Haifa (2014). https://doi.org/10.1145/2557500.2557546
Rayner, K.: Eye movements in reading and information processing: 20 years of research. English. Psychol. Bull. 124(3), 372–422 (1998)
Reichle, E.D., Reineberg, A.E., Schooler, J.W.: Eye movements during mindless reading, vol. 21, pp. 1300–1310, September 2010. https://doi.org/10.1177/0956797610378686
Schaefer, J.F.: Declaration spotting in mathematical documents. B.Sc. thesis. Jacobs University Bremen (2016). https://gl.kwarc.info/supervision/BSc-archive/blob/master/2016/schaefer-frederick.pdf
Wolska, M., Grigore, M.: Symbol declarations in mathematical writing: a corpus study. In: Sojka, P. (ed.) Towards Digital Mathematics Library, DML Workshop, pp. 119–127. Masaryk University, Brno (2010). http://dml.cz/bitstream/handle/10338.dmlcz/702580/DML_003-2010-1_14.pdf
Zambarbieri, D., Carniglia, E.: Eye movement analysis of reading from computer displays, eReaders and printed books. Ophthalmic Physiol. Opt. 32(5), 390–396 (2012). https://doi.org/10.1111/j.1475-1313.2012.00930.x
Zimmerman, J., Stolterman, E., Forlizzi, J.: An analysis and critique of research through design: towards a formalization of a research approach. In: Proceedings of the 8th ACM Conference on Designing Interactive Systems, DIS 2010, pp. 310–319. ACM, Aarhus (2010). https://doi.org/10.1145/1858171.1858228
Acknowledgements
The authors gratefully acknowledge the Erasmus+ Staff Mobility for Teaching program that provided the institutional setting of the design research, and the students of the course for their participation in the eye-tracking study.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Kohlhase, A., Kohlhase, M., Ouypornkochagorn, T. (2018). Discourse Phenomena in Mathematical Documents. In: Rabe, F., Farmer, W., Passmore, G., Youssef, A. (eds) Intelligent Computer Mathematics. CICM 2018. Lecture Notes in Computer Science(), vol 11006. Springer, Cham. https://doi.org/10.1007/978-3-319-96812-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-96812-4_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-96811-7
Online ISBN: 978-3-319-96812-4
eBook Packages: Computer ScienceComputer Science (R0)