Abstract
Multimedia resources conventionally convey their subject matter through a combination of descriptive and depictive representations. However, responsibility for explaining that content is typically skewed heavily towards multimedia’s descriptive components. This theoretical paper considers likely perceptual and cognitive processing requirements for internalizing these two sources of information during mental model construction. It uses the example of a multimedia resource consisting of written text and an accompanying overview picture to propose that much of the role usually allocated to text in such a resource could conceivably be reallocated to a set of ancillary diagrams. This proposal is based on an analysis suggesting that these diagrams are a better foundation for mental model building than is text. Consequently, replacing the text in a multimedia resource with appropriately designed ancillary diagrams should result in superior understanding. Likely benefits and costs of this approach as well as possibilities for its further development are discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wright, P.: Presenting technical information: a survey of research findings. Instr. Sci. 6, 93–134 (1977)
Schnotz, W.: Integrated model of text and picture comprehension. In: Mayer, R.E., Fiorella, L. (eds.) The Cambridge Handbook of Multimedia Leaning, pp. 82–99. Cambridge University Press, Cambridge (2020)
Butcher, K.R.: The Multimedia Principle. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 174–205, Cambridge University Press, Cambridge (2014)
Low, R., Sweller, J.: The modality principle in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning, 2nd edn., pp. 227–262. Cambridge University Press, Cambridge (2014)
Kintsch, W.: Comprehension: A Paradigm for Cognition. Cambridge University Press, Cambridge (2003)
Johnson-Laird, P.N.: Mental Models. Harvard University Press, Cambridge (1983)
Johnson-Laird, P.N.: How We Reason. Oxford University Press, Oxford (2006)
Bétrancourt, M.: The animation and interactivity principles in multimedia learning. In: Mayer, R.E. (ed.) The Cambridge Handbook of Multimedia Learning (1st Edition) pp. 487–512. Cambridge University Press, Cambridge (2005). https://doi.org/10.1017/CBO9780511816819.019
Lowe, R., Boucheix, J.-M., Menant, M.: Perceptual processing and the comprehension of relational information in dynamic diagrams. In: Chapman, P., Stapleton, G., Moktefi, A., Perez-, S., Bellucci, F. (eds.) Diagrams 2018. LNCS (LNAI), vol. 10871, pp. 470–483. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91376-6_42
Johnson-Laird, P.N.: Mental models and human reasoning. PNAS, 26, 107 (43) 18243–18250 (2010). https://doi.org/10.1073/pnas.1012933107
Hegarty, M., Just, M.A.: Constructing mental models of machines from text and diagrams. J. Mem. Lang. 6(32), 717–742 (1993)
Mayer, R.E., Hegarty, M., Mayer, S., Campbell, J.: When static media promote active learning: annotated illustrations versus narrated animations in multimedia instruction. J. Exp. Psychol. Appl. 11(4), 256–265 (2005)
Lowe, R., Boucheix, J.-M.: Learning from animated diagrams: how are mental models built? In: Stapleton, G., Howse, J., Lee, J. (eds.) Diagrams 2008. LNCS (LNAI), vol. 5223, pp. 266–281. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-87730-1_25
Lowe, R.K.: Animation and learning: Selective processing of information in dynamic graphics. Learn. Instr. 13, 157–176 (2003)
Lowe, R.K., Boucheix, J.M.: Dynamic diagrams: a composition alternative. In: Cox, P., Plimmer, B., Rogers, P. (eds.) Diagrammatic Representation and Inference, LNAI, pp. 233–240. Springer, Berlin (2012)
Lowe, R.K., Boucheix, J.M.: Principled animation design improves comprehension of complex dynamics. Learn. Instr. 45, 72–84 (2016). https://doi.org/10.1016/j.learninstruc.2016.06.005
Lowe, R.K., Schnotz, W., Boucheix, J.M.: The Animation composition principle in multimedia learning. In: Mayer, R.E., Fiorella, L. (eds.) The Cambridge Handbook of Multimedia Learning, 3rd edn., pp. 313–323. Cambridge University Press, New-York (2021)
Lowe, R., Boucheix, J.-M.: Event unit analysis: a methodology for anticipating processing demands of complex animated diagrams. In: Pietarinen, A.-V., Chapman, P., Bosveld-de Smet, L., Giardino, V., Corter, J., Linker, S. (eds.) Diagrams 2020. LNCS (LNAI), vol. 12169, pp. 307–322. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-54249-8_24
Ploetzner, R., Berney, S., Bétrancourt, M.: A review of learning demands in instructional animations: The educational effectiveness of animations unfolds if the features of change need to be learned. J. Comput.-Assisted Learn. 36, 838–860 (2020). https://doi.org/10.1111/jcal.12476
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Lowe, R., Boucheix, JM. (2022). Ancillary Diagrams: A Substitute for Text in Multimedia Resources?. In: Giardino, V., Linker, S., Burns, R., Bellucci, F., Boucheix, JM., Viana, P. (eds) Diagrammatic Representation and Inference. Diagrams 2022. Lecture Notes in Computer Science(), vol 13462. Springer, Cham. https://doi.org/10.1007/978-3-031-15146-0_21
Download citation
DOI: https://doi.org/10.1007/978-3-031-15146-0_21
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-15145-3
Online ISBN: 978-3-031-15146-0
eBook Packages: Computer ScienceComputer Science (R0)