skip to main content
10.1145/2971485.2996749acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article

Eye Tracking in Emotional Design Research: What are its Limitations?

Published: 23 October 2016 Publication History

Abstract

Adding anthropomorphic graphical elements to computerized learning materials has been shown to enhance learning. We have prepared an experimental study, in which we will investigate if learning is enhanced because of the elevated positive affect of learners or due to the attention-capturing effect of the anthropomorphisms. Here, we present a pilot study asking if eye tracking might help in answering this question. Participants (N = 23) studied from one of three versions (schematic, enhanced black-and-white, enhanced with color) of instructional slides about the influenza virus for about 10 minutes; with eye tracking. Their prior and, especially, post hoc negative affect was elevated, and positive affect decreased compared to participants from a similar experiment without an eye tracker (N = 37). One-third of participants reported higher nervousness due to the eye tracker. The attention-capturing effect was possible to measure; but with limitations. The implications for emotional design studies with eye tracking are discussed.

References

[1]
Brom C., Hannemann, T., Starkova, T., Bromova, E., & Dechterenko, F. Anthropomorfic faces and funny graphics in an instructional animation may improve superficial rather than deep learning: A quasi-experimental study. In Proc. of European Conference on e-Learning (2016). (accepted)
[2]
Brom, C., Hannemann, T., Stárková T., Bromová, E., & Dřchtřrenko, F. The role of cultural background in the personalization principle: Experiments with Czech learners (2016). (submitted)
[3]
Clark, R.C. and Mayer, R.E. E-learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. John Wiley & Sons 2011.
[4]
Frischen, A., Bayliss, A.P. and Tipper, S. P. Gaze cueing of attention: visual attention, social cognition, and individual differences. Psychological bulletin, 133, 4 (2007) 694--724.
[5]
Johnson, C.I., & Mayer, R.E. An eye movement analysis of the spatial contiguity effect in multimedia learning. Journal of Experimental Psychology: Applied, 18, 2 (2012), 178--191.
[6]
Mayer, R. Multimedia Learning. Cambridge University Press, 2009.
[7]
Mayer, R. E. and Estrella, G. Benefits of emotional design in multimedia instruction, Learning and Instruction, 33 (2014), 12--18.
[8]
Park, B., Knörzer, L., Plass, J. L. and Brünken, R. Emotional design and positive emotions in multimedia learning: An eyetracking study on the use of anthropomorphisms. Computers & Education, 86 (2015), 30--42.
[9]
Plass, J.L. and Kaplan, U. Emotional Design in Digital Media for Learning. In Emotions, Technology, Design, and Learning (2015), 131--161.
[10]
Plass, J.L., Heidig, S., Hayward, E.O., Homer, B.D. and Um, E. Emotional design in multimedia learning: Effects of shape and color on affect and learning, Learning and Instruction, 29 (2014), 128--140.
[11]
Rheinberg, F., Vollmeyer, R. and Engeser, S. Die Erfassung des Flow-Erlebens {in German}. In Diagnostik von Motivation und Selbstkonzept, Hogrefe 2003, 261--279.
[12]
Um, E.R., Plass, J.L., Hayward, E.O. and Homer, B.D. Emotional Design in Multimedia Learning, Journal of Educational Psychology, 104, 2 (2012) 485--498.
[13]
Watson, D., Clark, L.A. and Tellegen, A. Development and validation of brief measures of positive and negative affect: the PANAS scales, Journal of Personality and Social Psychology, 54, 6 (1988), 1063--1070.

Cited By

View all
  • (2024)Measurement and Quantification of Stress in the Decision Process: A Model-Based Systematic ReviewIntelligent Computing10.34133/icomputing.00903Online publication date: 18-Sep-2024
  • (2023)Microstates of Dynamic Directed Connectivity Networks Revealing Visual Color Influences on the Brain Information Processing During LearningIEEE Access10.1109/ACCESS.2023.324406611(14256-14273)Online publication date: 2023
  • (2022)Anthropomorphizing malware, bots, and servers with human-like images and dialogues: the emotional design effects in a multimedia learning environmentSmart Learning Environments10.1186/s40561-022-00187-w9:1Online publication date: 15-Jan-2022

Index Terms

  1. Eye Tracking in Emotional Design Research: What are its Limitations?

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction
    October 2016
    1045 pages
    ISBN:9781450347631
    DOI:10.1145/2971485
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 October 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Emotional design
    2. anthropomorphisms
    3. eye tracking
    4. eyes
    5. negative affect
    6. positive affect
    7. slides

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • GA CR

    Conference

    NordiCHI '16

    Acceptance Rates

    NordiCHI '16 Paper Acceptance Rate 58 of 231 submissions, 25%;
    Overall Acceptance Rate 379 of 1,572 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)57
    • Downloads (Last 6 weeks)6
    Reflects downloads up to 03 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Measurement and Quantification of Stress in the Decision Process: A Model-Based Systematic ReviewIntelligent Computing10.34133/icomputing.00903Online publication date: 18-Sep-2024
    • (2023)Microstates of Dynamic Directed Connectivity Networks Revealing Visual Color Influences on the Brain Information Processing During LearningIEEE Access10.1109/ACCESS.2023.324406611(14256-14273)Online publication date: 2023
    • (2022)Anthropomorphizing malware, bots, and servers with human-like images and dialogues: the emotional design effects in a multimedia learning environmentSmart Learning Environments10.1186/s40561-022-00187-w9:1Online publication date: 15-Jan-2022
    • (2021)The Influences of Visual Design on Learner's Emotion and Learning Performance: A Proposed Framework for Predictive Assessment2020 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES)10.1109/IECBES48179.2021.9398838(489-493)Online publication date: 1-Mar-2021

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media