Rotational perspective and learning procedural tasks from dynamic media
Introduction
The notion that dynamic external visualizations can provide some efficacy over alternative presentations such as textual descriptions has been suggested many times (Larkin and Simon, 1987, Tufte, 2001). While there is some evidence suggesting that animations do not facilitate learning (Boucheix and Schneider, 2009, ChanLin, 2000, Hegarty et al., 2003, Mayer et al., 2005, Tversky et al., 2002), numerous other studies have found that animations can indeed enhance learning under certain constraints (see Höffler & Leutner (2007) for a review). For example, animations have been shown to be more effective than static visualizations for the acquisition of process knowledge in cell biology (Münzer, Seufert, & Brünken, 2009), and learning concepts in chemistry and earth science (Falvo and Suits, 2009, Sanchez and Wiley, 2010). However, an open question is what leads to this differential pattern of results regarding the effectiveness of animations for learning?
Some have suggested that perhaps animations are particularly well suited for certain content areas, and less so for others. In a meta-analysis conducted by Höffler and Leutner (2007), it was found that animations can be more effective than static images if they are a realistic approximation of the task, and especially so if the task involves procedural motor learning. For example, studies on the learning of basic first aid procedures (e.g., what to do when someone is choking, or how to bandage a hand) found that animations produced higher levels of recall than static images or text alone, and also produced faster rates of learning (Arguel and Jamet, 2009, Michas and Berry, 2000). Similarly, Ayres, Marcus, Chan, and Qian (2009) found that observing animations of knot tying and ring assembly puzzles produced the highest levels of both forward and reverse learning, and increased the ability to recognize next or previous steps versus similar static presentations.
So what is it about procedural motor learning tasks that make them so amenable to animated presentations? As animations demonstrate changes over time and/or sequence, it is possible that the inclusion of this underlying temporal component might produce a higher degree of match to procedural tasks versus other contexts, as these procedural tasks themselves often contain a temporal sequence of events. This is consistent with the intuitions of Rieber & Kini (1991), who suggested that animations can reduce the abstract nature of temporal changes, thus providing a more tangible way to understand material. In other words, the representation of time in these dynamic visualizations potentially increases the match between the to-be-learned material, and how said information is instructionally conveyed. Simply, the method of instruction more closely matches the constraints of the content domain it is meant to represent. It has been speculated that this congruence between content area and instruction underlies the most effective animations (Rieber, 1990; Tversky et al., 2002).
How then are we able to capitalize on heightened levels of congruence between instruction and content to improve learning and thus realize the full benefit of animations? In other words, what might be the underlying mechanism by which the effects of congruence are realized? While to date this has not been explicitly tested neurologically, it has been proposed that such animations potentially activate the mirror neuron system (MNS). It is believed that this activation facilitates learning in these tasks by providing a perceptual basis to interpret and understand these visualizations (Ayres et al., 2009, Chandler, 2009, Wong et al., 2009), akin to the perceptual benefit originally attributed to static illustrations alone (Larkin & Simon, 1987). From this perspective, activation of the MNS permits an almost effortless simulation or embodiment of the material which can then be used to encourage the activation of relevant knowledge and connections between material, and thus better understanding (van Gog, Paas, Marcus, Ayres & Sweller, 2009).
Originally identified in primates, the MNS represents a neurophysiological circuit distributed across the pre-motor cortex that selectively activates when either conducting a specific action, or when observing another individual performing the same action (Pellegrino, Fadiga, Fogassi, Gallese & Rizzolatti, 1992). It was originally believed that this system offered a perceptual mechanism to understand goal-directed action and intent (Gallese & Goldman, 1998) and perhaps might even serve as a gateway to language and communication (Gallese et al., 1996, Rizzolatti and Arbib, 1998). More recent research has refined this definition and identifies the MNS as critical for not only understanding others' movements, but also generating plans for one's own actions and execution (Fogassi et al., 2005, Meltzoff and Prinz, 2002). For example, while simply observing an individual play guitar chords did activate the MNS, watching the same material with the intent to replicate or reproduce (i.e., to learn) the actions produced even higher levels of activation within the MNS (Buccino et al., 2004). As such, some have suggested that this underlying architecture is potentially responsible for our ability to learn through imitation, which is a unique to higher apes and humans (Rizzolatti & Craighero, 2004). Given this conceptualization, it is not surprising that this neural circuit might be especially relevant for procedural learning, as the fundamental goal of any procedural learning task is to successfully imitate or reproduce a given pattern of motor events.
If this mirror neuron explanation is correct, and thus mediates the effectiveness of a given animation, one would expect to see an interaction between animations and the degree to which they activate the MNS. For example, when animations most activate the MNS, we would expect to see the highest levels of learning as these visualizations leverage the perceptual system in such a way as to enable better understanding of the to-be-learned motor task. However, when animations fail to strongly activate the MNS, it is reasonable to expect a similar decline in overall performance as this perceptual processing benefit is not realized. One way to test this explanation would be to systematically vary the degree of activation of the MNS, while holding informational content constant. Shifting action away from first-person perspectives has been shown to moderate activation of the MNS, such that face-to-face presentations activate the MNS to a lesser degree than over-the-shoulder perspectives (Jackson et al., 2006, Maeda et al., 2002). In other words, watching someone else demonstrate an action has been shown to produce lower levels of activation in the MNS than watching action from a perspective more akin to actual experience (e.g., through your own eyes). The question then is: does reducing activation of the MNS simultaneously produce lower levels of learning from animations when informational content is the same? If the suggestion that the MNS is largely responsible for the facilitation of animations in procedural learning, than one would expect lower facilitation in situations that less strongly activate the MNS.
Finally, previous research has indicated that individual differences in visuospatial and attentional ability might also moderate the instructional effectiveness of any kind of visualization, including animations. Visuospatial ability has been shown to interact with animations to affect learning of mechanical information (Mayer, 2001; Mayer & Sims, 1994), and spatial science topics (Höffler and Leutner, 2011, Sanchez and Wiley, 2010, Yang et al., 2003). Similarly, Cognitive Load Theory (van Merriënboer & Sweller, 2005), Mayer's (2005) Cognitive Theory of Multimedia Learning, and Schnotz's (2005) Integrative Model of Text and Picture Comprehension all speculate that appropriate visualizations offload processing demand from the working memory system, thereby freeing resources to better dedicate to the learning process. Given these proposed connections between learning from visualizations and individual differences in cognitive ability, it seems prudent to control for these abilities when evaluating a causal theory such as the MNS explanation.
To explore learning in procedural motor tasks and how they may interact with our perceptual system and presentation, a study was conducted which manipulated both of these characteristics. Participants were shown a procedural knot tying task from either an animated or static media, which was either consistent with their perspective when completing the task themselves (i.e., over-the-shoulder, OTS), or instead rotated 180° into a face-to-face (FTF) orientation. It is hypothesized that for procedural motor learning tasks, instruction via animations instead of static images will facilitate overall performance resulting in faster time, fewer errors and more steps correct. This would be consistent with a host of psychological research regarding the efficacy of such dynamic media (Höffler & Leutner, 2007). Further, this performance benefit may also interact with perspective of the demonstration. If the mirror neuron explanation is correct, those orientations that would activate the MNS most strongly will realize the largest benefits of animation. Conversely, those that lessen activation of the MNS should perform less well. In order to control for individual differences in general cognitive processing and visuospatial manipulation, both of which have been suggested to influence learning from animations (Hegarty and Waller, 2005, Mayer and Moreno, 1998), additional measures of these cognitive abilities were collected and entered into subsequent analyses.
Section snippets
Participants
Eighty-six undergraduates from a large public university were solicited for participation in this experiment. To control for differences in prior knowledge, participants were asked to self-report any formal prior experience with knot tying before participation. Participants who reported any formal familiarity with knot tying were excluded from the final analysis. Based on this strict criteria, 6 participants were excluded from the final analysis, resulting in eighty participants overall. All
Results & discussion
Participant's task performance was measured in the following ways: total time on task, and proportion of correct attempts. Descriptive statistics are available in Table 1. To test whether the rotation of the media and instructional media differed, a hierarchical OLS regression was performed for each of these performance metrics. Type of Media, perspective, WMC and visuospatial ability measures were entered into the first block of the analysis, and then an interaction term between media and
Conclusions
This experiment was designed to test two previous assertions regarding the potential benefit of animations in educational contexts: do animations enhance performance in procedural motor tasks, and more importantly, can such increases be directly tied to activation of the perceptual MNS? While animations did lead to better performance over static images for both the time required to reach a solution, and also the number of correct steps learned, it appears that these effects were largest for
References (45)
- et al.
Using video and static pictures to improve learning of procedural contents
Computers in Human Behavior
(2009) - et al.
Learning hand manipulative tasks: when instructional animations are superior to equivalent static representations
Computers in Human Behavior
(2009) - et al.
Static and animated presentations in learning dynamic mechanical systems
Learning and Instruction
(2009) - et al.
Neural circuits underlying imitation learning of hand actions: an event-related fMRI study
Neuron
(2004) Dynamic visualizations and hypermedia: beyond the “wow” factor
Computers in Human Behavior
(2009)- et al.
Mirror neurons and the simulation theory of mind-reading
Trends in Cognitive Sciences
(1998) - et al.
Instructional animation versus static pictures: a meta-analysis
Learning and Instruction
(2007) - et al.
The role of spatial ability in learning from instructional animations–Evidence for an ability-as-compensator hypothesis
Computers in Human Behavior
(2011) - et al.
Neural circuits involved in imitation and perspective-taking
Neuroimage
(2006) - et al.
Learning from multimedia presentations: facilitation function of animations and spatial abilities
Learning and Individual Differences
(2009)
Language within our grasp
Trends in Neurosciences
Sex differences in science learning: closing the gap through animations
Learning and Individual Differences
Instructional animations can be superior to statics when learning human motor skills
Computers in Human Behavior
Useful knots
Attributes of animation for learning scientific knowledge
Journal of Instructional Psychology
Working memory span tasks: a methodological review and user’s guide
Psychonomic Bulletin & Review
Web-based training: Creating e-learning experiences
Gender and spatial ability and the use of specific labels and diagrammatic arrows in a micro-level chemistry animation
Journal of Educational Computing Research
Parietal lobe: from action organization to intention understanding
Science
Kit of reference tests for cognitive factors
Action recognition in the premotor cortex
Brain
The mirror neuron system and observational learning: Implications for the effectiveness of dynamic visualizations
Educational Psychology Review
Cited by (39)
The effect of visualization format and content complexity on acquisition of tactical actions in basketball
2019, Learning and MotivationInvestigating gender and spatial measurements in instructional animation research
2018, Computers in Human BehaviorCitation Excerpt :Researchers believe that animations have a greater flexibility in depicting physical and temporal changes than static pictures (Bétrancourt & Tversky, 2000; Castro-Alonso, Ayres, & Paas, 2014a, p. 552; Lowe, 2003), and are often assumed to be superior to static pictures (Chandler, 2009). There is supporting evidence showing that animations are more effective than static pictures when teaching statistics (e.g., Wender & Muehlboeck, 2003), physics (e.g., Rebetez, Bétrancourt, Sangin, & Dillenbourg, 2010; Rieber, 1990, 1991b), geometry (e.g., Thompson & Riding, 1990), zoology (e.g., Pfeiffer, Scheiter, Kühl, & Gemballa, 2011), computer algorithm (e.g., Byrne, Catrambone, & Stasko, 1999), and motor-related tasks (e.g., Akinlofa, Holt, & Elyan, 2013; Ayres, Marcus, Chan, & Qian, 2009; Castro-Alonso, Ayres, & Paas, 2015a; Garland & Sánchez, 2013; Michas & Berry, 2000; A.; Wong et al., 2009). However, some contradictory results have emerged that challenge the effectiveness of animations (e.g., Bétrancourt, Dillenbourg, & Clavien, 2008; Höffler & Leutner, 2007).
Mixed camera viewpoints improve learning medical hand procedure from video in nurse training?
2018, Computers in Human BehaviorCitation Excerpt :For example, Jackson, Meltzoff, and Decety (2006) compared the two viewpoints and found more activity in the left sensory-motor cortex for the first-person than for the third-person perspective (see also, Maeda, Kleiner-Fisman & Pascual-Leone, 2002; Rizzolatti & Sinigaglia, 2008). Taking the hypothesis of the modulation of activation of the mirror neuron system, Garland and Sanchez (2013) tested the effect of different viewpoints on university students learning to tie complex knots, comparing dynamic and static presentations with face-to-face (FtF) and over-the-shoulder (OtS) views. Results revealed that learning performance was significantly better with animations than static images, and that this improvement was most pronounced in the situation which matched the learners' own perspective, in other words, the OtS view.
Wearable technology effects on training outcomes of restaurant food handlers
2018, Journal of Food ProtectionInvestigating the role of hand perspective in learning from procedural animations
2023, British Journal of Educational Psychology