Skip to main content
SpringerLink
Log in

Using an augmented reality-based training system to promote spatial visualization ability for the elderly

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

The physical condition and cognitive ability of older adults tends to decline. This study focused on the development of an augmented reality (AR)-based rehabilitation training system to improve the spatial visualization and mental rotation abilities of elderly people. Using one’s imagination to manipulate objects is common in everyday life. However, training tasks for the elderly are still presented in two-dimension, which research indicates generates a cognitive load that reduces the participants’ interest and diminishes the effects of training. AR can effectively reduce cognitive load, improve one’s sense of spatial direction, and increase participants’ interest in training. Therefore, this study used AR technology, combined with a tangible user interface as a manual controller, to allow participants to directly manipulate a virtual three-dimensional model that used a cube to conduct mental rotation tasks (MRT) for the elderly to improve their mental rotation ability. After 6 weeks of intervention, we used an ABA (reversal) design and paired-sample t tests in SPSS to compare the learning effects on the experimental group’s pre- and posttests. The participants’ error rates significantly declined and their reaction times significantly improved during the MRT test.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Aretz, A.J., Wickens, C.D.: The mental rotation of map displays. Hum. Perform. 5(4), 303–328 (1992)

    Article  Google Scholar 

  2. Arthur, P., Passini, R.: Wayfinding: People, Signs, and Architecture. Reissued as a collector’s edition in 2002 by Focus Strategic Communications, Inc. (2002)

  3. Banich, M.T., Heller, W.: Evolving perspectives on lateralization of function. Curr. Dir. Psychol. Sci. 7(1), 1–2 (1998)

    Article  Google Scholar 

  4. Blakemore, S.J., Bristow, D., Bird, G., Frith, C., Ward, J.: Somatosensory activations during the observation of touch and a case of vision–touch synesthesia. Brain 128(7), 1571–1583 (2005)

    Article  Google Scholar 

  5. Buckner, R.: Memory and executive function in aging and AD: multiple factors that cause decline and reserve factors that compensate. Neuron 44(1), 195–208 (2004)

    Article  Google Scholar 

  6. Chandler, P., Sweller, J.: Cognitive load theory and the format of instruction. Cogn. Instr. 8(4), 293–332 (1991)

    Article  Google Scholar 

  7. Chen, K.C.: Mental rotation ability and topographical disorientation in patients with mild Alzheimer’s disease. Institute of Behavioral Medicine, NCKU Dissertation, 1–56 (2011)

  8. Chu, M., Kita, S.: The nature of gestures’ beneficial role in spatial problem solving. J. Exp. Psychol. Gen. 140(1), 102–116 (2011)

    Article  Google Scholar 

  9. Cook, S.W., Tanenhaus, M.K.: Embodied communication: speakers? ─ gestures affect listeners? ─actions. Cognition 113(1), 98–104 (2009)

    Article  Google Scholar 

  10. De Beni, R., Pazzaglia, F., Gardini, S.: The role of mental rotation and age in spatial perspective-taking tasks: when age does not impair perspective-taking performance. Appl. Cogn. Psychol. 20(6), 807–821 (2006)

    Article  Google Scholar 

  11. Dцnser, A., Walker, L., Horner, H., Bentall, D.: Creating interactive physics education books with augmented reality. In: Paper presented at the Proceedings of the 24th Australian Computer-Human Interaction Conference (2012)

  12. Folk, M.D., Luce, R.D.: Effects of stimulus complexity on mental rotation rate of polygons. J. Exp. Psychol. Hum. Percept. Perform. 13(3), 395 (1987)

    Article  Google Scholar 

  13. Folstein, M.F., Folstein, S.E., McHugh, P.R.: Mini-mental state: a practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12(3), 189–198 (1975)

    Article  Google Scholar 

  14. Frick, A., Daum, M.M., Walser, S., Mast, F.W.: Developmental changes in the interference of motor processes with mental rotation. In: Paper Presented at the Proceedings of the 27th Annual Meeting of the Cognitive Science Society. (2005)

  15. Gardony, A.L., Taylor, H.A., Brunye, T.T.: What does physical rotation reveal about mental rotation? Psychol. Sci. 25(2), 605–612 (2014)

    Article  Google Scholar 

  16. Goldin-Meadow, S., Beilock, S.L.: Action’s influence on thought: the case of gesture. Perspect. Psychol. Sci. 5(6), 664–674 (2010)

    Article  Google Scholar 

  17. Guo, N.W., Liu, X.Z., Wang, P.F., Liao, Q.C., Zhen, R.X., Lin, K.P., et al.: Brief intelligence assessment of Chinese measurement and established scheme. J. Taiwan. Rehabil. Med. Mag. 16, 52–59 (1988)

    Google Scholar 

  18. Hedden, T., Gabrieli, J.D.: Insights into the ageing mind: a view from cognitive neuroscience. Nat. Rev. Neurosci. 5(2), 87–96 (2004)

    Article  Google Scholar 

  19. Hedley, N.R.: Empirical evidence for advanced geographic visualization interface use. In: Paper Presented at the 2003 International Cartographic Association’s International Cartographic Congress (ICC 2003), Los Alamitos, CA. (2003)

  20. Hegarty, M., Mayer, S., Kriz, S., Keehner, M.: The role of gestures in mental animation. Spat. Cogn. Comput. 5, 333–356 (2005)

    Article  Google Scholar 

  21. Hertzog, C., Kramer, A.F., Wilson, R.S., Lindenberger, U.: Enrichment effects on adult cognitive development: can the functional capacity of older adults be preserved and enhanced? Psychol. Sci. Public Interest 9(1), 1–65 (2008)

    Article  Google Scholar 

  22. Hostetter, A.B., Alibali, M.W., Bartholomew, A.E.: Gesture during mental rotation. In: Paper Presented at the Proceedings of the 33rd Annual Conference of Cognitive Science Society. Cogsci. Austin. TX, USA. (2011)

  23. Hoyek, N., Champely, S., Collet, C., Fargier, P., Guillot, A.: Is mental rotation ability a predictor of success for motor performance? J. Cogn. Dev. 15(3), 495–505 (2014)

    Article  Google Scholar 

  24. Hwang, G.J., Chang, H.F.: A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students. Comput. Educ. 56(4), 1023–1031 (2011)

    Article  Google Scholar 

  25. Jansen, P., Heil, M.: Gender differences in mental rotation across adulthood. Exp. Aging Res. 36(1), 94–104 (2010)

    Article  Google Scholar 

  26. Jenkins, L., Myerson, J., Joerding, J.A., Hale, S.: Converging evidence that visuospatial cognition is more age-sensitive than verbal cognition. Psychol. Aging 15(1), 157–175 (2000)

    Article  Google Scholar 

  27. Kaufmann, H., Schmalstieg, D.: Mathematics and geometry education with collaborative augmented reality. Comput. Graph. 37(3), 339–345 (2003)

    Article  Google Scholar 

  28. Klatzky, R.L., Wu, B., Shelton, D., Stetten, G.: Effectiveness of augmented-reality visualization versus cognitive mediation for learning actions in near space. ACM. Trans. Appl. Percept. 5(1), 1–23 (2008)

    Article  Google Scholar 

  29. La Grow, S.J.: Blindness and brain plasticity in navigation and object perception. J. Vis. Impair. Blind. 102(2), 107–108 (2008)

    Article  Google Scholar 

  30. Lee, S., Kline, R.: Wayfinding study in virtual environments: the elderly vs. the younger-aged groups. J. Archit. Res. 5(2), 63–76 (2011)

    Google Scholar 

  31. Mahncke, H.W., Bronstone, A., Merzenich, M.M.: Brain plasticity and functional losses in the aged: scientific bases for a novel intervention. Prog. Brain Res. 157, 81–109 (2006)

    Article  Google Scholar 

  32. Maitland, S.B., Intrieri, R.C., Schaie, K.W., Willis, S.L.: Gender differences in cognitive abilities: invariance of covariance and latent mean structure. Aging Neuropsychol. C 7, 3253 (2000)

    Article  Google Scholar 

  33. Malinowski, J.C.: Mental rotation and real-world wayfinding. Percept. Mot. Skills 92, 19–30 (2001)

    Article  Google Scholar 

  34. Martín-Gutiérrez, J., Saorín, J.L., Contero, M., Alcañiz, M., Pérez-López, D.C., Ortega, M.: Design and validation of an augmented book for spatial abilities development in engineering students. Comput. Graph. 34(1), 77–91 (2010)

    Article  Google Scholar 

  35. McCarthy, A.L.: Improving Older Adults’ Mental Rotation Skills Through Computer Training. University of Akron, Akron (2010)

    Google Scholar 

  36. Mowszowski, L., Batchelor, J., Naismith, S.L.: Early intervention for cognitive decline: can cognitive training be used as a selective prevention technique? Int. Psychogeriatr. 22(4), 537–548 (2010)

    Article  Google Scholar 

  37. Park, H.: The effect of activities in virtual worlds as a communication environment to understand each other. J. Cyber. Ther. Rehabil. 3(1), 71–82 (2010)

    Google Scholar 

  38. Parsons, T.D., Courtney, C.G., Dawson, M.E., Rizzo, A.A., Arizmendi, B.J.: Visuospatial processing and learning effects in virtual reality based mental rotation and navigational tasks. In: Engineering Psychology and Cognitive Ergonomics. Understanding Human Cognition. Lect. Notes. Comput. Sci. 8019, 75–83: Berlin: Springer. (http://link.springer.com/chapter/10.1007%2F978-3-642-39360-0_9). (2013)

  39. Pazzaglia, F., Moe, A.: Cognitive styles and mental rotation ability in map learning. Cogn. Process. 14(4), 391–399 (2013)

    Article  Google Scholar 

  40. Peich, M.C., Husain, M., Bays, P.M.: Age-related decline of precision and binding in visual working memory. Psychol. Aging 28(3), 729–743 (2013)

    Article  Google Scholar 

  41. Podzebenko, K., Egan, G.F., Watson, J.D.: Real and imaginary rotary motion processing: functional parcellation of the human parietal lobe revealed by fMRI. J. Cogn. Neurosci. 17(1), 24–36 (2005)

    Article  Google Scholar 

  42. Rabbitt, P.: Handbook of Human Intelligence. Q. J. Exp. Psychol. Sect A Hum. 40(1), 167–185 (1988). Sternberg, Rj

    Article  Google Scholar 

  43. Rieser, J.J. (ed.): Blindness and Brain Plasticity in Navigation and Object Perception, vol. 14, pp. 263–264. Taylor & Francis, Abingdon (2008)

    Google Scholar 

  44. Rizzo, A., Buckwalter, J., Larson, P., Van Rooyen, A., Kratz, K., Neumann, U., Kesselman, C., Thiebeaux, M.: Preliminary findings on a virtual environment targeting human mental rotation/spatial abilities. In: Paper Presented at the European Conference on Disability, Virtual Real. Assoc. Technol. (1998)

  45. Roberts, J.E., Bell, M.A.: Two-and three-dimensional MRT lead to different parietal laterality for men and women. Int. J. Psychophysiol. 50(3), 235–246 (2003)

    Article  Google Scholar 

  46. Shelton, B.E., Hedley, N.R.: Using augmented reality for teaching Earth-Sun relationships to undergraduate geography students. In: The First IEEE International Workshop on Augmented Reality Toolkit, Conference Paper. (2002)

  47. Shelton, B.E., Hedley, N.R.: Exploring a cognitive basis for learning spatial relationships with augmented reality. TICL 1, 323–357 (2004)

    Google Scholar 

  48. Shepard, R.N., Cooper, L.A.: Mental Images and Their Transformations. MIT Press, Cambridege (1986)

    Google Scholar 

  49. Shepard, R.N., Metzler, J.: Mental rotation of three-dimensional objects. Science 171, 701–703 (1971)

    Article  Google Scholar 

  50. Sjolie, D., Bodin, K., Elgh, E., Eriksson, J., Janlert, L.E., Nyberg, L.: Effects of interactivity and 3D-motion on mental rotation brain activity in an immersive virtual environment. In: Paper Presented at the Proceedings of the SIGCHI Conference Human Factor. Comput. Syst. (2010)

  51. Sweller, J., Van Merriënboer, J.J., Paas, F.G.: Cognitive architecture and instructional design. Educ. Psychol. Rev. 10(3), 251–296 (1998)

    Article  Google Scholar 

  52. Tsai, L.S.: Insightful solution of a geometry problem with instructional cues: I Group experiments. Percept. Mot. Skills 67(3), 699–705 (1988)

    Article  Google Scholar 

  53. Van Gerven, P., Paas, F., Van Merriënboer, J., Hendriks, M., Schmidt, H.G.: The efficiency of multimedia learning into old age. Br. J. Educ. Psychol. 73(4), 489–505 (2003)

    Article  Google Scholar 

  54. Vingerhoets, G., De Lange, F.P., Vandemaele, P., Deblaere, K., Achten, E.: Motor imagery in mental rotation: an fMRI study. Neuroimage 17(3), 1623–1633 (2002)

    Article  Google Scholar 

  55. Wexler, M., Kosslyn, S.M., Berthoz, A.: Motor processes in mental rotation. Cognition 68(1), 77–94 (1998)

    Article  Google Scholar 

  56. Wiedenbauer, G., Jansen-Osmann, P.: Manual training of mental rotation in children. Learn. Instr. 18(1), 30–41 (2008)

    Article  Google Scholar 

  57. Willems, R.M., Toni, I., Hagoort, P., Casasanto, D.: Neural dissociations between action verb understanding and motor imagery. J. Cogn. Neurosci. 22, 2387–2400 (2010)

    Article  Google Scholar 

  58. Wohlschlager, A., Wohlschlager, A.: Mental and manual rotation. J. Exp. Psychol. Hum. Percept. Perform. 24(2), 397–412 (1998)

    Article  Google Scholar 

  59. Wraga, M., Thompson, W.L., Alpert, N.M., Kosslyn, S.M.: Implicit transfer of motor strategies in mental rotation. Brain Cogn. 52(2), 135–143 (2003)

    Article  Google Scholar 

  60. Wright, R., Thompson, W.L., Ganis, G., Newcombe, N.S., Kosslyn, S.M.: Training generalized spatial skills. Psychon. Bull. Rev. 15(4), 763–771 (2008)

    Article  Google Scholar 

  61. Yeh, S.C., Wang, J.L., Wang, C.Y., Lin, P.H., Chen, G.D., Rizzo, A.: Motion controllers for learners to manipulate and interact with 3D objects for mental rotation training. Br. J. Educ. Technol. 45(4), 666–675 (2014)

    Article  Google Scholar 

  62. Yurt, E., Sunbul, A.M.: Effect of Modeling-Based activities developed using virtual environments and concrete objects on spatial thinking and mental rotation skills. Educ. Sci Theory Pract. 12(3), 1987–1992 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Physical Medicine and Rehabilitation Department of Kaohsiung Veterans General Hospital, Department of Biomedical Engineering, National Cheng Kung University, Tainan, Taiwan

    Zheng-Yu Hoe

  2. Ergonomics and Interaction Design Lab, Department of Industrial Design, National Cheng Kung University, No.1 University Rd, East District, Tainan, Taiwan

    I-Jui Lee, Chien-Hsu Chen & Kuo-Ping Chang

Authors
  1. Zheng-Yu Hoe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. I-Jui Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chien-Hsu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kuo-Ping Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to I-Jui Lee.

Appendix: Questionnaire

Appendix: Questionnaire

Dear participant, this questionnaire is designed to determine your subjective feelings of the use of the training system. It consists of three parts. Part I concerns your learning interest of the training system. Part II concerns the cognitive load you perceived during the use of the training system. Part III concerns your general attitude toward the ARSVT system (only for the experimental group). The responses to questions in each part use seven-point Likert-type scales, ranging from 1 (strongly disagree) to 7 (strongly agree). There is no right or wrong answer, and all of your answers will be handled anonymously.

figure a

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hoe, ZY., Lee, IJ., Chen, CH. et al. Using an augmented reality-based training system to promote spatial visualization ability for the elderly. Univ Access Inf Soc 18, 327–342 (2019). https://doi.org/10.1007/s10209-017-0597-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-017-0597-x

Keywords

Search

Navigation