Exploring the Potential of Augmented Reality in English Language Learning: Designing an Interactive Pronunciation Training App

Abstract

Augmented reality (AR) has the potential to transform teaching and learning by providing real-time interactions, displaying information in various ways, and connecting the physical and digital worlds. While AR technology is becoming more accessible through mobile devices and head-mounted displays (HMDs), its widespread adoption in education depends on providing an engaging and interactive user experience. Designing appropriate AR user interfaces is crucial for ensuring the technology is easily adopted and enjoyed by users. One area where AR can be particularly beneficial is in the teaching of the English language and correct pronunciation, especially at an early stage of education. In the English language, vowels play a key role as they appear in every syllable of every word. Understanding vowel sounds is closely tied to reading skills. To address this, an AR-based pronunciation training app has been developed, based on linguistic theory and with a focus on usability for students learning English as a second language. The app is implemented using a Microsoft HoloLens head-mounted display and provides an AR-based learning experience. This study describes the factors that led to the development of the AR-based pronunciation app. This is an app that allows a user to be assessed on the pronunciation of selected 3D learning objects and receive meaningful feedback. As hardware advances and becomes more widely available, realistic holograms will be created. This will enable better technology integration with the physical world and more intuitive input methods. This will further enhance the user experience and increase technology acceptance.

This document is the result of the research supported by European Union’s Horizon 2020 research and innovation program under grant agree-ment No 856533, project ARETE.