Hrishikesh Mulay
ABSTRACT
Existing research indicates that immersive technology will greatly influence the pedagogical practices in the coming years. Due to the visual nature of the XR (eXtended Reality) applications, lack of auditory support systems and high dependence on physical gestures and movements makes immersive tech inaccessible for people with special needs. However, the increasing influence and rise of the Metaverse has instigated an urgency to make XR environments accessible from the vulnerable segments of the society. Deaf and Hard of Hearing (DHH) participants often face social challenges such as illiteracy, unemployment, lack of growth in personal and professional life and social isolation. Recent advancements in Machine Learning have opened opportunities to perform Automated Lip Reading (ALR), which could be used as an assistive tool by DHH people within the Metaverse. This work in progress aspires to contribute towards the implementation of ALR systems in XR educational environments, and provide an ethically aligned design and standardization in its implementation, with ultimate aim to enhance accessibility measures in immersive technologies.
Index Terms
- Automated Lip Reading: Potential to enhance accessibility in XR
Recommendations
Machine-Learning-Based Accessibility System
AbstractAccessing the internet presents considerable difficulties for those with impairments. They frequently have physical constraints that prevent them from using conventional input devices like a mouse or keyboard. However, without the use of ...
Lip reading of hearing impaired persons using HMM
This paper describes a method for lip reading of hearing impaired persons. The term lip reading refers to recognizing the spoken words using visual speech information such as lip movements. The visual speech video of the hearing impaired person is given ...
Easy Reading – Keeping the User at the Digital Original: Assessment and Potential Use of Easy Reading for Digital Accessibility
Universal Access in Human-Computer InteractionAbstractDigital access is essential to participation and everyday life in our digitized society and education [1]. Various laws and guidelines (e.g., UN-CRPD, WCAG) underline the importance of accessibility of new information and communication ...
Comments