Abstract
People with central vision loss may become unable to see facial expressions during face-to-face conversations. Nuances in interpersonal communication conveyed by those expressions can be captured by computer vision systems and conveyed via an alternative input to the user. We present a low-cost system using commodity hardware that serves as a communication aid for people with central vision loss. Our system uses a smartphone in a head-mounted-display to capture images of a conversation partner’s face, analyze the face expressions, and display a detected emotion in the corner of the display where the user retains vision senses. In contrast to purpose-built devices that are expensive, this system could be made available to a wider group of potential users, including those in developing countries.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Profita, H., Albaghli, R., Findlater, L., Jaeger, P., Kane, S.K.: The AT effect: how disability affects the perceived social acceptability of head-mounted display use. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 4884–4895. ACM (2016)
Boyd, L.E., Rangel, A., Tomimbang, H., Conejo-Toledo, A., Patel, K., Tentori, M., Hayes, G.R.: SayWAT: augmenting face-to-face conversations for adults with autism. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 4872–4883. ACM (2016)
Williams, K., Moffatt, K., McCall, D., Findlater, L.: Designing conversation cues on a head-worn display to support persons with aphasia. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 231–240. ACM (2015)
Rector, K., Milne, L., Ladner, R.E., Friedman, B., Kientz, J.A.: Exploring the opportunities and challenges with exercise technologies for people who are blind or low-vision. In: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 203–214. ACM (2015)
Affectiva. https://www.affectiva.com/. Accessed 1 Feb 2018
Acknowledgements
The authors wish to thank the Clark University undergraduate summer research program for funding and mentoring this research project. We also wish to thank the program’s anonymous sponsor.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Zuniga, R., Magee, J. (2018). Conversation Aid for People with Low Vision Using Head Mounted Display and Computer Vision Emotion Detection. In: Miesenberger, K., Kouroupetroglou, G. (eds) Computers Helping People with Special Needs. ICCHP 2018. Lecture Notes in Computer Science(), vol 10897. Springer, Cham. https://doi.org/10.1007/978-3-319-94274-2_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-94274-2_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94273-5
Online ISBN: 978-3-319-94274-2
eBook Packages: Computer ScienceComputer Science (R0)