abstract

Jazzy: Leveraging Virtual Reality Layers for Hand-Eye Coordination in Users with Amblyopia

Authors:

Mario Scrocca,

Nicola Ruaro,

Daniele Occhiuto,

Franca GarzottoAuthors Info & Claims

CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: LBW046, Pages 1 - 6

https://doi.org/10.1145/3170427.3188618

Published: 20 April 2018 Publication History

Get Access

Abstract

This paper describes the design and development of Jazzy, a Virtual Reality (VR) application for users with Amblyopia. Jazzy has been designed in collaboration with a target end user of the system from its early stages. Jazzy exploits visual layers to display different contents for each eye on the Head Mounted Display (HMD) screens. In this way, the system becomes a controllable tool to stimulate eyes individually. In addition, taking advantage of the HMD associated controllers, the system is able to track the user in the physical space, enhancing the perceived realism during the VR experience. Users can train hand-eye coordination skills in a more lifelike and engaging manner. Jazzy also provides an interface for caregivers empowering them with a new support tool that can be used alongside classic therapeutic artifacts. In this paper we describe the eye-specific parametric visual stimuli and the caregiver's interface to tune them remotely for plug and play activities that can be experienced at home.This paper describes the design and development of Jazzy, a Virtual Reality (VR) application for users with Amblyopia. Jazzy has been designed in collaboration with a target end user of the system from its early stages. Jazzy exploits visual layers to display different contents for each eye on the Head Mounted Display (HMD) screens. In this way, the system becomes a controllable tool to stimulate eyes individually. In addition, taking advantage of the HMD associated controllers, the system is able to track the user in the physical space, enhancing the perceived realism during the VR experience. Users can train hand-eye coordination skills in a more lifelike and engaging manner. Jazzy also provides an interface for caregivers empowering them with a new support tool that can be used alongside classic therapeutic artifacts. In this paper we describe the eye-specific parametric visual stimuli and the caregiver's interface to tune them remotely for plug and play activities that can be experienced at home.

Supplemental Material

MP4 File - suppl.mov

Supplemental video

Download
18.70 MB

References

[1]

Benjamin T Backus, Tuan Tran, and OD James Blaha. 2017. Clinical use of the Vivid Vision system to treat disorders of binocular vision. (2017).

Google Scholar

[2]

Lakshmi Bodduluri, Mei Ying Boon, Malcolm Ryan, and Stephen J Dain. 2017. Impact of Gamification of Vision Tests on the User Experience. Games for health journal 6, 4 (2017), 229--236.

Google Scholar

[3]

R M Eastgate, G D Griffiths, P E Waddingham, A D Moody, T K H Butler, S V Cobb, I F Comaish, S M Haworth, R M Gregson, I M Ash, and S M Brown. 2006. Modified virtual reality technology for treatment of amblyopia. Eye 20 (2006), 370--374.

Crossref

Google Scholar

[4]

Jonathan M Holmes and Michael P Clarke. 2006. Amblyopia. The Lancet 367, 9519 (2006), 1343--1351.

Google Scholar

[5]

Jonathan M Holmes, Elizabeth L Lazar, B Michele Melia, William F Astle, Linda R Dagi, Sean P Donahue, Marcela G Frazier, Richard W Hertle, Michael X Repka, Graham E Quinn, and others. 2011. Effect of age on response to amblyopia treatment in children. Archives of ophthalmology 129, 11 (2011), 1451--1457.

Google Scholar

[6]

D C Knill. 2010. Combining depth cues for planning and on-line control of reaching movements. Journal of vision 3, 12 (2010), 6--6.

Crossref

Google Scholar

[7]

Jinrong Li, Benjamin Thompson, Daming Deng, Lily YL Chan, Minbin Yu, and Robert F Hess. 2013. Dichoptic training enables the adult amblyopic brain to learn. Current Biology 23, 8 (2013), R308--R309.

Crossref

Google Scholar

[8]

Dean R Melmoth and Simon Grant. 2006. Advantages of binocular vision for the control of reaching and grasping. Experimental brain research. Experimentelle Hirnforschung. Experimentation cerebrale 171, 3 (2006), 371--388.

Google Scholar

[9]

Yuka Sasaki, Jose E Nanez, and Takeo Watanabe. 2010. Advances in visual perceptual learning and plasticity. Nature Reviews Neuroscience 11, 1 (2010), 53--60.

Crossref

Google Scholar

[10]

CM Suttle, Dean R Melmoth, AL Finlay, JJ Sloper, and S Grant. 2011. Eye-hand coordination skills in children with and without amblyopia. Invest Ophthalmol Vis Sci 52, 3 (2011), 1851--64.

Crossref

Google Scholar

[11]

C Wu and DG Hunter. 2006. Amblyopia: diagnostic and therapeutic options. Am J Ophthalmol 141, 1 (2006), 175--184.

Crossref

Google Scholar

[12]

P Ziak, A Holm, J Halicka, P Mojzis, and DP Pinero. 2017. Amblyopia treatment of adults with dichoptic training using the virtual reality oculus rift head mounted display: preliminary results. BMC Ophthalmol 17, 1 (2017), 105.

Crossref

Google Scholar

Cited By

View all

Cui DMousas C(2024)Effects of Tactile Interruption on Hand-Eye Coordination Task Performance2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00024(104-111)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00024
Kini VBallae Ganeshrao SSiddalingaswamy P(2024)Realization of Game Mechanics in Virtual Reality for Amblyopia TreatmentIEEE Access10.1109/ACCESS.2024.347221712(145018-145037)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3472217
Li YKim KErickson ANorouzi NJules JBruder GWelch G(2022)A Scoping Review of Assistance and Therapy with Head-Mounted Displays for People Who Are Visually ImpairedACM Transactions on Accessible Computing10.1145/352269315:3(1-28)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1145/3522693
Show More Cited By

Index Terms

Jazzy: Leveraging Virtual Reality Layers for Hand-Eye Coordination in Users with Amblyopia
1. Information systems
  1. Information systems applications
    1. Multimedia information systems
2. Social and professional topics

Recommendations

Insights for More Usable VR for People with Amblyopia
ASSETS '19: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility

Amblyopia, or "lazy eye" is the world's most common neurological eye disorder. Yet, very little has been done looking into how to make virtual reality (VR) more usable for people with Amblyopia. Furthermore, a trend of using VR for Amblyopia therapy has ...
AmblyopiaVR: Immersive Game-based Virtual Reality System for the Treatment of Amblyopia
ACSW '20: Proceedings of the Australasian Computer Science Week Multiconference

Amblyopia is a childhood condition in which best-corrected visual acuity in one eye is poorer than the other. Current treatments involve forcing the brain to privilege the affected eye, usually by blocking vision through the better one. Few studies have ...
Quantification of adaptation to virtual-eye location in see-thru head-mounted displays
VRAIS '95: Proceedings of the Virtual Reality Annual International Symposium (VRAIS'95)

An experiment was conducted on the effect of a prototype see-thru head-mounted display (HMD) on visuo-motor adaptation. When wearing video see-thru HMDs in augmented reality systems, subjects see the world around them through a pair of head-mounted ...

Comments

Information & Contributors

Information

Published In

CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

3155 pages

ISBN:9781450356213

DOI:10.1145/3170427

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2018

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI EA '18 Paper Acceptance Rate 1,208 of 3,955 submissions, 31%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
303
Total Downloads

Downloads (Last 12 months)23
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cui DMousas C(2024)Effects of Tactile Interruption on Hand-Eye Coordination Task Performance2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00024(104-111)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00024
Kini VBallae Ganeshrao SSiddalingaswamy P(2024)Realization of Game Mechanics in Virtual Reality for Amblyopia TreatmentIEEE Access10.1109/ACCESS.2024.347221712(145018-145037)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3472217
Li YKim KErickson ANorouzi NJules JBruder GWelch G(2022)A Scoping Review of Assistance and Therapy with Head-Mounted Displays for People Who Are Visually ImpairedACM Transactions on Accessible Computing10.1145/352269315:3(1-28)Online publication date: 19-Aug-2022
https://dl.acm.org/doi/10.1145/3522693
George CBuschek DNgao AKhamis M(2020)GazeRoomLock: Using Gaze and Head-Pose to Improve the Usability and Observation Resistance of 3D Passwords in Virtual RealityAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-58465-8_5(61-81)Online publication date: 7-Sep-2020
https://dl.acm.org/doi/10.1007/978-3-030-58465-8_5
Hurd OKurniawan SBigham JAzenkot SKane S(2019)Insights for More Usable VR for People with AmblyopiaProceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3308561.3356110(706-708)Online publication date: 24-Oct-2019
https://dl.acm.org/doi/10.1145/3308561.3356110

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

Supplemental Material

References

Cited By

Index Terms

Recommendations

Insights for More Usable VR for People with Amblyopia

AmblyopiaVR: Immersive Game-based Virtual Reality System for the Treatment of Amblyopia

Quantification of adaptation to virtual-eye location in see-thru head-mounted displays

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations