Hiroo Aoyama
ABSTRACT
Occupational therapists (OTs) support people with physical impairments and disabilities (PwIDs) to maintain their functional independence by suggesting home modifications that incorporate assistive technologies (ATs). Augmented reality (AR) systems can support home-modification processes by superimposing 3D items (e.g., ATs) onto real environments (e.g., in homes). In this paper, we report on evaluating a tablet-based AR application for use by OTs to facilitate envisioning the most appropriate scenarios for AT purchase, installation, and use in PwIDs homes. We conducted in situ user studies with ten OTs to evaluate the AR tool and identified the following advantages of using AR in home-modification processes: (1) providing visual clues (AT fit, size, function, and appearance) in the home, (2) supporting collaborative home-modification decision-making processes, (3) facilitating a holistic home-modification approach, and (4) involving stakeholders throughout the home-modification processes. Also, we discuss the lessons learned regarding the usability, usefulness, and future iterations of the AR home-modification tool.
- Hiroo Aoyama and Leila Aflatoony. 2020. HomeModAR: A Home Intervention Augmented Reality Tool for Occupational Therapists. In CHI, ACM, 1–7. DOI: https://doi.org/10.1145/3334480.3382993Google Scholar
- Patricia A. Arean, Kevin A. Hallgren, Joshua T. Jordan, Adam Gazzaley, David C. Atkins, Patrick J. Heagerty, and Joaquin A. Anguera. 2016. The use and effectiveness of mobile apps for depression: Results from a fully remote clinical trial. J. Med. Internet Res. (2016). DOI:https://doi.org/10.2196/jmir.6482Google Scholar
- Y. Ariadi, R. I. Campbell, M. A. Evans, and I. J. Graham. 2012. Combining additive manufacturing with computer aided consumer design. In 23rd Annual International Solid Freeform Fabrication Symposium - An Additive Manufacturing Conference, SFF 2012.Google Scholar
- Assistive Technology Industry Association. 2014. What is Assistive Technology? How Is It Funded? atia.org.Google Scholar
- Richard Atterer, Monika Wnuk, and Albrecht Schmidt. 2006. Knowing the user's every move: User activity tracking for website usability evaluation and implicit interaction. In Proceedings of the 15th International Conference on World Wide Web. DOI:https://doi.org/10.1145/1135777.1135811Google ScholarDigital Library
- Anita Atwal, Arthur Money, and Michele Harvey. 2014. Occupational therapists’ views on using a virtual reality interior design application within the pre-discharge home visit process. J. Med. Internet Res. (2014). DOI:https://doi.org/10.2196/jmir.3723Google Scholar
- Michael Lo Bianco, Sonja Pedell, and Gianni Renda. 2016. A Health industry perspective on augmented reality as a communication tool in elderly fall prevention. In ACM International Conference Proceeding Series. DOI:https://doi.org/10.1145/2996267.2996268Google ScholarDigital Library
- Leonardo Bonanni, Chia-Hsun Jackie Lee, and Ted Selker. 2004. CounterIntelligence: Augmented Reality Kitchen. In Association for Computing Machinery (ACM).Google Scholar
- Erin Buehler, Stacy Branham, Abdullah Ali, Jeremy J. Chang, Megan Kelly Hofmann, Amy Hurst, and Shaun K. Kane. 2015. Sharing is caring: Assistive technology designs on thingiverse. In Conference on Human Factors in Computing Systems - Proceedings. DOI:https://doi.org/10.1145/2702123.2702525Google Scholar
- Erin Buehler, Shaun K. Kane, and Amy Hurst. 2014. ABC and 3D: Opportunities and obstacles to 3D printing in special education environments. In ASSETS14 - Proceedings of the 16th International ACM SIGACCESS Conference on Computers and Accessibility. DOI:https://doi.org/10.1145/2661334.2661365Google Scholar
- R. I. Campbell, D. J. De Beer, L. J. Barnard, G. J. Booysen, M. Truscott, R. Cain, M. J. Burton, D. E. Gyi, and R. Hague. 2007. Design evolution through customer interaction with functional prototypes. J. Eng. Des. (2007). DOI:https://doi.org/10.1080/09544820601178507Google Scholar
- Xiang Anthony Chen, Jeeeun Kim, Jennifer Mankoff, Tovi Grossman, Stelian Coros, and Scott E. Hudson. 2016. Reprise: A design tool for specifying, generating, and customizing 3D printable adaptations on everyday objects. In UIST 2016 - Proceedings of the 29th Annual Symposium on User Interface Software and Technology. DOI:https://doi.org/10.1145/2984511.2984512Google Scholar
- Ashley Colley, Juho Rantakari, and Jonna Häkkilä. 2014. Augmenting the home to remember - Initial user perceptions. In UbiComp 2014 - Adjunct Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. DOI:https://doi.org/10.1145/2638728.2641717Google Scholar
- Robert G. Cumming, Margaret Thomas, George Szonyi, Glenn Salkeld, Elizabeth O'Neill, Christine Westbury, and Gina Frampton. 1999. Home visits by an occupational therapist for assessment and modification of environmental hazards: A randomized trial of falls prevention. J. Am. Geriatr. Soc. (1999). DOI:https://doi.org/10.1111/j.1532-5415.1999.tb01556.xGoogle Scholar
- Emma Dixon. 2019. Understanding the occupational therapists method to inform the design of technologies for people with dementia. In Conference on Human Factors in Computing Systems - Proceedings. DOI:https://doi.org/10.1145/3290607.3308453Google ScholarDigital Library
- Tom Djajadiningrat, Pei Yin Chao, Seyoung Kim, Marleen Van Leengoed, and Jeroen Raijmakers. 2016. Mime: An AR-based system helping patients to test their blood at home. In DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse. DOI:https://doi.org/10.1145/2901790.2901915Google ScholarDigital Library
- Wei Gao, Yunbo Zhang, Devarajan Ramanujan, Karthik Ramani, Yong Chen, Christopher B. Williams, Charlie C.L. Wang, Yung C. Shin, Song Zhang, and Pablo D. Zavattieri. 2015. The status, challenges, and future of additive manufacturing in engineering. CAD Comput. Aided Des. (2015). DOI:https://doi.org/10.1016/j.cad.2015.04.001Google Scholar
- Laura N. Gitlin, Ruth L. Schemm, Lisa Landsberg, and Desirée Burgh. 1996. Factors predicting assistive device use in the home by older people following rehabilitation. J. Aging Health (1996). DOI:https://doi.org/10.1177/089826439600800405Google Scholar
- Megan Hofmann, Kristin Williams, Toni Kaplan, Stephanie Valencia, Gabriella Hann, Scott E. Hudson, Jennifer Mankof, and Patrick Carrington. 2019. “Occupational therapy is making”: Clinical rapid prototyping and digital fabrication. In Conference on Human Factors in Computing Systems - Proceedings. DOI:https://doi.org/10.1145/3290605.3300544Google ScholarDigital Library
- Karen Holtzblatt and Hugh Beyer. 2017. The Affinity Diagram. In Contextual Design. DOI:https://doi.org/10.1016/b978-0-12-800894-2.00006-5Google Scholar
- Amy Hurst and Jasmine Tobias. 2011. Empowering individuals with do-it-yourself assistive technology. In ASSETS’11: Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility. DOI:https://doi.org/10.1145/2049536.2049541Google ScholarDigital Library
- Pascal Knierim, Paweł W. Woźniak, Yomna Abdelrahman, and Albrecht Schmidt. 2019. Exploring the potential of augmented reality in domestic environments. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2019. DOI:https://doi.org/10.1145/3338286.3340142Google ScholarDigital Library
- Jin Lee, Ha Na Yoo, and Byoung Hee Lee. 2017. Effects of augmented reality-based Otago exercise on balance, gait, and physical factors in elderly women to prevent falls: A randomized controlled trial. J. Phys. Ther. Sci. (2017). DOI:https://doi.org/10.1589/jpts.29.1586Google Scholar
- Xun Luo, Tiffany Kline, Heidi C. Fischer, Kathy A. Stubblefield, Robert V. Kenyon, and Derek G. Kamper. 2005. Integration of augmented reality and assistive devices for post-stroke hand opening rehabilitation. In Annual International Conference of the IEEE Engineering in Medicine and Biology - Proceedings. DOI:https://doi.org/10.1109/iembs.2005.1616080Google Scholar
- A.G. Money, S. Fernando, L. Lines, and A.D. Elliman. 2009. Developing and evaluating web-based assistive technologies for older adults. Gerontechnology (2009). DOI:https://doi.org/10.4017/gt.2009.08.03.013.00Google Scholar
- Jeremiah Parry-Hill, Patrick C. Shih, Jennifer Mankoff, and Daniel Ashbrook. 2017. Understanding volunteer AT fabricators: Opportunities and challenges in DIY-AT for others in e-NABLE. In Conference on Human Factors in Computing Systems - Proceedings. DOI:https://doi.org/10.1145/3025453.3026045Google ScholarDigital Library
- Monica Perusquía-Hernández, Hella Kriening, Carina Palumbo, and Barbara Wajda. 2014. User-centered design of a lamp customization tool. In ACM International Conference Proceeding Series. DOI:https://doi.org/10.1145/2582051.2582087Google ScholarDigital Library
- Helen Petrie, Stefan Carmien, and Andrew Lewis. 2018. Assistive technology abandonment: Research realities and potentials. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). DOI:https://doi.org/10.1007/978-3-319-94274-2_77Google Scholar
- Viet Toan Phan and Seung Yeon Choo. 2010. Interior Design in Augmented Reality Environment. Int. J. Comput. Appl. (2010). DOI:https://doi.org/10.5120/912-1290Google ScholarCross Ref
- Betsy Phillips and Hongxin Zhao. 1993. Predictors of Assistive Technology Abandonment. Assist. Technol. (1993). DOI:https://doi.org/10.1080/10400435.1993.10132205Google Scholar
- Halley P. Profita, Abigale Stangl, Laura Matuszewska, Sigrunn Sky, and Shaun K. Kane. 2016. Nothing to hide: Aesthetic customization of hearing AIDS and cochlear implants in an online community. In ASSETS 2016 - Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. DOI:https://doi.org/10.1145/2982142.2982159Google Scholar
- Ahmad M. Qamar, Ahmed Riaz Khan, Syed Osama Husain, Md Abdur Rahman, and Saleh Basalamah. 2015. A multi-sensory gesture-based occupational therapy environment for controlling home appliances. In ICMR 2015 - Proceedings of the 2015 ACM International Conference on Multimedia Retrieval. DOI:https://doi.org/10.1145/2671188.2749412Google ScholarDigital Library
- McCombe Waller Sandy, Samantha McDonald, Niara Comrie, Erin Buehler, Nicholas Carter, Braxton Dubin, Karen Gordes, and Amy Hurst. 2016. Uncovering challenges and opportunities for 3D printing assistive technology with physical therapists. In ASSETS 2016 - Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. DOI:https://doi.org/10.1145/2982142.2982162Google Scholar
- Joon Gi Shin, Gary Ng, and Daniel Saakes. 2018. Couples Designing their Living Room Together. DOI:https://doi.org/10.1145/3174910.3174930Google Scholar
- Alex Toh, Li Jiang, and Eng Keong Lua. 2011. Augmented reality gaming for Rehab@Home. In i-CREATe 2011 - International Convention on Rehabilitation Engineering and Assistive Technology.Google Scholar
- Leena Ventä-Olkkonen, Jonna Häkkilä, and Kaisa Väänänen-Vainio-Mattila. 2014. Exploring the augmented home window-user perceptions of the concept. In ACM International Conference Proceeding Series. DOI:https://doi.org/10.1145/2677972.2677994Google Scholar
- World health organization. 2020. Retrieved January 2, 2020 from https://www.who.int/news- room/fact-sheets/detail/assistive-technologyGoogle Scholar
Recommendations
HomeModAR: A Home Intervention Augmented Reality Tool for Occupational Therapists
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing SystemsThis paper reports on the exploration of a tablet-based augmented reality (AR) application for use by occupational therapists (OTs). The application enables OTs to support individuals with physical impairment and disability when making home ...
Augmented reality and home modifications: a tool to empower older adults in fall prevention
OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human InteractionThe ability for older adults to comprehend fall preventative home modifications is critical to achieve empowering outcomes. Existing design methods limit older individuals' ability to see their goals reflected in fall prevention practice and service. ...
An Assistive Technology Prescription Tool for Novice Occupational Therapy Practitioners
OzCHI '23: Proceedings of the 35th Australian Computer-Human Interaction ConferenceOccupational therapy practitioners (OTPs) frequently recommend assistive technologies (ATs) to help individuals with physical impairments and disabilities in their daily activities. However, providing AT recommendations can be challenging for ...
Comments