ABSTRACT
This paper explores the emerging field of human-embedded medical technology and its accompanying need for innovative user experience (UX) design. Specifically, the paper argues that, in the medium term, augmented reality (AR) can effectively serve as one part of a multimodal user interface (UI) for diabetes patients with embedded control systems for an artificial pancreas (AP). The paper explores what types of cross-disciplinary information UX designers will need in order to incorporate AR into an effective multimodal interface for diabetes patients with an AP. Currently, researchers are developing methods to embed continuous glucose monitors (CGM), model predictive control (MPC) systems, and AP systems into diabetes patients to regulate their blood sugar levels [30]. Ideally, an embedded control in a wearable medical device would remove the need for users to interact with the system because the system would self-regulate. However, once embedded, not only will a physician/technician need to initialize and adjust the system, but, ethically and practically, patients will also need access to the system. In the medium-term future (5-10 years), AR-with its emphasis on cross-disciplinary design needs-shows promise for conveying visual information most effectively to the patient. This paper addresses the interdisciplinary nature of conveying user information for embedded medical devices because it demonstrates the need for UX designers to integrate recent advancements in healthcare research, medical technology, cross-disciplinary design theory (e.g. human factors and effective use theory), and the rapidly changing nature of human-computer interaction (HCI).
- Dieter Bohn. 2018. Intel made smart glasses that look normal: Exclusive first look at Vaunt, which uses retinal projection to put a display in your eyeball. The Verge. February 5. https://www.theverge.com/2018/2/5/16966530/intel-vaunt-smart-glasses-announced-ar-videoGoogle Scholar
- Andrew Burton-Jones and Camille Grange. 2013. From use to effective use: A representation theory perspective. Information Systems Research. 24 (3). September. 632--658.Google Scholar
- CDC (Centers for Disease Control and Prevention). 2017. Estimates of diabetes and its burden in the United States. National Diabetes Statistics Report. http://www.diabetes.org/assets/pdfs/basics/cdc-statistics-report-2017.pdfGoogle Scholar
- CDRH (Center for Devices and Radiological Health) HHS (U.S. Department of Health and Human Services) FDA (Food and Drug Administration) ODE (Office of Device Evaluation). 2016. Applying human factors and usability engineering to medical devices: Guidance for industry and Food and Drug Administration staff. February 3. https://www.fda.gov/downloads/MedicalDevices/.../UCM259760.pdfGoogle Scholar
- Wonchan Choi and Bengisu Tulu. 2017. Effective use of user interface and user experience in an mHealth application. Proceedings of the 50th Hawaii International Conference on System Sciences. 3803--3812.Google ScholarCross Ref
- Steffi L. Colyer and Polly M. McGuigan. 2018. Textile electrodes embedded in clothing: A practical alternative to traditional surface electromyography when assessing muscle excitation during functional movements. Journal of Sports Science and Medicine.17. March. 101--109.Google Scholar
- Josh Constine. 2017. Zuckerberg shows off Oculus gloves for typing in AR. TechCrunch, February 9. https://techcrunch.com/2017/02/09/oculus-gloves/Google Scholar
- R. Jordan Crouser, Lyndsey Franklin, Alex Endert and Kris Cook. 2017. Theoretical techniques for measuring the use of human effort in visual analytic systems. IEEE Transactions on Visualization and Computer Graphics. 23 (1). January. 121-130. Google ScholarDigital Library
- FDA (U.S. Food and Drug Administration). 2018. What is the pancreas? What is an artificial pancreas device system? https://www.fda.gov/MedicalDevices/ProductsandMedicalProcedures/HomeHealthandConsumer/ConsumerProducts/ArtificialPancreas/ucm259548.htmGoogle Scholar
- Wilbert O. Galitz. 2007. The essential guide to user interface design: An introduction to GUI design principles and techniques. Indianapolis, IN: Wiley Publishing. Google ScholarDigital Library
- Dave Gershgorn. 2015. Facebook CEO says telepathy is coming after virtual reality; Zuckerberg says you'll be able to share emotions virtually 'one day'. Popular Science. June 30. https://www.popsci.com/facebook-ceo-says-telepathy-coming-after-virtual-realityGoogle Scholar
- David Goldman. 2014. Google to make smart contact lenses. CNN Money. January 17. http://money.cnn.com/2014/01/17/technology/innovation/google-contacts/Google Scholar
- Meron Gribetz. 2016. A glimpse of the future through an augmented reality headset. TED Talks. April 11. https://www.youtube.com/watch?v=H9ZOpQzjukY&t=6m49sGoogle Scholar
- Matthew G. Hanna, Ishtiaque Ahmed, Jeffrey Nine, Shyam Prajapati, and Liron Pantanowitz. 2018. Augmented reality technology using Microsoft HoloLens in anatomic pathology. Archives of Pathology and Laboratory Medicine. 142. May. 638--644.Google Scholar
- Kendall Ho, Christopher Yao, and Helen Novak Lauscher. 2017. Health apps, wearables, and sensors: The advancing frontier of digital health. BC Medical Journal. 59 (10). December. 503--506.Google Scholar
- Michio Kaku. 2011. Physics of the future: How science will shape human destiny and our daily lives by the Year 2100. NY: Doubleday. Google ScholarDigital Library
- Ljilja Kascak, Claudia B. Rébola, Richard Braunstein and Jon A. Sanford. 2013. Icon design for user interface of remote patient monitoring mobile devices. Proceedings of the 31st ACM International Conference on Design of Communication. September 9. 77--84. Google ScholarDigital Library
- Leo Kobayashi, Xiao Chi Zhang, Scott A. Collins, Naz Karim, and Derek L. Merck. 2018. Exploratory application of augmented reality/mixed reality devices for acute care procedure training. Western Journal of Emergency Medicine. 19 (1). January. 158--164.Google Scholar
- LAFORGE Optical. 2018. Meet Shima. https://laforgeoptical.com/pages/meet-shimaGoogle Scholar
- Jason Lim. 2016. Vue could be the smart glasses you'll actually want to wear. Forbes. December 7. https://www.forbes.com/sites/jlim/2016/12/07/vue-could-be-the-smart-glasses-youll-actually-want-to-wear/#772bbdc18fd1Google Scholar
- Jonas Löwgren. 2007. Inspirational patterns for embodied interaction. Knowledge, Technology and Policy.20. 165--177.Google ScholarCross Ref
- Medtronic. 2016. MiniMed 630G System User Guide. https://www.medtronicdiabetes.com/sites/default/files/ library/download-library/user-guides/MP6026157-011_b.pdfGoogle Scholar
- Medtronic. 2018. MiniMed 670G Insulin Pump System. https://www.medtronicdiabetes.com/products/minimed-670g-insulin-pump-systemGoogle Scholar
- Lisa Melonçon and Erin A. Frost. 2015. The rhetorics of health and medicine and its importance in communication design. Communication Design Quarterly (CDQ). 3 (4). August. 7--14. Google ScholarDigital Library
- Reuters. 2016. Sony filed a patent for video-recording contact lens: You could one day shoot video with the blink of an eye. Huffington Post. April 28. https://www.huffingtonpost.com/entry/sony-contact-lens-camera_us_57220fc6e4b0f309baefd3f2Google Scholar
- Noel E. Schaeffer. 2012. The role of human factors in the design and development of an insulin pump. Journal of Diabetes Science and Technology. 6 (2). March. 260--264.Google ScholarCross Ref
- David Canfield Smith, Charles Irby, Ralph Kimball, Bill Verplank and Eric Harslem. 1982. Designing the Xerox 'Star' user interface. BYTE Publications. April. 242--282.Google Scholar
- EunYoung Song. 2017. Brain-Computer Interface based Neuro-prosthetics. Duke SciPol. May 19. http://scipol.duke.edu/content/brain-computer-interface-based-neuro-prostheticsGoogle Scholar
- TimT. 2014. My early thoughts on the Tandem t:slim pump. TimT's Diabetic Life. October 20. http://mylifediabetic.blogspot.com/2014/10/my-early-thoughts-on-tandem-tslim-pump.htmlGoogle Scholar
- Stamatina Zavitsanou, Ankush Chakrabarty, Eyal Dassau and Francis J. Doyle III. 2016. Embedded control in wearable medical devices: Application to the artificial pancreas. Processes, 4 (35).Google Scholar
- M. Y. Zhao, S. K. Ong, and A. Y. C. Nee. 2016. An augmented reality-assisted therapeutic healthcare exercise system based on bare-hand interaction. International Journal of Human-Computer Interaction. 32 (9). 708--721Google ScholarCross Ref
Recommendations
Augmented Winter Ski with AR HMD
AH '16: Proceedings of the 7th Augmented Human International Conference 2016At time of writing, several affordable Head-Mounted Displays (HMD) are going to be released to the mass market, most of them for Virtual Reality (VR with Oculus Rift, Samsung Gear...) but also for indoor Augmented Reality (AR) with Hololens. We have ...
Comparative Study of HMD-based Virtual and Augmented Realities for Immersive Museums: User Acceptance, Medium, and Learning
Technologies like Head Mounted Display (HMD)-based Virtual Reality (VR) and Augmented Reality (AR) have made HMD-based immersive museums possible. To investigate the user acceptance, medium, and interaction experience for HMD-based immersive museums, an ...
A comparison of natural user interface and graphical user interface for narrative in HMD-based augmented reality
AbstractOver the years, the various mediums available for storytelling have progressively expanded, from spoken to written word, then to film, and now to Virtual Reality (VR) and Augmented Reality (AR). In 2016, the cutting-edge Head-Mounted Display (HMD) ...
Comments