Abstract
Augmented and Mixed Reality technology provides to the medical field the possibility for seamless visualization of text-based physiological data and various graphical 3D data onto the patient’s body. This allows improvements in diagnosis and treatment of patients. For the patient, this technology offers benefits and further potential in therapy, rehabilitation and diagnosis, and explanation. Applications across the whole range of functions that affect the health sector from the physician, the medical student, to the patients are possible. However, the quality of the work of medical professionals is considerably influenced by both usefulness and usability of technology. Consequently, key issues in developing such applications are the tracking methodology, the display technology and most of all ensuring good usability. There have been several research groups who extended the state of the art in employing these technologies in the medical domain. However, only a few are addressing issues of Human-Computer Interaction, Interaction Design, and Usability Engineering. This paper provides a brief overview over the history and the most recent developments in this domain with a special focus on issues of user-centered development.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bajura, M., Fuchs, H., Ohbuchi, R.: Merging Virtual Objects with the Real World: Seeing Ultrasound Imagery within the Patient. In: Proceedings of SIGGRAPH 1992. Computer Graphics, vol. 26, pp. 203–210 (1992)
State, A., McAllister, J., Neumann, U., Chen, H., Cullip, T., Chen, D.T., Fuchs, H.: Interactive Volume Visualization on a Heterogeneous Message-Passing Multicomputer. In: Proceedings of the 1995 ACM Symposium on Interactive 3D Graphics (Monterey, CA, April 9-12, 1995), Special issue of Computer Graphics, ACM SIGGRAPH, New York, pp. 69–74 (1995) Also UNC-CH Dept. of Computer Science technical report TR94-040, 1994
State, A., Chen, D.T., Tector, C., Brandt, A., Chen, H., Ohbuchi, R., Bajura, M., Fuchs, H.: Case Study: Observing a Volume-Rendered Fetus within a Pregnant Patient. In: Proceedings of IEEE Visualization 1994, pp. 364–368. IEEE Computer Society Press, Los Alamitos (1994)
State, A., Livingston, M.A., Hirota, G., Garrett, W.F., Whitton, M.C., Fuchs, H., Pisano, E.D.: Technologies for Augmented-Reality Systems: realizing Ultrasound-Guided Needle Biopsies. In: ACM SIGGRAPH. Proceedings of SIGGRAPH 1996 (New Orleans, LA, August 4-9, 1996). In Computer Graphics Proceedings, Annual Conference Series, pp. 439–446 (1996)
State, A., Keller, K., Fuchs, H.: Simulation-Based Design and Rapid Prototyping for a Pallax-Free, Orthoscopic Video See-Through Head-Mounted Display. In: Proc. ISMAR 2005, pp. 28–31 (2005)
Fuchs, H., Livingston, M.A., Raskar, R., Colucci, D., Keller, K., State, A., Crawford, J.R., Rademacher, P., Drake, S.H., Anthony, A., Meyer, M.D.: Augmented Reality Visualization for Laparoscopic Surgery. In: Wells, W.M., Colchester, A.C.F., Delp, S.L. (eds.) MICCAI 1998. LNCS, vol. 1496, pp. 11–13. Springer, Heidelberg (1998)
Stockmans, F.: Preoperative 3D virtual planning and surgery for the treatment of severe madelung’s deformity. In: Proc of Societe Francaise Chirurgie de la main, XLI Congres, vol. CP3006, pp. 314–317 (2005)
State, A., Keller, K., Rosenthal, M., Yang, H., Ackerman, J., Fuchs, H.: Stereo Imagery from the UNC Augmented Reality System for Breast Biopsy Guidance. In: Proc. MMVR 2003 (2003)
Southern, S.J., Shamsian, N., Wilkinson, S.: Real hand© - A 3-dimensional interactive web-based hand model - what is the role in patient education? In: XLIe Congrès national de la Société Française de Fhirurgie de la Fain, Paris (France), (15-17December, 2005)
Shuhaiber, J.H.: Augmented Reality in Surgery. ARCH SURG 139, 170–174 (2004)
Grimson, W.E.L., Lozano-Perez, T., Wells III, W.M., Ettinger, G.J., White, S.J., Kikinis, R.: An Automatic Registration Method for Frameless Stereotaxy, Image Guided Surgery, and Enhanced Reality Visualization. In: Computer Vision and Pattern Recognition Conference, Seattle (June 1994)
Morgan, F.: Developing a New Medical Augmented Reality System. Tech. report CMU-RI-TR-96-19, Robotics Institute, Carnegie Mellon University, (May 1996)
Schwald, B., Seibert, H., Weller, T.: A Flexible Tracking Concept Applied to Medical Scenarios Using an AR Window. In: ISMAR 2002 (2002)
Schnaider, M., Schwald, B.: Augmented Reality in Medicine – A view to the patient’s inside. Computer Graphic topics, Issue 1, INI-GraphicsNet Foundation, Darmstadt (2004)
International Workshop on Medical Imaging and Augmented Reality (MIAR), http://www.miar.info
Fischer, J., Bartz, D., Straßer, W.: Occlusion Handling for Medical Augmented Reality. In: VRST. Proceedings of the ACM symposium on Virtual reality software and technology, Hong Kong (2004)
Sielhorst, T., Obst, T., Burgkart, R., Riener, R., Navab, N.: An Augmented Reality Delivery Simulator for Medical Training. In: International Workshop on Augmented Environments for Medical Imaging - MICCAI Satellite Workshop (2004)
Birkfellner, W.M., Figl, K., Huber, F., Watzinger, F., Wanschitz, R., Hanel, A., Wagner, D., Rafolt, R., Ewers, H., Bergmann, H.: The Varioscope AR – A head-mounted operating microscope for Augmented Reality. In: Proc. of the 3rd International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 869–877 (2000)
Reitinger, B., Werlberger, P., Bornik, A., Beichel, R., Schmalstieg, D.: Spatial Measurements for Mecial Augmented Reality. In: ISMAR 2005. Proc. of the 4th IEE and ACM International Symposium on Mixed and Augmented Reality, pp. 208–209 (October 2005)
Riva, G., Morganti, F., Villamira, M.: Immersive Virtual Telepresence: Virtual Reality meets eHealth. In: Cybertherapy-Internet and Virtual Reality as Assessment and Rehabilitation Tools for Clinical Psychology and Neuroscience, IOS Press, Amsterdam (2006)
Nischelwitzer, A., Lenz, F.J., Searle, G., Holzinger, A.: Some Aspects of the Development of Low-Cost Augmented Reality Learning Environments as Examples for Future Interfaces in Technology Enhanced Learning. In: Universal Access to Applications and Services. LNCS, vol. 4556, pp. 728–737. Springer, New York
Juan, M.C., Alcaniz, M., Monserrat, C., Botella, C., Banos, R.M., Guerrero, B.: Using Augmented Reality to Treat Phobias. IEEE Comput. Graph. Appl. 25, 31–37 (2005)
Gaggioli, A., Morganti, F., Meneghini, A., Alcaniz, M., Lozano, J.A., Montesa, J., Martínez, J.M., Walker, R., Lorusso, I., Riva, G.: Abstracts from CyberTherapy 2005 The Virtual Mirror: Mental Practice with Augmented Reality for Post-Stroke Rehabilitation. CyberPsychology & Behavior 8(4) (2005)
Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd (2005)
Maurer, H., Oliver, R.: The future of PCs and implications on society. Journal of Universal Computer Science 9(4), 300–308 (2003)
del Valle, A., Opalach, A.: The Persuasive Mirror: Computerized Persuasion for Healthy Living. In: Proceedings of Human Computer Interaction International, HCI International, Las Vegas, US (July 2005)
Nestler, S., Dollinger, A., Echtler, F., Huber, M., Klinker, G.: Design and Development of Virtual Patients. In: 4th Workshop VR/AR, Weimar (15 July, 2007)
Elkin, P.L., Sorensen, B., De Palo, D., Poland, G., Bailey, K.R., Wood, D.L., LaRusso, N.F.: Optimization of a research web environment for academig internal medicine faculty. Journal of the American Medical Informatics Association 9(5), 472–478 (2002)
Hesse, B.W., Shneiderman, B.: eHealth research from the user’s perspective. American Journal of Preventive Medicine 32(5), 97–103 (2007)
Rhodes, M.L.: Computer Graphics and Medicine: A Complex Partnership IEEE. Computer Graphics and Applications 17(1), 22–28 (1997)
Holzinger, A., Geierhofer, R., Ackerl, S., Searle, G.: CARDIAC@VIEW: The User Centered Development of a new Medical Image Viewer. In: Zara, J.S.J. (ed.) Central European Multimedia and Virtual Reality Conference (available in Eurographics Library), pp. 63–68, Czech Technical University (2005)
Holzinger, A.: Usability Engineering for Software Developers. Communications of the ACM 48(1), 71–74 (2005)
Gould, J.D., Lewis, C.: Designing for usability: key principles and what designers think. Communications of the ACM 28(3), 300–331 (1985)
Seffah, A., Metzker, E.: The obstacles and myths of usability and software engineering. Communications of the ACM 47(12), 71–76 (2004)
Sutcliffe, A., Gault, B., Shin, J.E.: Presence, memory and interaction in virtual environments. International Journal of Human-Computer Studies 62(3), 307–332 (2005)
Wilson, J.R., D’Cruz, M.: Virtual and interactive environments for work of the future. International Journal of Human-Computer Studies 64(3), 158–169 (2006)
Dünser, A., Grassert, R., Seichter, H., Billinghurst, M.: Applying HCI principles to AR systems design. In: MRUI 2007. 2nd International Workshop at the IEEE Virtual Reality 2007 Conference, Charlotte, North Carolina, USA (March 11, 2007)
Billinghurst, M.: Designing for the masses. INTERFACE HITLabNZ, Issue 14 (July2007)
Gabbard, D.H., Swan, J.E.: User-centered design and evaluation of virtual environments. IEEE Computer Graphics and Applications 19(6), 51–59 (1999)
Freeman, S.E.A., Pearson, D.E., Ijsselsteijn, W.A.: Effects of sensory information and prior experience on direct subjective ratings of presence. Presence Teleoperators and Virtual Environments 8, 1–13 (1999)
Kalawsky,: VRUSE A computerised diagnostic tool for usability evaluation of virtual/synthetic environment systems. Applied Ergonomics 30(1), 11–25 (1999)
Bowman, D., Hodges, L.: An Evaluation of Techniques for Grabbing and Manipulating Remote Objects in Immersive Virtual Environment. In: Proceedings of the ACM Symposium on Interactive 3D Graphics, ACM Press, New York (1997)
Slater, M., Linakis, V., Usoh, M., Kooper, R.: Immersion, Presence and Performance in Virtual Environments: An Experiment Using Tri-Dimensional Chess. Available online at www.cs.ucl.ac.uk/ staff/m.slater/Papers/Chess/index.html (1996)
Lombard, M., Ditton, T.: At the heart of it all: the concept of presence. Journal of Computer Mediated Communication 3(2), http://www.ascusc.org/jcmc/vol3/issue2/Lombard.html
Blach, R., Simon, A., Riedel.: Experiences with user interactions in a CAVE-like projection environment. In: Proceedings Seventh International Conference on Human-Computer Interaction (1997)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Behringer, R., Christian, J., Holzinger, A., Wilkinson, S. (2007). Some Usability Issues of Augmented and Mixed Reality for e-Health Applications in the Medical Domain. In: Holzinger, A. (eds) HCI and Usability for Medicine and Health Care. USAB 2007. Lecture Notes in Computer Science, vol 4799. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76805-0_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-76805-0_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-76804-3
Online ISBN: 978-3-540-76805-0
eBook Packages: Computer ScienceComputer Science (R0)