Skip to main content
SpringerLink
Log in
Book cover

Handbook of Augmented Reality pp 479–500Cite as

Mixed Reality Manikins for Medical Education

  • Chapter
  • First Online:

Abstract

In medical education, human patient simulators, or manikins, are a well established method of teaching medical skills. The current state of the art manikins are limited in their functions by a fixed number of in-built hardware devices, such as pressure sensors and motor actuators that control the manikin behaviors and responses.

In this work, we review several research projects, where applied techniques from the fields of Augmented and Mixed Reality allowed to significantly expand manikin functionality. We will pay special attention to tactile augmentation, and describe in detail a fully functional “touch-enabled” human manikin, developed at SimTiki Medical Simulation Center, University of Hawaii. Also, we will outline possible extensions of the proposed touch-augmented human patient simulator and share our thoughts on the future directions in use of Augmented Reality in medical education.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Laerdal Medical Corporation, http://www.laerdal.com.

  2. 2.

    CyberGlove, by Immersion Corporation, http://www.immersion.com.

  3. 3.

    Workshop on Medical Simulation Systems at the 18th Annual Asia Pacific Military Medicine Conference, Singapore, April 2008, http://www.apmmc.org/.

References

  1. Ascension Technology Corporation, http://www.ascension-tech.com.

  2. R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre. Recent Advances in Augmented Reality. IEEE Computer Graphics And Applications, Vol. 21, No. 6, pp. 34-47, 2001.

    Article  Google Scholar 

  3. M. Bajura, H. Fuchs, and R. Ohbuchi. Merging virtual objects with the real world: Seeing ultrasound imagery within the patient. Computer Graphics, 26(2), 1992.

    Google Scholar 

  4. C. Bichlmeier, F. Wimmer, S.M. Heining, N. Navab. Contextual Anatomic Mimesis: Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality Proceedings of The Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality ISMAR ’07, Nara, Japan, Nov. 13-16, 2007.

    Google Scholar 

  5. C. Bichlmeier, B. Ockert, O. Kutter, M. Rustaee, S.M. Heining, N. Navab. The Visible Korean Human Phantom: Realistic Test & Development Environments for Medical Augmented Reality. Proceedings of the International Workshop on Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery (AMI-ARCS 2008), USA, New York, September 2008.

    Google Scholar 

  6. O. Bimber and R. Raskar. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, 2005.

    Google Scholar 

  7. A. Carlin, H. Hoffman, S. Weghorst. Virtual reality and tactile augmentation in the treatment of spider phobia: A case study. Behaviour Research and Therapy, 35, pp. 153-158, 1997.

    Article  Google Scholar 

  8. A. Cracknell and L. Hayes. Introduction to Remote Sensing, (2 ed.), London: Taylor and Francis, 2007.

    Google Scholar 

  9. Flatland, open source VR engine. The Homunculus Project at the Albuquerque High Performance Computing Center (AHPCC), http://www.hpc.unm.edu/homunculus, 2000.

  10. H. Hoffman. Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. Proceedings of the IEEE Virtual Reality Annual International Symposium, Atlanta GA, p. 59-63. IEEE Computer Society, Los Alamitos, California, 1998.

    Google Scholar 

  11. R. Jacoby, M. Ferneau and J. Humphries. Gestural Interaction in a Virtual Environment. Stereoscopic Displays and Virtual Reality Systems, SPIE 2177, pp. 355-364, 1994.

    Google Scholar 

  12. D. Kondo, R. Kijima, Y. Takahashi. Dynamic Anatomical Model for Medical Education using Free Form Projection Display. Proceedings of the 13th International Conference on Virtual Systems and Multimedia, Brisbane, Australia, Sept. 23-26, 2007.

    Google Scholar 

  13. D. Kondo, T. Goto, M. Kouno, R. Kijima and Y. Takahashi. A Virtual Anatomical Torso for Medical Education using Free Form Image Projection, Proceedings of 10th International Conference on Virtual Systems and MultiMedia (VSMM2004), pp. 678-685, 2004.

    Google Scholar 

  14. D. Kondo and R. Kijima. Proposal of a Free Form Projection Display Using the Principle of Duality Rendering. Proceedings of 9th International Conference on Virtual Systems and MultiMedia, pp. 346-352, 2002.

    Google Scholar 

  15. A. Kotranza, B. Lok, A. Deladisma, CM. Pugh, DS. Lind. Mixed Reality Humans: Evaluating Behavior, Usability, and Acceptability. IEEE Transactions on Visualization and Computer Graphics, vol. 15, no. 3, May/June 2009.

    Google Scholar 

  16. O. Kutter, A. Aichert, C. Bichlmeier, J. Traub, S.M. Heining, B. Ockert, E. Euler, N. Navab. Real-time Volume Rendering for High Quality Visualization in Augmented Reality. International Workshop on Augmented environments for Medical Imaging including Augmented Reality in Computer-aided Surgery (AMI-ARCS 2008), USA, New York, September 2008.

    Google Scholar 

  17. B. Lok and A. Kotranza. Virtual Human + Tangible Interface  = Mixed Reality Human: An Initial Exploration with a Virtual Breast Exam Patient. Proceedings of IEEE VR Conference, Reno, Nevada 2008, pp. 99-106.

    Google Scholar 

  18. J. Looser, M. Billinghurst and A. Cockburn. Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces. Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and SouthEast Asia, June 15-18, Singapore, 2004.

    Google Scholar 

  19. N. Navab, J. Traub, T. Sielhorst, M. Feuerstein, C. Bichlmeier. Action- and Workflow-Driven Augmented Reality for Computer-Aided Medical Procedures. IEEE Computer Graphics and Applications, vol. 27, no. 5, pp. 10-14, Sept/Oct, 2007.

    Google Scholar 

  20. N. Navab, M. Feuerstein, C. Bichlmeier. Laparoscopic Virtual Mirror – New Interaction Paradigm for Monitor Based Augmented Reality. Proceedings of IEEE VR Conference, Charlotte, North Carolina, USA, March 10-14, 2007.

    Google Scholar 

  21. J. Quarles, S. Lampotang, I. Fischler, P. Fishwick, B. Lok. A Mixed Reality Approach for Merging Abstract and Concrete Knowledge. Proceedings of IEEE VR Conference, Reno, Nevada, pp. 27-34, 2008.

    Google Scholar 

  22. A. Sherstyuk, D. Vincent, J. Hwa Lui, K. Connolly, K. Wang, S. Saiki, T. Caudell. Design and Development of a Pose-Based Command Language for Triage Training in Virtual Reality, Proceedings of IEEE Symposium on 3D User Interfaces, March 10-14, 2007.

    Google Scholar 

  23. A. Sherstyuk, D. Vincent, B. Berg. Creating Mixed Reality Manikins for Medical Education Proceedings of the 2008 International Conference on Artificial Reality and Telexistence (ICAT’08), Yokohama, Japan, December 01-03, 2008.

    Google Scholar 

  24. A. Sherstyuk, A. Treskunov, B. Berg. Semi-Automatic Surface Scanner for Medical Tangible User Interfaces International Journal on Imaging and Graphics, vol. 10, issue 2, pp. 219-233, 2010.

    Google Scholar 

  25. B. Ullmer and H. Ishii. Emerging frameworks for tangible user interfaces. IBM Systems Journal, Vol. 39, No. 3&4, pp. 915-931, 2000.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Avatar Reality Inc., Honolulu, HI, USA

    Andrei Sherstyuk

  2. Internal Medicine Program, Tripler Army Medical Center (TAMC), Honolulu, HI, USA

    Dale Vincent

  3. SimTiki Simulation Center, University of Hawaii, Honolulu, HI, USA

    Benjamin Berg

  4. Samsung Information Systems America Inc (SISA), San Jose, CA, USA

    Anton Treskunov

Authors
  1. Andrei Sherstyuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dale Vincent
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Benjamin Berg
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anton Treskunov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrei Sherstyuk .

Editor information

Editors and Affiliations

  1. Dept. of Computer Science & Engineering, Florida Atlantic University, Boca Raton, 33431, Florida, USA

    Borko Furht

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Sherstyuk, A., Vincent, D., Berg, B., Treskunov, A. (2011). Mixed Reality Manikins for Medical Education. In: Furht, B. (eds) Handbook of Augmented Reality. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0064-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-0064-6_23

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-0063-9

  • Online ISBN: 978-1-4614-0064-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation