Skip to main content

Multi modal presentation in virtual telemedical environments

  • Workshop: IEEE EMBS ITIS-ITAB'99
  • Conference paper
  • First Online:
  • 127 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1593))

Abstract

Telemedicine can be used to create virtual environments for the collaboration of patient, physicians, and medical staff. Multi modal presentation is increasingly used to improve human-computer interface. In this paper we present a multimodal interactive environment for EEG/MEG data presentation based on Internet technologies and a virtual reality user interface (VRUI). In addition to visualization, VRUI takes advantage of other input/output modalities such as audio. Animation on the 3D models is used to give insight into spatio-temporal patterns of activity. In addition, sonification is applied to emphasize the temporal dimension of the selected visualized scores. Our proposed approach requires only a standard Web browser to run the multi modal viewer which presents 3D EEG topographic maps using a VRML head model which is animated with Java applets.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. J.E. Cabral, Y. Kim, “Multimedia Systems for Telemedicine and Their Communication Requirements”, IEEE Communications, 34 (7):20–27, 1996.

    Article  Google Scholar 

  2. A. Marsh, “EUROMED—Combining WWW and HPCN to supoort advanced medical imaging”, Int Conf on High Performance Computing and Networking HPCN 1997, Vienna, Austria, 1997.

    Google Scholar 

  3. W.J. Greenleaf, “Developing the Tools for Practical VR Applications”, IEEE EMBS, 15(2), 1996, pp. 23–30.

    Google Scholar 

  4. M. Haubner, A. Krapichler, A. Losch, K. Englmeier, W. van Eimeren, “Virtual Reality in Medicine-Computer Graphics and Interaction Techniques”, IEEE Trans on Information Technology in Biomedicine, 1(1):61–72, 1997.

    Article  Google Scholar 

  5. G. Burdea. Force and Touch Feedback for Virtual Reality. John Wiley & Sons, Inc., New York, 1996.

    Google Scholar 

  6. N.O. Bernsen, “Foundations Of Multimodal Representations: A taxonomy of representational modalities,” Interacting with Computers, 6, 1994, pp. 347–371.

    Article  Google Scholar 

  7. G. Kramer (Ed.), Auditory Display, Sonification, Audification and Auditory Interfaces, Addison Wesley, 1994

    Google Scholar 

  8. A. Samardzic., E. Jovanov., D. Starcevic., “3D Visualisation of Brain Electrical Activity”; Proceedings of 18th Annual Int'l Conf. IEEE/EMBS, Amsterdam, October 1996.

    Google Scholar 

  9. The Virtual Reality Modeling Language, http://www.vrml.org/Specifications/VRML97

    Google Scholar 

  10. D.R. Begault, 3D Sound for Virtual Reality and Multimedia, Academic Press, Inc., Boston, 1994.

    Google Scholar 

  11. R.E. Cytowic, “Synesthesia: Phenomenology And Neuropsychology A Review of Current Knowledge,” Psyche, 2(10). 1995.

    Google Scholar 

  12. A Society for Testing and Materials: Standard Specification for E1467-94 Transferring Digital Neurophysiological Data Between Independent Computer Systems.

    Google Scholar 

  13. F.H. Duffy, Ed, Topographic Mapping of Brain Electrical Activity, Butterworth Publishers, 1986.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Peter Sloot Marian Bubak Alfons Hoekstra Bob Hertzberger

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag

About this paper

Cite this paper

Jovanov, E., Starcevic, D., Marsh, A., Obrenovic, Z., Radivojevic, V., Samardzic, A. (1999). Multi modal presentation in virtual telemedical environments. In: Sloot, P., Bubak, M., Hoekstra, A., Hertzberger, B. (eds) High-Performance Computing and Networking. HPCN-Europe 1999. Lecture Notes in Computer Science, vol 1593. Springer, Berlin, Heidelberg . https://doi.org/10.1007/BFb0100657

Download citation

  • DOI: https://doi.org/10.1007/BFb0100657

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65821-4

  • Online ISBN: 978-3-540-48933-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics