Abstract
Telemedicine can be used to create virtual environments for the collaboration of patient, physicians, and medical staff. Multi modal presentation is increasingly used to improve human-computer interface. In this paper we present a multimodal interactive environment for EEG/MEG data presentation based on Internet technologies and a virtual reality user interface (VRUI). In addition to visualization, VRUI takes advantage of other input/output modalities such as audio. Animation on the 3D models is used to give insight into spatio-temporal patterns of activity. In addition, sonification is applied to emphasize the temporal dimension of the selected visualized scores. Our proposed approach requires only a standard Web browser to run the multi modal viewer which presents 3D EEG topographic maps using a VRML head model which is animated with Java applets.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
J.E. Cabral, Y. Kim, “Multimedia Systems for Telemedicine and Their Communication Requirements”, IEEE Communications, 34 (7):20–27, 1996.
A. Marsh, “EUROMED—Combining WWW and HPCN to supoort advanced medical imaging”, Int Conf on High Performance Computing and Networking HPCN 1997, Vienna, Austria, 1997.
W.J. Greenleaf, “Developing the Tools for Practical VR Applications”, IEEE EMBS, 15(2), 1996, pp. 23–30.
M. Haubner, A. Krapichler, A. Losch, K. Englmeier, W. van Eimeren, “Virtual Reality in Medicine-Computer Graphics and Interaction Techniques”, IEEE Trans on Information Technology in Biomedicine, 1(1):61–72, 1997.
G. Burdea. Force and Touch Feedback for Virtual Reality. John Wiley & Sons, Inc., New York, 1996.
N.O. Bernsen, “Foundations Of Multimodal Representations: A taxonomy of representational modalities,” Interacting with Computers, 6, 1994, pp. 347–371.
G. Kramer (Ed.), Auditory Display, Sonification, Audification and Auditory Interfaces, Addison Wesley, 1994
A. Samardzic., E. Jovanov., D. Starcevic., “3D Visualisation of Brain Electrical Activity”; Proceedings of 18th Annual Int'l Conf. IEEE/EMBS, Amsterdam, October 1996.
The Virtual Reality Modeling Language, http://www.vrml.org/Specifications/VRML97
D.R. Begault, 3D Sound for Virtual Reality and Multimedia, Academic Press, Inc., Boston, 1994.
R.E. Cytowic, “Synesthesia: Phenomenology And Neuropsychology A Review of Current Knowledge,” Psyche, 2(10). 1995.
A Society for Testing and Materials: Standard Specification for E1467-94 Transferring Digital Neurophysiological Data Between Independent Computer Systems.
F.H. Duffy, Ed, Topographic Mapping of Brain Electrical Activity, Butterworth Publishers, 1986.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1999 Springer-Verlag
About this paper
Cite this paper
Jovanov, E., Starcevic, D., Marsh, A., Obrenovic, Z., Radivojevic, V., Samardzic, A. (1999). Multi modal presentation in virtual telemedical environments. In: Sloot, P., Bubak, M., Hoekstra, A., Hertzberger, B. (eds) High-Performance Computing and Networking. HPCN-Europe 1999. Lecture Notes in Computer Science, vol 1593. Springer, Berlin, Heidelberg . https://doi.org/10.1007/BFb0100657
Download citation
DOI: https://doi.org/10.1007/BFb0100657
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65821-4
Online ISBN: 978-3-540-48933-7
eBook Packages: Springer Book Archive