Abstract
We have been developing a visual/haptic interface to virtual environments, called a WYSIWYF Display, which ensures spatially/temporally consistent visual/haptic sensation. Three key components are (i) vision-based tracking for correct visual/haptic registration (ii) blending live video and computer graphics (CG) images by a chroma-keying technique, and (iii) encountered-type haptic rendering that provides real free and real touch sensations.
In this paper, the recent progress on the above key components are presented. First, accurate image overlay technique by using vision and accelerometers is shown. Then, a path planning for encountered-type haptic devices that render multiple virtual objects is presented. A virtual control panel of automobiles was developed to demonstrate the proposed path-planning algorithm.
The developed visual/haptic interface system can be regarded as a kind of mechano-media, a new concept extending the framework of teleoperation, which transmit kinesthetic knowledge from a human to other humans.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Azuma R (1997) A survey of augmented reality. Presence, 6(4):355–385.
Azuma R, Bishop G (1994) Improving static and dynamic registration in an optical see-through hmd. In Proceedings of SIGGRAPH’94, pp 197–204.
Burdea GC (1996) Force and touch feedback for virtual reality. Jhon Wiley & Sons.
Dickmanns ED, Mysliwetz B, Christians T (1990) An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles. IEEE Trans. Sys., Man, and Cyb., 20(6): 1273–1284.
Groen J, Werkhoven PJ (1998) Visuomotor adaptation to virtual hand positioning in interactive virtual environment. Presence, 7(5):429–446.
Gruenbaum PE et al. (1997) Implementation of dynamic robotic graphics for a virtual control panel. Presence, 6(1): 118–126.
Henmi K, Yoshikawa T (1998) Virtual lesson and its application to virtual calligraphy system. In Proc. IEEE ICRA’98, pp 1275–1280.
McNeely WA (1993) Robotic graphics: a new approach to force feedback for virtual reality. In Proc. 1993 IEEE Virtual Reality Annual International Symposium (VRAIS’93), pp 336–341.
Preparata FP, Shamos MI (1985) Computational geometry. Springer-Verlag, New York.
Tachi S et al. (1994) A construction method of virtual haptic space. In Proc. of Int. Conf. on Artificial Reality and Telepresence (ICAT’94), pp 131–138.
Uenohara M, Kanade T (1995) Vision-based object registration for real-time image overlay. Comput.,Biol., Med.,, 25(2):249–260.
Yokokohi Y (2001) Toward mechano-media from teleoperation. In Proc. Workshop on Advances in Interactive Multimodal Telepresence Systems, pp 3–20, Munich, Germany.
Yokokohi Y, Kinoshita J, Yoshikawa T (2001) Path planning for encountered-type haptic devices that render multiple objects in 3D space. In Proc. IEEE VR 2000, pp 271–278.
Yokokohi Y, Sugawara Y, Yoshikawa T (2000) Accurate image overlay on video see-through HMDs using vision and accelerometers. In Proc. IEEE VR 2000, pp 247–254.
Yokokohji Y (1998) A visual/haptic interface to virtual environment (WYSIWYF display) and its application. In Proc. 1998 IEEE and ATR Workshop on Computer Vision for Virtual Reality Based Human Communications (CVVRHC’98), pp 99–104.
Yokokohji Y et al. (1996a) Toward machine mediated training of motor skill. In Proc. IEEE RO-MAN’96, pp 32–37.
Yokokohji Y, Hollis RL, Kanade T (1996b) What you can see is what you can feel-development of a visual/haptic interface to virtual environment-. In Proc. 1996 IEEE Virtual Reality Annual International Symposium (VRAIS’96), pp 46–53.
Yokokohji Y, Hollis RL, Kanade T (1999) WYSIWYF display: a visual/haptic interface to virtual environment. Presence, 8(4):412–434.
You S, Neumann U, Azuma R (1999) Hybrid internal and vision tracking for augmented reality registration. In Proc. of IEEE VR99, pp 260–267.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yokokohji, Y., Sugawara, Y., Kinoshita, J., Yoshikawa, T. (2003). Mechano-Media that Transmit Kinesthetic Knowledge from a Human to Other Humans. In: Jarvis, R.A., Zelinsky, A. (eds) Robotics Research. Springer Tracts in Advanced Robotics, vol 6. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36460-9_33
Download citation
DOI: https://doi.org/10.1007/3-540-36460-9_33
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00550-6
Online ISBN: 978-3-540-36460-3
eBook Packages: Springer Book Archive