Summary
The ability to perceive a three dimensional view of a remote workspace is an essential factor for teleoperation performance. In this chapter we present a novel class of 3D video interfaces that actively control the image acquisition system geometry to improve the teleoperation process. We describe a prototype system composed by two main components: (i) a visualization system called 3D-VIP, which receives two video input streams from a binocular camera system and combines them into a single stereoscopic video image displayed on a computer screen, and (ii) an automatic vergence control system that commands the movements of the binocular camera system to minimize the disparity of observed objects, thus facilitating depth perception. Automatic vergence control is based on the estimation of dominant disparity in the stereo image pair. It employs a foveal image representation, whose image resolution decreases toward image periphery, to focus attention on central objects and attenuate the influence of background clutter. Foveal images have smaller sizes than usual cartesian images which allows very fast sample rates and adaptation to working conditions. We present results on real teleoperation experiments which show that active systems compare favorably to conventional ones with respect to working range. Given the increasing availability of high quality cameras and motorized systems, the integration of automatic vergence control with stereoscopic video devices will pave the way for a new advanced generation of human interfaces in teleoperated systems.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
G. C. Burdea and P. Coiffet. Virtual Reality Technology. Second edition. John Wiley & Sons, 2003.
R. Aracil, M. Ferre, M. Hernando, E. Pinto and J.M. Sebastian. Telerobotic System for Live-Power Line Maintenance:ROBTET. Control Engineering Practice, 10:1271–1281, 2002.
M. Ferre, R. Aracil and M. Navas. Stereoscopic Video Images for Telerobotic Applications. Journal of Robotic Systems, 22(3):131–146, 1993.
W. Barfiel, C. Hendrix and O. Bojorneseth. Comparison of Human Sensory Capabilities with Technical Specifications of Virtual Environment Equipment. Presence, 4(4):1–19, 1995.
W. Barfiel, C. Hendrix and K.E. Bystrom. Effects of stereopsis and head tracking on performance using desktop virtual environment displays. Presence, 8:237–240, 1999.
H. Baier, M. Buss, F. Freyberger and G. Schmidt. Interactive Stereo Vision Telepresence for Correct Communication of Spatial Geometry. Advanced Robotics, 17(3):219–233, 2003.
H. Baier, M. Buss, F. Freyberger and G. Schmidt. Benefits of Combined Active Stereo Vision and Haptic Telepresence. In Proc. IEEE Int. Conf. on Intelligent Robots and Systems, pages 702–707, 2000.
L. Matthies. Stereo Vision for Planetary Rovers-Stochastic Modeling to near Real-Time Implementation Int. Journal of Computer Vision, 8(1), 1992.
M. Ueberle, N. Mock and M. Buss. Towards a Hyper-Redundant Haptic Display. In Proc. of Int. Workshop on Telepresence and Teleaction, pages 1–22, 2003.
Y.Y. Yed and L.D. Silverstein, Limits of fusion and depth judgement in stereoscopic color displays Human Factors, 32:45–60, 1990.
L. Lipton. The Crystal eyes handbook StereoGraphics Corporation, 1991.
I.P. Howard and B.J. Rogers. Binocular vision and stereopsis. Oxford University Press, Oxford, 1995.
M. Ferre and R. Aracil. Interfaces for Telerobotics Studies on Stereoscopic Vision. In Proc. of the XV IFAC World Congress, 2002.
M. Ferre, R. Aracil, M. Navas and J. A. Escalera. Real time video image processing for teleoperation: Image Blending and stereoscopy. In Proc. of 9th IEEE Int. Conference on Emerging Technologies and Factory Automation, pages 539–544, 2003.
T. J. Olson and D. Coombs. Real-Time Vergence Control for Binocular Robots IJCV, pages 67–89, 1991.
K. Pahlavan, T. Uhlin and J. Eklundh. Integrating Primary Ocular Processes. In Proc. of 2nd ECCV, pages 526–541, 1992.
J. Siebert and D. Wilson. Foveated Vergence and Stereo. In Proc. of the 3rd Int. Conf. on Visual Search (TICVS), 1992.
A. Bernardino and J. Santos-Victor. Binocular Visual Tracking: Integration of Perception and Control IEEE Trans. on Robotics and Automation, 15(6):137–146, 1999.
C. Capurro, F. Panerai and g. Sandini. Dynamic Vergence Using Log-Polar Images IJCV, 24(1):79–94, 1997.
E. Schwartz. Spatial mapping in the primate sensory projection: Analytic structure and relevance to perception Biological Cybernetics, 25:181–194, 1977.
J. Semmlow, G. Hung, J. Horng and K. Ciuffreda. Disparity Vergence Eye Movements Exhibit Preprogrammed Motor Control Vision Research, 34(10):1335–1343, 1994.
G. Hirzinger. Robots in Space-a survey. Advanced Robotics, 9(6):625–651, 1995.
W.M. Theimer and H.A. Mallot. Phase-Based Binocular Vergence Control and Depth Reconstruction Using Active Vision CVGIP, 60:343–358, 1994.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Bernardino, A., Santos-Victor, J., Ferre, M., Sanchez-Urán, M.A. (2007). Stereoscopic Image Visualization for Telerobotics. Experiments with Active Binocular Cameras. In: Ferre, M., Buss, M., Aracil, R., Melchiorri, C., Balaguer, C. (eds) Advances in Telerobotics. Springer Tracts in Advanced Robotics, vol 31. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71364-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-71364-7_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71363-0
Online ISBN: 978-3-540-71364-7
eBook Packages: EngineeringEngineering (R0)