Abstract
Combining visual shape-capturing and vision-based object manipulation without intermediate manual interaction steps is important for autonomic robotic systems. In this work we introduce the concept of such a vision system closing the chain of shape-capturing, detecting and tracking. Therefore, we combine a laser range sensor for the first two steps and a monocular camera for the tracking step. Convex shaped objects in everyday cluttered and occluded scenes can automatically be re-detected and tracked, which is suitable for automated visual servoing or robotic grasping tasks. The separation of shape and appearance information allows different environmental and illumination conditions for shape-capturing and tracking. The paper describes the framework and its components of visual shape-capturing, fast 3D object detection and robust tracking. Experiments show the feasibility of the concept.
This work is supported by the European project MOVEMENT (IST-2003-511670) and by the Austrian Science Foundation grants S9101-N04 and S9103-N04.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barr, A.H.: Superquadrics and Angle Preserving Transformations. IEEE Computer Graphics and Applications 1(1), 11–23 (1981)
Biegelbauer, G., Vincze, M.: Fast and Robust 3D Object Detetction Using a Simplified Superquadric Model Description. In: Proceedings of the 7th Conference on Optical 3-D Measurement Techniques, vol. 2, pp. 220–230 (2005)
Fischler, M.A., Bolles, R.C.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM 24, 381–395 (1981)
Haverinen, J., Röning, J.: A 3-D Scanner Capturing Range and Color for the Robotics Applications. In: 24th Workshop of the Austrian Association of Pattern Recognition OEAGM/AAPR, pp. 41–48 (2000)
Jang, H.-Y., et al.: A Visibility-Based Accessibility Analysis of the Grasp Points for Real-Time Manipulation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3111–3116 (2005)
Kim, S., et al.: Robust model-based 3D object recognition by combining feature matching with tracking. In: Proceedings of the IEEE International Conference on Robotics and Automation, vol. 2, pp. 2123–2128 (2003)
Kragic, D., Christensen, H.I.: Model based techniques for robotic servoing and grasping. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and System, vol. 1, pp. 299–304 (2002)
Leonardis, A., Jaklic, A.: Superquadrics for segmenting and modeling range data. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(11), 1289–1295 (1997)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Lu, C.P., et al.: Fast and Globally Convergent Pose Estimation from Video Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(6), 610–622 (2000)
Mikolajczyk, K., et al.: A Comparison of Affine Region Detectors. International Journal of Computer Vision 65(1/2), 43–72 (2005)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(10), 1615–1630 (2005)
Moré, J.J.: The Levenberg-Marquardt Algorithm: Implementation and Theory. Numerical Analysis - Lecture Notes in Mathematics, vol. 630, pp. 105–116. Springer, Heidelberg (1977)
Mukherjee, S., Nayar, S.K.: Automatic generation of GRBF networks for visual learning. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 794–800 (1995)
Parhami, B.: Voting Algorithms. Machine Learning (IEEE Transactions on Reliability) 43(4), 617–629 (1994)
Salganicoff, M.: Active Learning for Vision-Based Robot Grasping. Machine Learning 23(2), 251–278 (1996)
Solina, F., Bajcsy, R.: Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(2), 131–147 (1990)
Taylor, G., Kleeman, L.: Integration of robust visual perception and control for a domestic humanoid robot. In: Proceedings IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, vol. 1, pp. 1010–1015 (2004)
Yoon, Y., et al.: A New Approach to the Use of Edge Extremities for Model-based Object Tracking. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1883–1889 (2005)
Zillich, M., Al-Ani, E.: Camcalb: A user friendly camera calibration software. In: Workshop of the Austrian Association of Pattern Recognition OEAGM/AAPR, pp. 111–116 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schlemmer, M.J., Biegelbauer, G., Vincze, M. (2006). An Integration Concept for Vision-Based Object Handling: Shape-Capture, Detection and Tracking. In: Zheng, N., Jiang, X., Lan, X. (eds) Advances in Machine Vision, Image Processing, and Pattern Analysis. IWICPAS 2006. Lecture Notes in Computer Science, vol 4153. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11821045_23
Download citation
DOI: https://doi.org/10.1007/11821045_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37597-5
Online ISBN: 978-3-540-37598-2
eBook Packages: Computer ScienceComputer Science (R0)