Accumulation of Object Representations Utilizing Interaction of Robot Action and Perception

Abstract

We introduce a robotic-vision system which is able to extract object representations autonomously utilizing a tight interaction of visual perception and robotic action within a perception action cycle [9, 16]. Controlled movement of the object grasped by the robot enables us to compute the transformations of entities which are used to represent aspects of objects and to find correspondences of entities within an image sequence.

A general accumulation scheme allows to acquire robust information from imperfect and partly missing information extracted from single frames of an image sequence. Here we used this scheme with a preprocessing stage in which 3D-line segments are extracted from stereo images. However, the accumulation scheme can be used with any kind of preprocessing as long as the entities used to represent objects can be brought to correspondence by certain equivalence relations such as ‘rigid body motion’.