Intelligent grasping with natural human-robot interaction

The aim of this paper is to propose a grasping method based on intelligent perception for implementing a grasp task with human conduct.

First, the authors leverage Kinect to collect the environment information including both image and voice. The target object is located and segmented by gesture recognition and speech analysis and finally grasped through path teaching. To obtain the posture of the human gesture accurately, the authors use the Kalman filtering (KF) algorithm to calibrate the posture use the Gaussian mixture model (GMM) for human motion modeling, and then use Gaussian mixed regression (GMR) to predict human motion posture.

In the point-cloud information, many of which are useless, the authors combined human’s gesture to remove irrelevant objects in the environment as much as possible, which can help to reduce the computation while dividing and recognizing objects; at the same time to reduce the computation, the authors used the sampling algorithm based on the voxel grid.

The authors used the down-sampling algorithm, kd-tree algorithm and viewpoint feature histogram algorithm to remove the impact of unrelated objects and to get a better grasp of the state.