The purpose of this study is development of Mobile Gestural Control System of a Vehicle. The designated coordinate was estimated from the intersection of the location information and the floor of the elbow and wrist. Position control system for moving the vehicle indicated coordinate was designed. When there is an obstacle on the path of the robot, vehicle avoid the obstacle by potential method.