Integration of planning and execution in force controlled compliant motion

https://doi.org/10.1016/j.robot.2007.09.009Get rights and content

Abstract

This paper presents the Compliant Task Generator, a new approach for the automatic conversion of a geometrical contact path into a force-based task specification. A contact path planner generates a sequence of six-dimensional poses and corresponding contact formations, while a hybrid robot controller expects a desired wrench, twist and the local wrench and twist subspaces. Our approach automatically converts a geometrical path description into a force based tasks specification for the hybrid controller, based on a user specified input of the magnitudes and the norms of the desired contact force and execution speed. The approach applies to all contact motions between known polyhedral objects, and is verified in real world experiments.

Introduction

Compliant motion tasks are manipulation tasks that involve contacts between the object manipulated by a robot and the environment in which it operates. To cope with uncertainties these operations must be carried out using passive or active force control. Indeed small errors in the object models can give rise to high interaction forces. Whereas passive force control relies on compliance elements placed at the wrist of the robot, in active force control the robot controller modifies the trajectory depending on the forces arising during the interaction [13].

To specify force controlled robot tasks M.T. Mason introduced the Task Frame Formalism (TFF) [29] an intuitive and manipulator independent formalism for the specification of force controlled robot tasks in the Hybrid Control Paradigm (HCP) [34]. Bruyninckx and De Schutter made an extensive catalogue of TFF models and specifications [3]. While the TFF is useful to specify many elementary contact tasks [20], it cannot cope with more complex operations involving multiple simultaneous contacts, even in the case of polyhedral objects; the TFF is limited to translational and rotational components along the same axes, orthogonal to each other. Recently, De Schutter presented a constraint-based task specification framework that overcomes the limitations of the TFF, and provides a powerful interface to specify complex compliant motion tasks involving multiple (contact) constraints [12]. However, these approaches themselves have no “intelligence” such as planning or advanced sensor processing capabilities, but fully rely on human intervention and intuition to specify a task compatible with the framework. Indeed, the programmer not only has to specify the task but also has to foresee the input sensor signal to control it. For more complex tasks, involving multiple contacts and changes in contact formations, this can prove to be extremely difficult.

Different approaches exist to automatically generate the desired sequence of contact formations in such a case. Programming by Human Demonstration [6], [16], [31], [35] gathers wrench, pose and contact data about a task, while a human demonstrates the task, in a virtual or real environment using for instance a haptic device or a demonstration tool. A different approach, as used in this paper, involves a geometrical planner that automatically generates a path in the contact space of the manipulated object and its environment based on their geometrical models. Xiao and Ji developed such a compliant planner [18]. Due to the complexity of the problem this planner finds such a path in two stages. In the first one the planner automatically generates the contact state space between two arbitrary polyhedral objects in terms of a contact state graph [38]. Even between two simple polyhedral objects, hundreds of contact formations are possible. In this graph the possible contact states and their adjacency relations are represented. In the second stage the planner generates a compliant path by compliant interpolation between neighbouring contact states. However, this path only contains geometrical and topological information. For the complete specification of the compliant task the forces to be applied to the environment along the path have to be described.

In this paper we present an approach to automatically generate a task specification for a hybrid controller, based on the output of the geometrical planner, called the Compliant Task Generator, in which the user specifies the desired magnitudes for the contact wrench and the manipulator twist. This allows a complex task plan to be generated based on the known geometrical models of the objects that can be generated on a real robot manipulator under active force control without expert user intervention. The method has been implemented and real world experiments have been carried out to validate it. This work is complementary to–and can be integrated with–previous work of our research group, which focused on the identification of contact states and the estimation of geometrical parameters using iterative stochastic estimation tools such as Kalman filters or particle filters [16], [23], [31]. To improve the identification and estimation, in [25] the active sensing problem is formulated and decoupling it into smaller optimization problems.

The remainder of the paper is organized as follows: Section 2 briefly reviews the concept of contact formations and the contact state graph. Section 3 discusses the output of the compliant planner and the input to the hybrid controller, in other words the planner and controller primitives. Section 4 describes the automatic generation of the controller primitives, using the planner primitives and information about the desired contact force level and execution speed. Section 5 explains the internals of the hybrid controller. Section 6 discusses the invariance and the robustness of the method. The experimental setup and the obtained results are discussed in Section 7. Finally, Section 8 contains the conclusions together with future extensions and improvements of the method.

Section snippets

Contact formations

The notion of principal contacts (PCs) was introduced [36] to describe a contact primitive between two surface elements of two polyhedral objects in contact, where a surface element can be a face, an edge or a vertex. The boundary elements of a face are the edges and vertices bounding it, and the boundary elements of an edge are the vertices bounding it. Formally, a PC denotes the contact between a pair of surface elements which are not boundary elements of other contacting surface elements.

Compliant planner and hybrid controller primitives

This section first describes the output primitives of the compliant motion planner, which correspond to the input for the Compliant Task Generator. Next, the input primitives for the hybrid controller are discussed, which correspond to the output of the Compliant Task Generator. This is schematically represented in Fig. 4.

Compliant task generator

This section describes the core of our approach, the automatic conversion of a geometrical path generated by the compliant path planner (X1Xn and CF1CFm), into a force based task specification for the hybrid controller (wd, td, Xd, W and T). The direction of the desired twist td and the desired wrench wd are derived from the planner output: td is defined by the pose setpoints X1Xn, and wd is defined by the contact formation setpoints CF1CFm. The magnitudes of the desired twist and wrench

Implementation of the hybrid controller

This section discusses the hybrid controller that converts the desired twist td, the desired pose Xd and the desired wrench wd to a control twist tc for the manipulator. The approach applies to a velocity controlled manipulator as in [9], which is industrial practice. A proportional feedback loop in the twist space controls the desired twist td and pose Xd, while a second proportional feedback loop in the wrench space controls the desired wrench wd.

Discussion

This section discusses the applicability of the approach, the invariance of the method and the choice of the different parameters.

Experimental results

This paragraph reports on the real world experiment to validate our approach. It first describes the experimental setup. Then the obtained results are analysed and discussed.

Compliant task generator

This paper presents the Compliant Task Generator an approach to automatically link the planning and controller efforts in active compliant motion. A compliant path planner provides a geometrical path in the form of a set of six-dimensional poses X1Xn and their corresponding contact formations CF1CFm. The hybrid compliant controller expects a desired twist td, pose Xd and wrench wd at each time step, together with their twist and wrench spaces T and W. The conversion of the discrete planner

Acknowledgments

This work has been supported by the K. U. Leuven’s Concerted Research Action GOA/ 05/10, by the US National Science Foundation grants IIS-0328782 and EIA-0203146, by the URJC-CM grant 2006-CET-0371 and by the Spanish Ministry of Science and Education under the “Ramón y Cajal” programme.

Wim Meeussen obtained the Bachelor’s degree in Engineering in 2000, the Master of Science degree in Mechanical Engineering in 2002 and the Ph.D. degree in Applied Sciences in 2006, all from Katholieke Universiteit Leuven, Leuven, Belgium. Currently, he is a Postdoctoral Researcher with the Department of Mechanical Engineering, Katholieke Universiteit Leuven. His research interests include online estimation in sensor-based robot tasks, robotics compliant motion, force control, active sensing and

References (38)

  • Wojciech Blajer

    A geometric unification of constrained system dynamics

    Multibody System Dynamics

    (1997)
  • Herman Bruyninckx, Kinematic models for robot compliant motion with identification of uncertainties, Ph.D. Thesis,...
  • Herman Bruyninckx et al.

    Specification of force-controlled actions in the Task Frame Formalism: A survey

    IEEE Transactions on Robotics and Automation

    (1996)
  • Herman Bruyninckx et al.

    Where does the Task frame go?

  • Herman Bruyninckx, Peter Soetens, Bob Koninckx, The real-time motion control core of the Orocos project, in: Int. Conf....
  • Jason Chen et al.

    Programing by demonstration: Coping with suboptimal teaching actions

    International Journal of Robotics Research

    (2003)
  • Chiaverini Stefano et al.

    The parallel approach to force/position control manipulators

    IEEE Transactions on Robotics and Automation

    (1993)
  • Alessandro De Luca et al.

    Modeling of robots in contact with a dynamic environment

    IEEE Transactions on Robotics and Automation

    (1994)
  • Joris De Schutter et al.

    Force control of robot manipulators

  • Joris De Schutter et al.

    Estimating first order geometric parameters and monitoring contact transitions during force controlled compliant motion

    International Journal of Robotics Research

    (1999)
  • Joris De Schutter et al.

    Constraint-based task specification and estimation for sensor-based robot systems in the presence of geometric uncertainty

    International Journal of Robotics Research

    (2007)
  • Joris De Schutter et al.

    Unified constraint-based task specification for complex sensor-based robot systems

  • Joris De Schutter et al.

    Compliant motion I, II

    International Journal of Robotics Research

    (1988)
  • Keith L. Doty et al.

    A theory of generalized inverses applied to robotics

    International Journal of Robotics Research

    (1993)
  • Joseph Duffy

    The fallacy of modern hybrid control theory that is based on orthogonal complements of twist and wrench spaces

    Journal of Robotic Systems

    (1990)
  • Klaas Gadeyne et al.

    Bayesian hybrid model-state estimation applied to simultaneous contact formation recognition and geometrical parameter estimation

    International Journal of Robotics Research

    (2005)
  • Neville Hogan

    Stable execution of contact tasks using impedance control

  • Xuerong Ji et al.

    Planning motions compliant to complex contact states

    International Journal of Robotics Research

    (2001)
  • Lydia E. Kavraki et al.

    Probabilistic roadmaps for robot path planning

  • Wim Meeussen obtained the Bachelor’s degree in Engineering in 2000, the Master of Science degree in Mechanical Engineering in 2002 and the Ph.D. degree in Applied Sciences in 2006, all from Katholieke Universiteit Leuven, Leuven, Belgium. Currently, he is a Postdoctoral Researcher with the Department of Mechanical Engineering, Katholieke Universiteit Leuven. His research interests include online estimation in sensor-based robot tasks, robotics compliant motion, force control, active sensing and task specification.

    Ernesto Staffetti received the M.Sc. degree In Electronic Engineering from the University of Rome “La Sapienza” Italy and the Ph.D. in Electronic Engineering from the Technical University of Catalonia Spain. He is a researcher at the Department of Statistics and Operational Research of the Rey Juan Carlos University in Madrid Spain. He has previously been with the University of North Carolina at Charlotte, USA, the Catholic University Leuven, Belgium and with the Spanish Council of Scientific Research. His research interests are in motion planning in robotics and computer vision.

    Dr Bruyninckx obtained the Masters degrees of Licentiate in Mathematics (1984), Burgerlijk Ingenieur in Computer Science (1987) and in Mechatronics (1988), all from the Katholieke Universiteit Leuven, Belgium. In 1995 he got his Doctoral Degree in Engineering from the same university, with a thesis entitled “Kinematic Models for Robot Compliant Motion with Identification of Uncertainties”. His current research interests are on-line Bayesian estimation of model uncertainties in sensor-based robot tasks, kinematics of serial and parallel manipulators and humans, geometrical foundations of robotics and robot modelling, simulation and control software. In 2001, he started the Free Software project Orocos (www.orocos.org), to support this latter research interest and to facilitate its industrial exploitation. Since 2003, he has been Associate Professor at the K.U.Leuven. He held visiting research positions at the Grasp Lab of the University of Pennsylvania, Philadelphia (1996), the Robotics Lab of Stanford University (1999), and the Kungl Tekniska Hogskolan in Stockholm (2002). Since 2007, he has been Coordinator of the European Robotics Research Network EURON.

    Jing Xiao received the Ph.D. degree in Computer, Information, and Control Engineering from the University of Michigan, Ann Arbor, Michigan, USA, in 1990. She is currently a Professor of Computer Science and also the Director of the Information Technology Ph.D. Programme, University of North Carolina - Charlotte, USA. From October to December 1997, she was a visiting researcher at the Scientific Research Laboratories of the Ford Motor Company, and from January to June 1998, she was a Visiting Associate Professor at the Robotics Lab. of Computer Science Department, Stanford University. From August 1998 to December 2000, She was the Programme Director of the Robotics and Human Augmentation Programme at the National Science Foundation. Her research interests cover robotics, haptics and intelligent systems in general. Dr Xiao was an elected member of the Administrative Committee of the IEEE Robotics and Automation Society from 1999 to 2001. She is currently on the Membership Board of the IEEE Robotics and Automation Society and serves as the Associate Vice President for Membership Activities. She has been active in programme committees of major IEEE robotics conferences for many years and has served in various roles including the Programme Co-Chair of the 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems and the General Chair of the 2005 IEEE International Symposium on Assembly and Task Planning.

    Joris De Schutter received the degree of Mechanical Engineer from the Katholieke Universiteit (K.U.) Leuven, Leuven, Belgium, in 1980, the M.S. degree from the Massachusetts Institute of Technology, Cambridge, in 1981, and the Ph.D. degree in Mechanical Engineering, also from K.U. Leuven, in 1986. Following work as a Control Systems Engineer in industry, in 1986, he became a Lecturer with the Department of Mechanical Engineering, K.U. Leuven, where he has been a Full Professor since 1995. He teaches courses in kinematics and dynamics of machinery, control and robotics, and has been the Coordinator of the study programme in mechatronics, established in 1986. He has published papers on sensor-based robot control and programming (in particular, force control and compliant motion), position control of flexible systems and optimization of mechanical and mechatronic drive systems.

    View full text