Enhancing adaptability with local reactive behaviors for hexapod walking robot via sensory feedback integrated central pattern generator

https://doi.org/10.1016/j.robot.2019.103401Get rights and content

Highlights

  • A two-layered CPG-based single-leg controller is devised to generate tripod movement.

  • Two local reactive mechanisms are proposed to deal with terrain disturbances.

  • A locomotion control framework is proposed and verified for hexapod robot.

Abstract

Local reactive behaviors endow animals the ability to exhibit agile and dexterous performance when traversing challenging terrains. This paper presents a novel locomotion control method based on the central pattern generator (CPG) concept for hexapod walking robot with local reactive behavior to cope with terrain irregularities. Firstly, a two-layered CPG-based single-leg controller is developed to generate the rhythmical movement for each leg executing tripod walking. The Van der Pol oscillator is employed on the high-layer to construct a coupled CPG network which serves as a phase regulator (PR) to produce rhythmic signals with prescribed phase relations amongst neurons. On the low-layer, an auxiliary linear converter (LC) transforms these signals into the desired joint trajectories. Subsequently, by embodying the proprioceptive sensing and external tactile information as the sensory feedback, two typical local reactive mechanisms including the elevator reflex and searching reflex are achieved by virtue of on-line adjusting the coupling scheme of the PR and the coefficients of the LC. A locomotion control framework for hexapod walking robot is further established by combining the single-leg controller with a finite state machine to allocate swing/stance commands for individual joints in dealing with terrain perturbations. The effectiveness of the proposed method has been verified through both virtual model simulation and experiments on a physical hexapod platform.

Introduction

Achieving agile and robust walking performance as presented in vertebrates and arthropods becomes increasingly attractive for legged robots when traversing complicated terrains in recent years [1], [2], [3]. Due to the inherent redundancy among the joints and the complexity in foot-ground interaction, tackling the motion coordination of multi-degrees of freedom (MDoF) and multi-axial movement is regarded as a challenge in locomotion control of legged robots [4]. The relevant biological observations and experimental results provide abundant inspirations for scientists and engineers to deal with this issue. By refining the essence of the neuro-mechanics, a serials of legged prototypes such as RHex [5], Zebro [6], Foldable Hexapod [7], PhantomX [8], HITCR-II [9], Octopus-III [10] and AMOS [11] have been successfully developed, exhibiting astonishing adaptive behaviors in varied surfaces. Recently the desert ant-inspired 3D printed hexapod robots [12] have been devised and provided an affordable alternative in outdoor exploration due to the distinctive adaptability in unknown environment [13], [14]. With regard to traversing rough terrains, a position feedback-based adaptive locomotion control method has been proposed in [15] for affordable hexapod walking robot to improve the mobility in typical unstructured terrains (i.e., stairs, irregular blocks). Nonetheless, the underlying mechanism on how animals maneuver tissues, organs as well as limbs to produce energetically efficient and dexterously movements when interacting with the unstructured environment still remains unsettled.

Recent neuroscience research has found that the central pattern generator (CPG), a group of neural circuit located in the spinal cord of vertebrates or in relevant ganglia in invertebrates, can produce rhythmic and quasi-periodic movement in absence of sensory feedback or higher regulation signals from the brain-stem level [16]. Meanwhile, the neurobiology studies [17], [18], [19] have revealed that the local reactive behaviors via muscles, tissues and organs with tactile sensing or vestibular feedback plays an irreplaceable role for terrestrial creatures when coping with unconventional environment. These biological observations and findings inspire both engineers and roboticists to resolve specific locomotory tasks for legged robots. Lewinger et al. [20] proposed a biologically inspired leg controller to generate adaptive stepping actions in a hexapod walking robot. The proposed controller contains three sensory-coupled neuron circuits by collecting the angle and load information of each joint, exhibiting a motion combination including the protraction of the thorax-coxa, the levation of the coxa-trochanter as well as the extension of the femur–tibia. Rutter et al. [21] extended this work by developing a neural network-based single-leg controller with local sensor feedback to steer a cockroach-like robotic leg. By appropriately inhibiting or exciting the local neural circuits and adjusting the associated neuron thresholds, a serials of adaptive reflex transitions were obtained on the single-leg platform. Similar results could be found in [22] wherein the movement of a 3-DoF leg is steered by the proposed joint controller that embodies simplified linear muscle models. The strategy based on bio-inspired local reactive behavior was also implemented in [23] that the reactive climbing performance for hexapod walking robot AMOS-II is conducted via the central pattern generator (CPG) network integrated with reflex neurons. The robot could negotiate obstacles with varied height, displaying a comparable climbing behaviors as observed in cockroaches. The reflex mechanism had also been cooperated with the CPG network to successfully manipulates a limbless robot for improving adaptability in unstructured environment with rapid response in presence of external stimuli [24]. Kimura et al. [25] developed a CPG-based controller for the quadruped prototype Tekken-II in which the corrective stepping reflex together with the crossed flexor reflex induced by sensory feedback was implemented on the swing leg to maintain the balance when dynamically walking on irregular terrain in outdoor environment. Wang et al. [26] also achieved stable and robust hopping for a biped robot in uneven surface by elaborately adding sensory feedback path to the original CPG circuits. Espenschied et al. [27] proposed a distributed locomotion controller incorporating with local leg reactive behaviors including step reflex, elevator reflex as well as searching behaviors for a insect-like hexapod robot to enhance the walking adaptation when negotiating complicated terrains such as irregular, slatted and compliant surface.

Although these bio-inspired reflex control methods are widely and fruitfully applied in locomotion control of legged robots, it still remains a challenge for locomotion control of legged robots that how to generate suitable and efficient reactive behaviors comparable to natural performance of animals. Generally, constructing the CPG network for locomotion control is a trade-off between the complexity of the neural network topology and the diversity of the resulting gait patterns. From the perspective of synchronization of complex network, the rhythmical signals with stable phase relationships that are appropriate to generate diverse gait patterns for legged locomotion depends on the collective dynamical behaviors of the CPG network with specific coupling scheme amongst neurons. However, the sophisticated topology of the CPG network will inevitably reduce the mathematical tractability, which further decreases the possibility of straight-forward parametrical synthesis of the CPG-based controller for locomotory tasks in steering limb/limbless movement. Traditional numerical methods such as evolutionary searching [28], empirical tuning [29] as well as other learning approaches [30], [31] are applied to obtain the appropriate model parameters of the neural network. Constructing an ideal CPG network capable of providing abundant dynamical behaviors that results rhythmic locomotion patterns meanwhile preserving tractability is a long-term goal for the CPG-based locomotion control for legged robots especially in cope with unstructured terrain profiles.

Aiming at improving the adaptability of hexapod walking robot in unstructured environment, this paper presents a novel CPG-based locomotion controller with sensory feedback to generate local reactive behaviors for single-leg in dealing with irregular terrain. To fully leverage the merit of the CPG-based approach in producing rhythmic signals with stable phase relationships among neurons, a coupled neuron network integrating with proprioceptive sensing and external tactile information to exhibit conventional leg movement in tripod gait and two typical adaptive reactive behaviors. The main contributions of this paper are summarized as follows.

  • 1.

    A two-layered CPG-based single-leg controller is developed to generate reference trajectory for hexapodal walking in conventional tripod gait. On the high-level, the CPG network composed of three coupled Van der Pol oscillators is constructed as the phase regulator (PR) to produce rhythmic signals with prescribed waveforms. These signals are transformed into the desired joint trajectories for a single-leg by using a linear convertor (LC) on the low-level.

  • 2.

    Two typical local reactive behaviors including the elevator reflex and searching reflex are achieved by adjusting the coupling scheme of the PR and the coefficients of the LC. The former reflex mainly deals with irregular terrain (i.e., step obstacles) to avoid stumbling while the latter treats sunk terrain (i.e., gap, ditches or holes) to search feasible foothold.

  • 3.

    A comprehensive locomotion control framework for hexapod walking robot by combining the single-leg controller with two reflex mechanisms is established by using a finite state machine (FSM) to schedule individual legs in swing/stance phase during walking. The effectiveness of the proposed method is demonstrated through the simulation on a virtual hexapod model and the experiments on physical hexapod robot.

The remainder of this paper is organized as follows. Section 2 briefly revisits the neurobiological basis of the motor system in animals. Section 3 presentsthe development of the CPG-based single-leg controller with sensory feedback. Reactive behavior generation is detailed in Section 4 followed by the establishment of locomotion control framework for hexapod robot in Section 5. The effectiveness of the proposed controller is validated via both simulation and experiments in Section 6. The paper ends with conclusions in Section 7.

Section snippets

Neurobiological basis of the motor system in animals

It is an undeniable fact that the distinguished walking performance of animals outperforms any man-made legged devices at present. This section briefly revisits the essential features of the motor system that contribute to generate rhythmic movement with reactive behaviors. Fig. 1 illustrates the essential features of the motor system in animals by highlighting three pathways of feedback, namely, the central feedback, the reflex feedback and the sensory feedback [32].

The rhythmic movement of

The neuron model

The CPG network is modeled as a group of coupled nonlinear neurons. We hereby introduce the classical Van der Pol (VDP) oscillator as the elementary neuron with ẍ+εbx21ẋ+ω02=0,where ω0 is the oscillation frequency, ε is a scalar coefficient quantifying the strength of the nonlinear damping 0<ε1 and b is the amplitude adjustment parameter. We rewrite the VDP model into the state–space formulation as ż=Fz=ẋẏ=yε1bx2yω02x,where z=x,yT is the state vector of the VDP oscillator.

Elevator reflex generation

The elevator reflex is activated when the step obstacle occurs during the halfway of the swing phase, provided that the obstacle is not too large to negotiate. For the single-leg control, the elevator reflex is switched on when the following conditions hold simultaneously.

  • The single-leg is sweeping during the halfway of the swing phase, namely ẋ1>0.

  • The contact force components Ftoex and Ftoey satisfy Ftoex>Fcontactx or Ftoey>Fcontacty.

To successfully pass through the step obstacle, the

General control framework

The locomotion control framework for hexapod walking robot is established as illustrated in Fig. 11. The movement of each leg is governed by only one CPG controller. A finite state machine (FSM) is introduced to allocate the swing/stance phase of each leg according to the discrete event such as leg touchdown, lift-off. Since the walking pattern of the hexapod walking robot is determined by the movements of α-joint in each leg, the FSM could regulate the waveform of the leader neuron z1 in each

Simulation results

The simulation on a virtual model is conducted to testify the performance of the proposed locomotion controller in generating adaptive tripod gait pattern as well as treating terrain perturbations by using the presented local reactive mechanisms. The virtual model together with the irregular terrains is created in MSC.ADAMS software. The proposed locomotion control framework including the FSM as well as the CPG network integrated with two local reaction mechanisms is fulfilled in

Comparison with conventional CPG-based methods

Network coupling scheme has always been a crucial issue in the CPG-based control no matter what neuron model is used. How to systematically construct a CPG network capable of generating both rhythmical movement and adaptive behaviors is yet unsettled. The main contribution of this paper is to present a simple but yet effective coupling scheme to construct a coupled CPG network composed of three VDP neurons as the single-leg controller wherein the local reflexes could be generated by either

Conclusions

In this paper, a CPG-based locomotion control method with local reactive behavior is presented for hexapod walking robot to enhance the adaptability when dealing with irregular terrains. We develop a two-layered CPG-based single-leg controller to produce nominal trajectory of each leg in tripod gait pattern. On the high-layer, the VDP oscillator is introduce to construct to a coupled neuron network that generates rhythmic signals with prescribed frequencies and phase-lags. The coupling scheme

Declaration of Competing Interest

The authors declare that they have no financial and personal relationships with other people or organizations that can inappropriately influence the work.

Acknowledgments

This work was supported in part by the National Key Research and Development Program of China (No. SQ2019YFB130016), the National Natural Science Foundation of China under Grant No. 51605115 and No. 91948202, Self-Planned Task (No. SKLRS201719A) of State Key Laboratory of Robotics and System (HIT), Open Projects (No. DMETKF2019013) of State Key Lab of Digital Manufacturing Equipment & Technology (HUST), Heilongjiang Postdoctoral Financial Assistance (LBH-Z16083) and Natural Science Foundation

Haitao Yu received the B.S., M.S. and Ph.D. degree in mechanical engineering from Harbin Institute of Technology (HIT), Harbin, China, in 2007, 2009, and 2014, respectively. He was a visiting scholar with the control system and robotics laboratory at the department of aerospace engineering, Ryerson University, Toronto, ON, Canada, from 2014 to 2015 before he jointed HIT where he is currently working as a lecturer with the School of Mechatronics. His research interests include bio-inspired

References (39)

  • WangT. et al.

    CPG Control for biped hopping robot in unpredictable environment

    J. Bionic Eng.

    (2012)
  • EspenschiedK.S. et al.

    Biologically based distributed control and local reflexes improve rough terrain locomotion in a hexapod robot

    Robot. Auton. Syst.

    (1996)
  • NakamuraY. et al.

    Reinforcement learning for a biped robot based on a CPG-actor-critic method

    Neural Netw.

    (2007)
  • BässlerU.

    The femur-tibia control system of stick insects — a model system for the study of the neural basis of joint control

    Brain Res. Rev.

    (1993)
  • GaoH. et al.

    A real-time, high fidelity dynamic simulation platform for hexapod robots on soft terrain

    Simul. Model. Pract. Theory

    (2016)
  • TóthT.I. et al.

    A kinematic model of stick-insect walking

    Physiol. Rep.

    (2019)
  • C.J. Dallmann, V. Dürr, J. Schmitz, Motor control of an insect leg during level and incline walking, J. Exp. Biol. 222...
  • NelsonG.M. et al.

    Posture control of a cockroach-like robot

    IEEE Control Syst. Mag.

    (1999)
  • AltendorferR. et al.

    RHex: a biologically inspired hexapod runner

    Auton. Robots

    (2001)
  • Cited by (32)

    View all citing articles on Scopus

    Haitao Yu received the B.S., M.S. and Ph.D. degree in mechanical engineering from Harbin Institute of Technology (HIT), Harbin, China, in 2007, 2009, and 2014, respectively. He was a visiting scholar with the control system and robotics laboratory at the department of aerospace engineering, Ryerson University, Toronto, ON, Canada, from 2014 to 2015 before he jointed HIT where he is currently working as a lecturer with the School of Mechatronics. His research interests include bio-inspired robots, legged locomotion control and underactuated systems.

    Haibo Gao received the M.S. and Ph.D. degree in mechanical engineering from Harbin Institute of Technology (HIT), Harbin, China, in 1995 and 2003, respectively. He is now a Professor and Vice Dean in School of Mechatronics of HIT, and the Vice Dean of State Key Laboratory of Robotics and System of HIT. His research interests mainly focus on mobile robots, aerospace mechanism and control and multi legged robots.

    Zongquan Deng received MS. Degree in mechanical engineering from the Harbin Institute of Technology (HIT), Harbin, China, in 1984.

    In 1984, He joined the Department of Mechatronics, HIT, where he is currently the Vice President of HIT and the Director of National Defense Key Laboratory of Aerospace Mechanism and Control at HIT. His research interests include aerospace mechanism and control, mobile robots.

    View full text