An assistive upper-limb exoskeleton controlled by multi-modal interfaces for severely impaired patients: development and experimental assessment

https://doi.org/10.1016/j.robot.2021.103822Get rights and content

Highlights

  • The Bridge exoskeleton is an active upper limb assistive device for disabled people.

  • The device is controlled with interfaces suitable for severely impaired patients.

  • Joystick-based and vocal interfaces are used to detect user’s intention.

  • An inverse kinematic algorithm tracks the hand position and drives joints angles.

  • With Bridge, users with muscular dystrophy increased their upper limb functionalities.

Abstract

Active exoskeletons can help adults with muscular dystrophy regain independence and self-esteem, which have been limited due to their severe and progressive muscular weakness. A four degrees-of-freedom fully actuated upper limb exoskeleton, equipped with a spring-based anti-gravity system, has been designed, prototyped, and tested on end-users. While wearing the exoskeleton, the user directly controls the system by actively driving the end-effector position (i.e., the hand) using a joystick or vocal control. The exoskeleton’s kinematic model has been determined so that, given a desired user’s position in the task-space, a differential inverse kinematics algorithm computes the desired joint-space motion trajectories. The dynamic model was investigated in the vertical plane, demonstrating that gravity torques were considerably higher than velocity-induced and inertia torques, which have been therefore neglected. A pilot study on 14 Muscular Dystrophy patients was conducted. Outcome measures included: (i) externally-assessed functional benefit evaluated through the Performance of Upper Limbs module, (ii) self-perceived functional benefit assessed through the ABILHAND questionnaire, and (iii) usability of the system assessed through the System Usability Scale. All participants strongly increased their range of motion, and they were able to perform activities that were not possible without the exoskeleton, such as feeding. The externally-assessed and self-perceived functional improvements were statistically improved when wearing the exoskeleton (PUL p-value=0.001, ABILHAND p-value=0.005). System usability was evaluated to be excellent. Patients’ feedbacks were encouraging and outlined future development steps.

Introduction

“From the patient’s point of view, improvement is measured by regaining lost abilities and by being able to do something – anything – today, she/he couldn’t do yesterday” [1]. People who have muscular dystrophy (MD) progressively lose the ability to walk, stand, and control the function of their arms. This hinders them from performing activities of daily life (ADLs), participating socially, and being independent [2], [3]. Thanks to improved medical care and technical possibilities, life expectancy has increased rapidly [4]. Consequently, most of these patients do not have functional arm movements for more than half of their life, if unsupported. Arm disability has been demonstrated to play a key role in reducing patients’ autonomy and worsening quality of life [5], [6]. In recent decades, some efforts have been made in the field of upper limb assistive devices (ADs). A recent systematic review (14 studies, 184 participants) investigated assistive devices effects on upper limb functionalities of patients with neuromuscular disorders [7], [8]. This study demonstrated that assistive devices significantly increase the ability to perform daily life activities for people affected by neuromuscular diseases, with an associated large effect size in favor of ADs. However, ADs assistance should be tailored to the residual ability of target end-users. To this aim, we divide users with respect to residual ability as evaluated by clinical scales [9]: (i) slightly impaired (i.e., muscular weakness when performing movements and reduced range of motion), (ii) moderately impaired (i.e., from partial to active movement in the absence of gravity), and (iii) severely impaired (i.e., no contraction or traces of contraction which do not result in movement). Recently, we carried out a crossover clinical trial with the two most diffused upper limb assistive devices in the market targeting dystrophic patients [9]. The results showed that, depending on the level of disability, different outcomes are observed for the two tested devices, but none of them cope with the severely impaired end-users.

Assistive devices can be classified as passive, semi-active, or fully-active devices [9]. Most of the exoskeletons developed to assist upper limbs are passive solutions, which require the user to have residual ability to pilot the device. To help the user to fulfill the desired action, an assistive device might move the user’s arm in the space to reach the target (as in the case of exoskeletons or end-effector devices) or independently fulfill the action (as in the case of external manipulators). When coming to exoskeletons, passive devices include the passive A-gear [10], the Exoskeletal Meal Assistance System (EMAS III) [11], or the commercial device Wrex (Jaeco, USA). Wrex has been successfully tested on people with MD with mild impairment, increasing upper limb functionality [9], [12], [13]. These solutions, however, are not suitable for severely impaired patients, given the active contribution required to the user [9].

Some semi-active ADs are available on the market, such as Armon Ayura (Microgravity Products BV, The Netherlands) [14], Electrical Top/Help (Focal Meditech BV, The Netherlands) [15], or the Neater Arm Support (Neater Solutions Ltd, United Kingdom). These devices do provide upper limb(s) support through a forearm brace that provides anti-gravity support. The compensation level is usually remotely controlled and can be adjusted according to users’ needs. However, they still require the user’s muscular effort to drive the device and fulfill the movements. A recent study on MD patients demonstrated their effectiveness on moderately impaired subjects but not on users with very poor residual functional ability [9], [15]. These devices are characterized by an imperfect gravity compensation, and they require sufficient muscle strength to overcome inertia [16].

For the assistance of severely impaired patients, a fully active device is the only solution. While there is a considerable number of powered upper limb exoskeleton in the rehabilitation field (e.g., Armeo Power — Hocoma, Switzerland; Harmony SHR — Harmonic Bionics, USA), few efforts have been devoted to the development of fully active exoskeletons in the assistive technologies field. Kooren and colleagues [17] developed the Active A-Gear, a wearable arm exoskeleton with five degrees-of-freedom (DOFs). The human–machine interface of this device consists of a force sensor attached between the forearm link and the arm to measure the interaction forces between the user and device. However, this device was tested only on one healthy subject. Another example is the A-Arm [18], a planar fully-active arm assistive device. The end-user controls it with a force sensor or through the EMG surface signals acquired from four different muscles (biceps, triceps, deltoid anterior, and deltoid posterior). The A-Arm was tested on one person with MD in a severely impaired condition, and it increased the functional workspace of the user’s arm. However, it only supports movements in the horizontal plane without allowing the participant to support hand-to-mouth movements, critical when coming to daily life activities (e.g., drinking, eating, etc.).

Force and EMG-based controlling strategies have been originally developed for rehabilitation purposes [19], [20], [21]. Such interfaces have been recently tested on three MD patients [22]. In the study, one patient can be classified as moderately impaired (i.e., he/she can raise the hand to the mouth but cannot raise a glass of water, following the Brooke scale classification), and two patients are severely impaired (i.e., cannot raise the hand to the mouth). While the less impaired patients succeeded in using both control interfaces, the most severely impaired subject (i.e., the one who has no useful function of the hand) could not effectively use the force-based control interface. Indeed, the force-based method requires users to have enough force in their arms to be detected by force sensors, which are not reliable for severely impaired patients. Indeed, considering MD patients, the loss of motor function occurs from proximal to distal level. The force-based control requires effort from muscles in the proximal part of the arm. Hence, they become insufficient to target the most compromised patients, especially to move in the anti-gravity direction. Finally, this human–machine interface is generally felt by patients as more fatiguing [23]. EMG control, instead, has been shown as an intuitive and natural control interface for robotic arm supports in adults with MD until the last stage of the disease [24]. However, it was found by MD patients as less intuitive, and the EMG-based interface presents several practical issues (e.g., poor long-term stability of the measurements, high sensitivity to electrode location, the time required to place the electrodes, and uncomfortable feeling due to multiple electrodes in contact with the skin for a long period of time [23]). Despite the technological advancement, patients often still experience problems controlling myoelectric ADs in daily life [25]. A relevant limitation of this approach is that it allows the simultaneous control of only one or two DOFs arm movements. In fact, patients could not simultaneously control the arm support with three DOFs [22].

Nowadays, a possible alternative to fulfill an action completely assisted by the robot are external manipulators, such as the iARM or the JACO robotic arms. They can be mounted on the user’s wheelchair to facilitate the accomplishment of ADLs in people with upper limb impairments [26], [27]. The most common human–machine interface of the JACO system is a three-axis joystick that allows the user to move the robot’s end-effector in the Cartesian space and modify the hand’s pose, and grasp objects [28]. The joystick is constituted by a cylindrical driving system and five pushbuttons permitting to switch between different control modes. However, it is very difficult or even impossible for certain users to use this kind of joystick [29]. Indeed, it is not sensitive, and its big dimensions require wide hand movements that severely impaired patients do not preserve. A possible alternative is a voice-based control, which was demonstrated to be an easy and intuitive alternative for the weakest subjects [29]. However, external manipulators do not preserve a direct interaction of the subject’s arm with the environment. These systems are not directly connected to the users’ arm and completely substitute the users’ action. Differently from the previously described exoskeletons and end-effector systems, external manipulators do not render movement proprioception. This solution could be less accepted by patients, who feel deprived of being part of the action itself.

This study’s specific research question is the design, development, and test of an upper limb assistive device for severely disabled people to fulfill the desired action towards better independence in daily life activities. We followed human-centered (or user-centered) design processes for interactive systems, an approach to interactive system development that focuses specifically on making systems usable. Usability goals, user characteristics, environment, tasks, and workflow of a product, service, or process are given extensive attention at each stage of the design process [30]. In this view, we performed a focus group with three dystrophic patients (end-users), three caregivers, two clinicians, and three engineers to derive specific requirements, which we did not find in any commercial product, nor prototype described in the literature at best of our knowledge. Specifically: (i) the assistive device should move the user’s own arm with no or very little residual force, assuring natural movement proprioception afferent feedbacks; (ii) the upper limb motion should always be under the direct control of the end-user, without using specific pre-defined trajectories or pre-defined actions to be performed; (iii) severely impaired end-users should test the prototype for usability assessment; (iv) the assistance provided by the device should be adequate to permit the end-users to fulfill activities of daily living.

For these reasons, we here propose a new assistive upper limb exoskeleton (i.e., the Bridge exoskeleton). The aim is to provide the user with an AD that detects movement intention and drives the user’s arm in the world space coordinates without performing any muscular forces. This work presents the exoskeleton system design and the efficacy validation on a pilot group of end-users. Section 2 introduces the mechatronic system design and modeling, the control system, and the human–machine interfaces. The clinical experimental protocol is described in Section 3, while the results are reported in Section 4. Finally, Sections 5 Discussion, 6 Conclusion draw, respectively, the discussion and conclusion of the work.

Section snippets

Exoskeletal system design

The Bridge exoskeleton is a four degrees-of-freedom actuated orthosis for upper limb assistance. The system consists of a mechatronic structure, equipped with appropriate stepper motors, motor drivers, a control unit, a screen, and two different human–machine interfaces for motion control, embodied by a joystick and a voice control system (Fig. 1). A preliminary description of the system has been reported in [31], [32].

Participants

Participants were recruited from in-patients and out-patients services at Scientific Institute IRCCS E. Medea and Rehabilitation Institute Villa Beretta starting from July 2018. Eligible participants met the following inclusion criteria: (i) signed informed consent after the explanation of the aims of the study; (ii) diagnosis of Duchenne, Becker, Limb-Girdle type 2 or Facio-scapulo-humeral MD; (iii) wheelchair dependence; (iv) Muscular Rating Council score [50] at the Deltoid and Biceps

Participants

Eight participants have been enrolled at the Scientific Institute IRCCS E. Medea (Bosisio Parini, LC, Italy) and six at the Rehabilitation Institute Villa Beretta (Costa Masnaga, LC, Italy). The participants’ median age was 21 years (IQR 11), with [15–53] years range. The percentage of males was predominant, with thirteen males and only one female enrolled. Study participants were affected by Duchenne (8) and Limb-Girdle Type 2 (6) MD. Participants had a high degree of disability, with a median

Discussion

In this work, we presented and tested the Bridge exoskeleton, developed to help people with muscular dystrophy perform daily life activities and possibly increase their independence and quality of life.

The literature proposed several upper limb assistive devices (ADs) that can improve the quality of life for people with upper limb impairments. However, none of the currently available solutions seems to be adequate when assisting the most compromised patients. Indeed, passive and semi-active

Conclusion

A fully active upper limb exoskeleton was developed and tested on people with muscular dystrophy. The key philosophy of this project was to contrast the everyday experience of these patients of losing arm functions. Thanks to the Bridge exoskeleton, participants could move their own arms to perform the desired action under their direct control. The system, indeed, is controlled by the end-user with a sensitive joystick or vocal control.

This research highlights the effectiveness of upper limb

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgments

This research was made possible by technicians, who helped with the set-up and the training (a special thanks to Valerio Martocchi), and patients who volunteered for the study. Funding: this research was supported by Bridge and Empatia projects funded by Cariplo Foundation, Italy in collaboration with Regione Lombardia, and by the Italian Ministry of Health, Italy (Ricerca Corrente VARA “2018/2019” to Dr. Reni).

Marta Gandolla (M.Sc. in Biomedical Engineering in 2009 and European Ph.D. cum laude in Bioengineering in 2013 from Politecnico di Milano) is currently Assistant Professor at the Department of Mechanical Engineering at Politecnico di Milano. From 2013, she was research fellow at the Neuroengineering and Medical Robotics Laboratory, with which she is currently collaborating with interdisciplinary projects. Her research interest is about neuroengineering, including biomechanics in motor control,

References (64)

  • JanssenM.M. et al.

    2nd Workshop on Upper-Extremity Assistive Technology for People with Duchenne: Effectiveness and Usability of Arm Supports Irvine, USA, 22nd–23rd January 2018

    (2019)
  • GandollaM. et al.

    The effectiveness of wearable upper limb assistive devices in degenerative neuromuscular diseases: A systematic review and meta-analysis

    Front. Bioeng. Biotechnol.

    (2020)
  • GandollaM. et al.

    Research technologies for assistance during daily life activities

  • LongatelliV. et al.

    User-centred assistive SystEm for arm functions in neUromuscuLar subjects (USEFUL): a randomized controlled study

    J. Neuroeng. Rehabil.

    (2021)
  • KoorenP.N. et al.

    Design and pilot validation of A-gear: a novel wearable dynamic arm support

    J. Neuroeng. Rehabil.

    (2015)
  • HasegawaY. et al.

    Exoskeletal meal assistance system (EMAS III) for progressive muscle dystrophy patient

  • EstilowT. et al.

    Use of the wilmington robotic exoskeleton to improve upper extremity function in patients with duchenne muscular dystrophy

    Amer. J. Occup. Ther.

    (2018)
  • RahmanT. et al.

    Design and testing of a functional arm orthosis in patients with neuromuscular diseases

    IEEE Trans. Neural Syst. Rehabil. Eng.

    (2007)
  • LundK. et al.

    A user-centered evaluation study of a mobile arm support

  • Jan BurgersM.J.

    Upper limb training with dynamic arm support in boys with duchenne muscular dystrophy: A feasibility study

    Int. J. Phys. Med. Rehabil.

    (2015)
  • CorriganM.C. et al.

    A novel approach to increase upper extremity active range of motion for individuals with duchenne muscular dystrophy using admittance control: A preliminary study

  • KoorenP.N. et al.

    Design and control of the Active A-Gear: A wearable 5 DOF arm exoskeleton for adults with Duchenne muscular dystrophy

  • StraathofP.T. et al.

    Design and control of the A-Arm: An active planar arm support for adults with Duchenne muscular dystrophy

  • ProiettiT. et al.

    Upper-limb robotic exoskeletons for neurorehabilitation: A review on control strategies

    (2016)
  • Lobo-PratJ. et al.

    Comparison between sEMG and force as control interfaces to support planar arm movements in adults with Duchenne: A feasibility study

    J. Neuroeng. Rehabil.

    (2017)
  • Lobo-PratJ. et al.

    Implementation of EMG- and force-based control interfaces in active elbow supports for men with duchenne muscular dystrophy: A feasibility study

    IEEE Trans. Neural Syst. Rehabil. Eng.

    (2016)
  • Lobo-PratJ. et al.

    Surface EMG signals in very late-stage of Duchenne muscular dystrophy: A case study

    J. Neuroeng. Rehabil.

    (2017)
  • ValkT.A. et al.

    Fixed muscle synergies and their potential to improve the intuitive control of myoelectric assistive technology for upper extremities

    J. Neuroeng. Rehabil.

    (2019)
  • BeaudoinM. et al.

    Long-term use of the JACO robotic arm: a case series

    Disabil. Rehabil.: Assist. Technol.

    (2019)
  • BaldiT.L. et al.

    Design of a wearable interface for lightweight robotic arm for people with mobility impairments

  • MaheuV. et al.

    Evaluation of the JACO robotic arm: clinico-economic study for powered wheelchair users with upper-extremity disabilities

  • PoirierS. et al.

    Voice control interface prototype for assistive robots for people living with upper limb disabilities

  • Cited by (14)

    View all citing articles on Scopus

    Marta Gandolla (M.Sc. in Biomedical Engineering in 2009 and European Ph.D. cum laude in Bioengineering in 2013 from Politecnico di Milano) is currently Assistant Professor at the Department of Mechanical Engineering at Politecnico di Milano. From 2013, she was research fellow at the Neuroengineering and Medical Robotics Laboratory, with which she is currently collaborating with interdisciplinary projects. Her research interest is about neuroengineering, including biomechanics in motor control, neurorobotics and new technologies for motor rehabilitation and motor assistance during daily life activities of fragile people or during exhausting activities of workers.

    Stefano Dalla Gasperina graduated cum laude in M.Sc. Biomedical Engineering in October 2017. Since November 2017 he is Ph.D. student in Biomedical Engineering at the NearLab working with control systems for upper limb personalized robotic exoskeletons. His main research focus regards rehabilitation and assistive robotics with the aim of designing and developing control solutions for compliant cooperative upper-limb exoskeletons. He is now engaged in several projects concerning the development of upper-limb exoskeletons such as the RETRAINER project (H2020), the AGREE Project (Regione Lombardia), and FESleg Project (INAIL).

    Valeria Longatelli graduated cum laude in M.Sc. Biomedical Engineering in April 2019 with the thesis “Upper limb assistive devices to help neuromuscular patients in their daily living”. She is now a Ph.D. student in Biomedical Engineering at the Neuroengineering and Medical Robotics Laboratory and her research regards assistive and rehabilitative upper limb exoskeletons, with a particular focus on objective and quantitative evaluation protocols of exoskeleton performance and system controls. She is engaged in projects concerning the evaluation and development of upper-limb exoskeletons: Bridge, Empatia@Lecco and Useful.

    Alessandro Manti studied Mechanical Engineering at Politecnico di Milano. He is now fellow researcher in Mechatronics and Robotics at the Department of Mechanics. His interests are in the mechanical design, optimization and control of wearable exoskeletons and, in particular, in the development of devices devoted to both assistance and rehabilitation of the upper limb.

    Lorenzo Aquilante was born in Italy in 1989. He received the master degree in Mechatronics and Robotics in 2015, and then the Ph.D. in 2018, both at the Politecnico di Milano. His Ph.D. concerned the design of two different electric actuators to reduce rotor-induced vibrations on a helicopter fuselage. Moreover, he worked on the design of exoskeletons for biomedical research projects. He was a Post-Doc fellow at the department of mechanical engineering of Politecnico di Milano and the main research fields are the design and control of exoskeletons for both healthcare and industrial fields, actuator design and vibration control.

    Maria Grazia D’Angelo got the B.S. Degree in Medicine and Surgery, specialized in Neurology and received Ph.D. Degree in Neurological Sciences (2004). She is currently Head of the Neuromuscular Unit at Scientific Institute IRCCS E. Medea.

    Emilia Biffi obtained a Ph.D. Degree cum laude in Bioengineering in 2012. Since 2013 she is a researcher at the Scientific Institute IRCCS Eugenio Medea. She is involved in projects on new technologies for the rehabilitation and assistance of neuromotor and cognitive impairments of children. She authored 54 publications (h-index: 9). She is the book Editor of a 14-chapter book in the Springer series named “Neuromethods” (2015), and a Review Editor of the Editorial Board of “Neural Technology”, a specialty section of Frontiers in Neuroscience. She has been professor in the class “Electronic and Information Bioengineering” since 2013.

    Eleonora Diella received the degree (cum laude) in Physical therapy from the Università degli Studi dell’Insubria di Varese (Italy) in 2002. She is a Physical therapist at La Nostra Famiglia di Bosisio Parini (Lecco) since 2003. In her work, she deals with cerebral palsy and muscle diseases and her research interest is about technological-mediated therapy, including the use of robotic devices.

    Franco Molteni is Director of Villa Beretta Rehabilitation Centre, Valduce Hospital. He got his Medical Degree from Milan University (1981). He received an award by the Italian Society of Physical Medicine and Rehabilitation (1984). He collaborates with National and International universities. He has led several research projects and scientific collaborations including some funded by the European Commission, the Italian National Council of Research, and Cariplo Foundation. He was Director of the Italian Journal of Rehabilitation Medicine (2002–2006). He is a member of the Italian Society of Physical Medicine and Rehabilitation and the Italian Society for Clinical Movement Analysis.

    Mauro Rossini is Electronic Engineer, and he obtained his degree at the Politecnico of Milan on 1998 with a specialization in Bioengineering. Since 1996 he works as Researcher Consultant of Bioengineering Department of Villa Beretta Rehabilitation Centre. His main research interests are: Gait & Movement Analysis, Electronic Medical Record, Robotic Device for Rehabilitation, Functional Electrical Stimulation, Virtual and Augmented Reality for Rehabilitation.

    Margit Gföhler is Professor and Head of the Research Unit of Biomechanics and Rehabilitation Engineering’ at the Faculty for Mechanical and Industrial Engineering at TU Wien, Vienna, Austria. Her main interest lies on mechanical phenomena in our body - the mechanics of muscles that are coordinated in most complex ways to move our body segments smoothly, or the (fluid)mechanics in our cardiovascular system that provides nutrients to each of our cells and her research aims to apply engineering principles to assist or replace body functions in case of impaired functionality.

    Markus Puchinger is University Assistant at the Research Unit of’Biomechanics and Rehabilitation Engineering’ at the Faculty for Mechanical and Industrial Engineering at TU Wien, Vienna, Austria. His research focuses on computer-aided design, construction and mechatronic optimization of rehabilitation aids. During his work in this research field, he played a decisive role in both the development of passive and active arm exoskeletons and the construction of a novel crank-based wheelchair drive, optimized for the musculoskeletal system of the arm.

    Marco Bocciolone received the M.Sc. degree in mechanical engineering from the Politecnico di Milano, Milan, Italy, in 1986. In 1993, he joined the Department of Mechanical Engineering, Politecnico di Milano, as a Researcher on mechanical and thermal measurements, where he was a Full Professor in 2006 and he has been a Full Professor of applied mechanics since 2012. He is currently the Head of the Department of Mechanical Engineering, olitecnico di Milano.

    Francesco Braghin received the M.Sc. degree in mechanical engineering and the Ph.D. degree in applied mechanics both from Politecnico di Milano, Milano, Italy, in 1997 and 2001, respectively. He became Researcher in 2001 and in 2011 Associate Professor in the Department of Mechanical Engineering, Politecnico di Milano, where, since 2015, he has been a Full Professor in applied mechanics.

    Alessandra Pedrocchi received the M.S. degree in Electrical Engineering and the Ph.D. degree in Bioengineering from the Politecnico di Milano in 1997 and 2001, respectively. She is currently Associate Professor at the Department of Electronics, Informatics and Bioengineering of the Politecnico di Milano. She is one of the founders and responsible of the Neuroengineering section of the NearLab. Her research interest is neuroengineering, including biomechanics in motor control, neurorobotics and new technologies for neurorehabilitation, with a special emphasis on arm exoskeletons for rehabilitation and assistive devices, neuroprostheses and the study of the correlation between brain plasticity and functional recovery.

    1

    These authors equally contributed to the work..

    View full text