Elsevier

Neurocomputing

Volume 380, 7 March 2020, Pages 78-86
Neurocomputing

Quaternion broad learning system: A novel multi-dimensional filter for estimation and elimination tremor in teleoperation

https://doi.org/10.1016/j.neucom.2019.10.059Get rights and content

Abstract

In this paper, a novel quaternion broad learning system is proposed in this paper for tremor estimation and elimination in teleoperation. In the new proposed QBLS, the architecture can be divided into three layers, including quaternion feature layer, enhancement layer and the output layer. In quaternion feature layer, a quaternion-value auto-encoder (QAE) based on the quaternion algebra is proposed and employed to extract the unsupervised features in quaternion domain. Moreover, the enhancement nodes are mapped to improve the system’s regression ability in enhancement layer. In the output layer, the nodes of feature layer and enhancement layer are concatenated to map the output of QBLS. The weight parameters of output layer can be calculated by the minimum norm least squares solutions. In addition, the semi-physical simulation experiment is completed and the new proposed QBLS has been compared with some existing methods. Finally, the effectiveness and efficiency of QBLS are demonstrated by experimental results.

Introduction

Nowadays, the operator’s manipulation and sensing capabilities are extended to a remote location by the tele-robotics [1]. The master-slave robot system facilitates off-site robotic performance of a desired task and ensures cost-effectiveness, safety and accessibility. Hence, tele-robotics systems have been widespread used in the range of mining, space medicine [2], underwater exploration, robotics-assisted minimally invasive surgery [3], [4], [5], robotic surgical training [6], [7], rehabilitation assistant [8], [9] and so on. In [10], a tele-robotic system consists of the following parts:

  • (1)

    a manipulator arm;

  • (2)

    a master device;

  • (3)

    a communication channel.

As shown in Fig. 1, the overall scheme of a simplified Master–Slave(MS) teleoperation system. In the teleoperation system, the communication random delay problem of adaptive control is inevitable. To overcome this challenge, some related research has been carried out in [11], [12]. Moreover, the precision of the control signal is critical for the high precision operations of the teleoperation robot. However, the control signal of telerobotics system is disturbed by the physiological tremor of operator which is defined as a roughly, involuntary, sinusoidal component inherent in normal hand motion [13]. Therefore, physiological tremor canceling has become an urgent problem in many fields.

In the past decade, a large number of filter have been proposed to solve this problem. In adaptive filter technology, the bandlimited multiple Fourier linear combiner (BMFLC) and weighted Fourier linear combiner (WFLC) which are relied on truncated Fourier series [14], [15], [16], [17] have been popular to estimate the physiological tremulous motion without any phase delay. Further, BMFLC, least squares support vector machines (MWLS-SVM) [18] methods and autoregressive methods [19] are proposed to perform a multi-step prediction of the hand tremor to tackle the unknown and known phase delays. Moreover, adaptive fuzzy wavelet neural network filter (FWNNF) and the time-sequence-based fuzzy support vector machine (TS-FSVM) are proposed in [20], [21] to cancel the physiological tremor of a minimally invasive surgery (MIS). The methods mentioned above are one-dimensional methods which have defects for estimation the multidimensional data of the actual teleoperating system.

Recently, the study of multi-dimensional method has become the focus gradually. In [22], quaternion algebra is defined as a calculation tool for multidimensional data. In the quaternion domain, the multi-dimensional features can be extracted better rather than extracted independently for each dimension. Therefore, there are some classical algorithms are extended to the quaternion version, such as the quaternion least square method (QLSM) [23], [24] and the quaternion weighted fourier linear combiner (QWFLC) [17] and so on. The quaternion-value algorithms have been experimentally verified that they have better performance in multidimensional signal processing than the real-value methods. In [25], [26], [27], a efficient machine learning algorithm which is named broad learning system (BLS) is proposed. Therefore, this paper further develops a quaternion version of this efficient BLS.

This paper proposes a novel quaternion broad learning system (QBLS) for estimation and elimination the tremor. In this work, the proposed QBLS is an extension of broad learning system (BLS) [26]. The architecture of the new proposed QBLS include quaternion feature layer, enhancement layer and the output layer. Meanwhile, the quaternion auto-encoder is proposed to extract the multi-dimensional features in the quaternion layer. In enhancement layer, the enhancement nodes are mapped by feature nodes. Moreover, all the nodes are concatenated as a matrix to map the output of the new proposed QBLS. In addition, the semi-physical simulation experiment is completed and the new proposed QBLS has been compared with some representative methods. Finally, the effectiveness and efficiency of QBLS are demonstrated by experimental results.

The remainder of this paper is organized as follows. In Section 2, some preliminaries are provided. The overview of teleoperation system is descried in Section 3. In Section 4, the details of the new proposed QBLS is given. Finally, the semi-physical simulation experiment is completed in Section 5 and conclusion is drown in Section 6.

Section snippets

Quaternion algebra

Quaternion is defined as a noncommutative extension of complex numbers, and it is consisted of four variables. In maths, a quaternion variable can be expressed as qH1×1 which has a real/scalar part R(q) that the value is denoted with superscript a, and a vector part s(q) comprising of three imaginary part that its elements are denoted with superscript b, c, and d). A quaternion can be denoted as:p=pa+pbı+pcj+pdκq={R(q),s(q)}=qa+qbı+qcj+qdκwhere pa,pb,pc,pd,qa,qb,qc,qdR are the real numbers.

Overview of telerobotics system

With the development of robot technology, teleoperation robot system has been widely applied to complete the various complex tasks such as: microsurgery, space teleoperation, deep-sea exploration and so on. In teleoperation master-slave robot system, the operator can perform a complex task remotely by a mechanical arm.

As shown in Fig. 2, the tele-robotics system, which is employed in the semi-physical simulation, can be divided into a 6 degrees of freedom (DOF) robotic arm and a master data

Data processing of QBLS

In the aforementioned teleoperation platform, signals can be collected from the sensors, including angle signals, acceleration signals, etc. These collected signals are three-dimensional time series in time domain. In order to transform the data into the quaternion space, a transformation of signals is required. In this section, the details of data transformation are given. In the new proposed quaternion broad learning system (QBLS), three-dimensional signals are converted into quaternion

Semi-physical experiment

To demonstrate the effectiveness and efficiency of the novel quaternion broad learning system (QBLS), this section has carried on the semi-physical simulation experiment.

Conclusion

This work proposes a new QBLS for tremor estimation and elimination in master-slave system. In this work, the traditional broad learning system(BLS) is expanded to a quaternion version. Structure of the novel method includes quaternion feature layer, enhancement layer and output layer. In quaternion feature layer, potential features can be extracted in quaternion domain. In the simulation section, results of semi-physical experiment have shown the effectiveness of QBLS for estimating the

Declaration of Competing Interest

None.

Acknowledgment

This work was supported in part by the National Natural Science Foundation of China under Grant 61573108, in part by the Natural Science Foundation of Guangdong Province 2016A030313715, and in part by Guangdong Province Universities and Colleges Pearl River Scholar Funded Scheme.

Jiatai Lin received the B.S. degree from the Guangdong University of Technology, Guangdong, China, in 2017, where he is currently pursuing the M.S degree with the Department of Automation. His research interests include adaptive control, fuzzy logic systems, neural networks, unmanned aerial vehicle, and robotics.

References (48)

  • F. Wang et al.

    Finite time control of switched stochastic nonlinear systems

    Fuzzy Sets Syst.

    (2019)
  • F. Wang et al.

    Finite time control of switched stochastic nonlinear systems

    Fuzzy Sets Syst.

    (2019)
  • H. Zhang et al.

    Augmented quaternion extreme learning machine

    IEEE Access

    (2019)
  • M. Shahbazi et al.

    Position-force domain passivity of the human arm in telerobotic systems

    IEEE/ASME Trans. Mechatron.

    (2018)
  • M. Shahbazi et al.

    Novel cooperative teleoperation framework: multi-master/single-slave system

    IEEE/ASME Trans. Mechatron.

    (2015)
  • R. L’orsa et al.

    Introduction to haptics for neurosurgeons

    Neurosurgery

    (2013)
  • J. Burgner et al.

    A telerobotic system for transnasal surgery

    IEEE/ASME Trans. Mechatron.

    (2014)
  • M. Shahbazi et al.

    A dual-user teleoperated system with virtual fixtures for robotic surgical training

    Proceedings of the 2013 IEEE International Conference on Robotics and Automation

    (2013)
  • M. Shahbazi et al.

    An expertise-oriented training framework for robotics-assisted surgery

    Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA)

    (2014)
  • P.R. Culmer et al.

    A control strategy for upper limb robotic rehabilitation with a dual robot system

    IEEE/ASME Trans. Mechatron.

    (2010)
  • S.F. Atashzar et al.

    Networked teleoperation with non-passive environment: application to tele-rehabilitation

    Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems

    (2012)
  • Z. Lu et al.

    Predictive approach for sensorless bimanual teleoperation under random time delays with adaptive fuzzy control

    IEEE Trans. Ind. Electron.

    (2018)
  • Z. Li et al.

    Trilateral teleoperation of adaptive fuzzy force/motion control for nonlinear teleoperators with communication random delays

    IEEE Trans. Fuzzy Syst.

    (2013)
  • S. Tatinati et al.

    Multistep prediction of physiological tremor based on machine learning for robotics assisted microsurgery

    IEEE Trans. Cybern.

    (2015)
  • Cited by (15)

    • The capacity estimation and cycle life prediction of lithium-ion batteries using a new broad extreme learning machine approach

      2020, Journal of Power Sources
      Citation Excerpt :

      BL is an emerging method for modeling complex system effectively. Based on flat network structure, its structure can be extended in a broad sense [25]. It performs feature mapping on the input data, captures the internal correlation of the input features, produces mapping features and constructs feature mapping nodes.

    • Three-domain fuzzy wavelet broad learning system for tremor estimation

      2020, Knowledge-Based Systems
      Citation Excerpt :

      As shown in Fig. 4(b), the tremor signals are preacquired. This work collects training samples and test samples on these signals, including 700 samples for training and 100 samples for testing [43]. This work designs a comparative experiment in which we compare the new method with some existing methods including fuzzy broad learning system (Fuzzy BLS [24]), wavelet broad learning filter (WBLF [42]) and quaternion broad learning system (QBLS [43]).

    View all citing articles on Scopus

    Jiatai Lin received the B.S. degree from the Guangdong University of Technology, Guangdong, China, in 2017, where he is currently pursuing the M.S degree with the Department of Automation. His research interests include adaptive control, fuzzy logic systems, neural networks, unmanned aerial vehicle, and robotics.

    Zhi Liu received the B.S. degree from Huazhong University of Science and Technology, Wuhan, China, in 1997, the M.S. degree from Hunan University, Changsha, China, in 2000, and the Ph.D degree from Tsinghua University, Beijing, China, in 2004, all in electrical engineering. He is currently a Professor in the Department of Automation, Guangdong University of Technology, Guangzhou, China. His research interests include fuzzy logic systems, neural networks, robotics, and robust control.

    C.L. Philip Chen received his M.S. degree in electrical engineering from the University of Michigan, Ann Arbor, MI, USA, in 1985, and the Ph.D. degree in electrical engineering from Purdue University, West Lafayette, IN, USA, in 1988. He was a tenured Professor, the department head, and an associate dean with two different universities in the U.S. for 23 years. Currently, he is a chair professor with the Department of Computer and Information Science, Faculty of Science and Technology, University of Macau, Macau, China. The University of Macau’s Engineering and Computer Science programs receiving Hong Kong Institute of Engineers’ (HKIE) accreditation and Washington/Seoul Accord is his utmost contribution in engineering/computer science education for Macau as the former Dean of the Faculty. His current research interests include systems, cybernetics, and computational intelligence. Dr. Chen was the IEEE SMC Society President from 2012 to 2013 and a Vice President of Chinese Association of Automation (CAA). He is a Fellow of IEEE, AAAS, IAPR, CAA, and HKIE. He has been the editor-in-chief of the IEEE Transaction on Systems, Man, and Cybernetics: Systems, since 2014 and an associate editor of several IEEE Transactions. He was the Chair of TC 9.1 Economic and Business Systems of International Federation of Automatic Control (2015–2017), and also a Program Evaluator of the Accreditation Board of Engineering and Technology Education (ABET) of the U.S. for computer engineering, electrical engineering, and software engineering programs. He received 2016 Outstanding Electrical and Computer Engineers award from his alma mater, Purdue University.

    Yun Zhang received the B.S. and M.S. degrees in automatic engineering from Hunan University, Changsha, China, in 1982 and 1986, respectively, and the Ph.D. degree in automatic engineering from the South China University of Science and Technology, Guangzhou, China, in 1998. He is currently a Professor with the Department of Automation, Guangdong University of Technology, Guangzhou, China. His research interests include intelligent control systems, network systems, and signal processing.

    View full text