Abstract
In this article, we present an intelligent human-machine interface designed to control the medical robotic exoskeleton of the lower limbs “Remotion”. Intelligent bimodal interface combines tools of contactless voice control, as well as contact sensor-based control on mobile devices. The authors argue that the use of intelligent techniques of interaction between the user and the exoskeleton increases the level of ergonomics as well as effectiveness of its use in medical rehabilitation practice due to an intuitive and natural way of human-machine communication and control. The salient features of the proposed and developed system are automatic voice command recognition, conversion audio signal into text data, remote control and remote supervision of the exoskeleton through a PC, and active and informative feedback with the user, securing safety during rehabilitation sessions. The design of the interface is shown in the paper in details, outlines of engineering solutions applied for this exoskeleton are provided as well. Despite the existence of conceptually similar devices in Russia, the presented exoskeleton differs by the presence of an intelligent user interface, which significantly improves the ergonomics of the system. Another feature is a total modularity of the device. Such a solution greatly facilitates the maintenance of the exoskeleton and provides a range of adjustment opportunities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kapustin, A.V., Loskutov, Yu.V., Skvortsov, D.V., Nasybullin, A.R., Klyuzhev, K.S., Kudryavtsev, A.I.: Circuit solutions for the management of a rehabilitation exoskeleton for medical purposes. Vestnik Povolzhskogo gosudarstvennogo tekhnologicheskogo universiteta 2(38), 77–86 (2018)
Antsaklis, P.J., Passino, K.M.: An Introduction to Intelligent and Autonomous Control. Kluwer Academic Publishers (1993)
Shcherbatov, I.A.: Intellectual control of robotic systems in conditions of uncertainty. Vestnik Astrakhanskogo gosudarstvennogo tekhnicheskogo universiteta 1, 73–77 (2010)
Karpov, A.A., Yusupov, R.M.: Multimodal interfaces of human-computer interaction. Herald Russ. Acad. Sci. 88(1), 67–74 (2018)
Ronzhin, A.L., Yusupov, R.M., Li, I.V.: Speech and Multimodal Interfaces. Moscow (2006)
Ushakov, I.B., Karpov, A.A., Kryuchkov, B.I., Polyakov, A.V., Usov, V.M.: Promising solutions in the field of medical robotics to support crew life and reduce medical risks in space flight. Aviakosmicheskaya i ekologicheskaya meditsina 49(6), 76–83 (2015)
World Robotics - Service Robots 2017: Statistics, Market Analysis, Forecasts and Case Studies. VDMA Verlag, Frankfurt-am-Main (2017)
Ermolov, I.L., Knyaz’kov, M.M., Kryukova, A.A., Sukhanov, A.N., Kryuchkov, B.I., Usov, V.M.: Method of controlling an exoskeleton device using the system of recognition of arm movements on basis of biosignals from the skeletal muscles of a human operator’s arms. Pilotiruemye polety v kosmos 4(17), 80–93 (2015)
Ferris, D.: The exoskeletons are here. J. Neuroeng. Rehabil. 6(17) (2009)
Vorob’ev, A.A., Andryushchenko, F.A., Ponomareva, O.A., Solov’eva, I.O., Krivonozhkina, P.S.: Controversial terminology and classification of exoskeletons (Analytical review, own data, clarifications, suggestions). Volgogradskii nauchno-meditsinskii zhurnal 3(47), 14–20 (2015)
Herr, H.: Exoskeletons and orthoses: classification, design challenges and future directions. J. Neuroeng. Rehabil. 6(21) (2009)
Gorgey, A.S.: Robotic exoskeletons: the current pros and cons. World J. Orthop. 9(9), 112–119 (2018)
Vorob’ev, A.A., Zasypkina, O.A., Krivonozhkina, P.S., Petrukhin, A.V., Pozdnyakov, A.M.: Exoskeleton - the state of the problem and the prospects for the introduction of the system of habilitation and rehabilitation of persons with disabilities (analytical review). Vestnik Volgogradskogo gosudarstvennogo meditsinskogo universiteta 2(54), 9–17 (2015)
Banala, S.K., Agrawal, S.K., Kim, S.H., Scholz, J.P.: Novel gait adaptation and neuromotor training results using an active leg exoskeleton. IEEE/ASME Trans. Mechatron. 15(2), 216–225 (2010)
Banala, S.K., Kim, S.H., Agrawal, S.K., Scholz, J.P.: Robot assisted gait training with Active Leg Exoskeleton (ALEX). IEEE Trans. Neural Syst. Rehabil. Eng. 17(1), 2–8 (2009)
Talaty, M., Esquenazi, A., Briceno, J.E.: Differentiating ability in users of the ReWalk(TM) powered exoskeleton: an analysis of walking kinematics. In: IEEE International Conference on Rehabilitation Robotics (2013)
Exoskeleton (2019). https://bleex.me.berkeley.edu/research/exoskeleton
Bednyak, S.G., Eremina, O.S.: HAL robotic exoskeletons (Feel like a HALc). Sworld 2(1), 49–51 (2009)
USA (2019). http://www.army-technology.co
Ergasheva, B.I.: Lower limb exoskeletons: brief review. Sci. Tech. J. Inf. Technol. Mech. Opt. 17(6), 1153–1158 (2017)
Yan, T., Cempini, M., Oddo, C.M., Vitiello, N.: Review of assistive strategies in powered lower-limb orthoses and exoskeletons. Robot. Auton. Syst. 64, 120–136 (2015)
Robopedia (2019). http://robotrends.ru/robopedia/katalog--ekzoskeletov/
Exoatlet (2019). https://www.exoatlet.com/ru/node/84/
Exoskeletonrepor (2019). https://exoskeletonreport.com/product/arke/
SpeechRecognizer (2019). https://developer.android.com/reference/android/speech/Speech--Recognizer
He, Y., Eguren, D., Azorín, J.M., Grossman, R., Luu, T.Ph., Contreras-Vidal, J.: Brain–machine interfaces for controlling lower–limb powered robotic systems. J. Neural Eng. 15 (2018)
Rosen, M.: Mind to motion: brain-computer interfaces promise new freedom for the paralyzed and immobile. Sci. News 184(10), 22–24 (2013)
Acknowledgments
This work was performed within the joint project “Creating a high–tech production of multifunctional robotic exoskeleton for medical purposes (RME)” No. 2017–218–09–1807, and as a part of state research No. 0073–2019–0005.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kagirov, I. et al. (2020). Lower Limbs Exoskeleton Control System Based on Intelligent Human-Machine Interface. In: Kotenko, I., Badica, C., Desnitsky, V., El Baz, D., Ivanovic, M. (eds) Intelligent Distributed Computing XIII. IDC 2019. Studies in Computational Intelligence, vol 868. Springer, Cham. https://doi.org/10.1007/978-3-030-32258-8_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-32258-8_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32257-1
Online ISBN: 978-3-030-32258-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)