Abstract
Hand gestures are one of the most natural and expressive way for humans to convey information, and thus hand gesture recognition has become a research hotspot in the human-machine interface (HMI) field. In particular, biological signals such as surface electromyography (sEMG) can be used to recognize hand gestures to implement intuitive control systems, but the decoding from the sEMG signal to actual control signals is non-trivial. Blind source separation (BSS)-based methods, such as convolutive independent component analysis (ICA), can be used to decompose the sEMG signal into its fundamental elements, the motor unit action potential trains (MUAPTs), which can then be processed with a classifier to predict hand gestures. However, ICA does not guarantee a consistent ordering of the extracted motor units (MUs), which poses a problem when considering multiple recording sessions and subjects; therefore, in this work we propose and validate three approaches to address this variability: two ordering criteria based on firing rate and negative entropy, and a re-calibration procedure, which allows the decomposition model to retain information about previous recording sessions when decomposing new data. In particular, we show that re-calibration is the most robust approach, yielding an accuracy up to 99.4%, and always greater than 85% across all the different scenarios that we tested. These results prove that our proposed system, which we publish open-source and which is based on biologically plausible features rather than on data-driven, black-box models, is capable of robust generalization.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cannan, J., et al.: Human-machine interaction (HMI): a survey. In: University of Essex (2011)
Guo, L., et al.: Human-machine interaction sensing technology based on hand gesture recognition: a Review. IEEE Trans. Hum.-Mach. Syst. 51(4), 300–309 (2021)
Wei, L., et al.: Gesture recognition using surface electromyography and deep learning for prostheses hand: state-of-the-art, challenges, and future. Front. Neurosci. 15, 621885 (2021)
Zanghieri, M., et al.: sEMG-based regression of hand kinematics with temporal convolutional networks on a low-power edge microcontroller. In: 2021 IEEE International Conference on Omni-Layer Intelligent Systems (COINS), pp. 1–6 (2021)
Merletti, R., et al.: Tutorial. surface EMG detection in space and time: best practices. J. Electromyogr. Kinesiol. 49, 102363 (2019)
Spiewak, C., et al.: A comprehensive study on EMG feature extraction and classifiers. Open Access J. Biomed. Eng. Appl. 1 (2018)
Chen, W., et al.: Hand gesture recognition using compact CNN Via surface electromyography signals. Sensors 20(3), 672 (2020)
Zanghieri, M., et al.: Robust real-time embedded EMG recognition framework using temporal convolutional networks on a multicore IoT processor. In: IEEE Trans. Biomed. Circ. Syst. 14(2), 244–256 (2020)
Masri, G., et al.: Design and control of a myoelectric prosthetic hand using multi-channel blind source separation techniques’. In: 2021 Sixth International Conference on Advances in Biomedical Engineering (ICABME), pp. 54–58 (2021)
Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10(3), 626–634 (1999)
Holobar, A., et al.: Multichannel blind source separation using convolution kernel compensation. In: IEEE Trans. Sign. Process. 55(9), 4487–4496 (2007)
Zanghieri, M., et al.: Temporal variability analysis in sEMG hand grasp recognition using temporal convolutional networks’. In: 2020 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS), pp. 228–232 (2020)
Burrello, A., et al.: Tackling time-variability in sEMG-based gesture recognition with on-device incremental learning and temporal convolutional networks. In: 2021 IEEE Sensors Applications Symposium (SAS), pp. 1–6 (2021)
Gonzalo, G.A., Maekawa, K., Akazawa, K.: Decomposition of synthetic multi-channel surface-electromyogram using independent component analysis. In: Puntonet, C.G., Prieto, A. (eds.) Independent Component Analysis and Blind Signal Separation. ICA 2004. Lecture Notes in Computer Science, vol. 3195, pp. 985–992 . Springer, Berlin, Heidelberg (2004)
Negro, F., et al.: Multi-channel intramuscular and surface EMG decomposition by convolutive blind source separation. J. Neural Eng. 13(2), 026027 (2016)
Thomas, J., et al.: Time-domain fast fixed-point algorithms for convolutive ICA. IEEE Sign. Process. Lett. 13(4), 228–231 (2006)
Barsakcioglu, D., et al.: Control of spinal motoneurons by feedback From a non-invasive real-time interface. IEEE Trans. Biomed. Eng. 1–1 (2020)
Formento, E., et al.: Skilled independent control of individual motor units via a non-invasive neuromuscular-machine interface. J. Neural Eng. 18(6), 066019 (2021)
Dai, C., et al.: Independent component analysis based algorithms for high-density electromyogram decomposition: systematic evaluation through simulation. Comput. Biol. Med. 109, 171–181 (2019)
Jiang, X., et al.: Open access dataset, toolbox and benchmark processing results of high-density surface electromyogram recordings. IEEE Trans. Neural Syst. Rehab. Eng. 29, 1035–1046 (2021)
Fuglevand, A.J., et al.: Models of recruitment and rate coding organization in motor-unit pools. J. Neurophys. 70(6), 2470–2488 (1993)
Mohebian, M.R., et al.: Non-invasive decoding of the motoneurons: a guided source separation method based on convolution kernel compensation with clustered initial points. Front. Comput. Neurosci. 13, 14 (2019)
Kaczmarek, P., et al.: putEMG - a surface electromyography hand gesture recognition dataset. Sensors 19(16) (2019)
Acknowledgements
The work was partially funded by the EU project BONSAPPS (g.a. 101015848).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Orlandi, M., Zanghieri, M., Schiavone, D., Donati, E., Conti, F., Benatti, S. (2023). Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition. In: Valle, M., et al. Advances in System-Integrated Intelligence. SYSINT 2022. Lecture Notes in Networks and Systems, vol 546. Springer, Cham. https://doi.org/10.1007/978-3-031-16281-7_49
Download citation
DOI: https://doi.org/10.1007/978-3-031-16281-7_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16280-0
Online ISBN: 978-3-031-16281-7
eBook Packages: EngineeringEngineering (R0)