Hajar Y Alimam
ABSTRACT
Due to the increasing number of amputees and the need to use prosthetics that simulate human limbs, an improved technique is proposed to classify hand gestures using Deep Recurrent Neural Networks (DRNN) based on the surface Electromyographic (sEMG) signal on the forearm. The implemented models are built on FeedForward Neural Networks (FFNN), Deep Recurrent Neural Networks (DRNN), and Long Short-Term Memory Networks (LSTM) using two types of datasets. They were recorded for four and seven motions, respectively. Both were written by MYO armband, and the conception of the technique is divided into two main phases applied to the two types of datasets. Two DRNN models are implemented, the First is a multi-classifications DRNN with all dataset files imported simultaneously. Each data file is then imported separately as input to the second binary classification DRNN model. Classification results for the multi-DRNN classifier and binary one is compared according to both datasets separately. Results show that the average accuracy for multi-classifications was (95%, and 86%) for both datasets while binary classification was 99% accurate for each model. Additionally, precision, recall, and f1-score were determined for both datasets, yielding better results.
- Roșca AC, Baciu CC, Burtăverde V, Mateizer A. Psychological consequences in patients with amputation of a limb. An Interpretative-Phenomenological Analysis. Frontiers in Psychology. 2021;12.Google Scholar
- Grushko S, Spurný T, Cerny M. Control Methods for Transradial Prostheses Based on Remnant Muscle Activity and Its Relationship with Proprioceptive Feedback. Sensors. 2020;20(17):4883.Google Scholar
- Marinelli A, Boccardo N, Tessari F, Active upper limb prostheses: a review on current state and upcoming breakthroughs. Progress in Biomedical Engineering. 2023;5(1):012001.Google Scholar
- Esposito D, Centracchio J, Andreozzi E, Gargiulo G, Naik GR, Bifulco P. Biosignal-Based Human–Machine Interfaces for Assistance and Rehabilitation: a survey. Sensors. 2021;21(20):6863.Google Scholar
- Del Olmo M, Domingo R. EMG Characterization and Processing in Production engineering. Materials. 2020;13(24):5815. doi:10.3390/ma13245815.Google ScholarCross Ref
- Campbell E, Phinyomark A, Scheme E. Current trends and confounding factors in myoelectric control: limb position and contraction intensity. Sensors. 2020;20(6):1613.Google Scholar
- Nayak S, Das RK. Application of artificial intelligence (AI) in prosthetic and orthotic rehabilitation. In: IntechOpen EBooks. ; 2020.Google ScholarCross Ref
- Zhang S, Suresh LP, Yang J, Zhang X, Tan SC. Augmenting Sensor Performance with Machine Learning Towards Smart Wearable Sensing Electronic Systems. Advanced Intelligent Systems. 2022;4(4):2100194Google Scholar
- Gopal P, Gesta A, Mohebbi A. A systematic study on Electromyography-Based hand gesture recognition for assistive robots using deep learning and machine learning models. Sensors. 2022;22(10):3650.Google Scholar
- Xiong D, Zhang D, Zhao X, Zhao Y. Deep Learning for EMG-based Human-Machine Interaction: A review. IEEE/CAA Journal of Automatica Sinica. 2021;8(3):512-533.Google Scholar
- Nguyen AT, Drealan MW, Luu DK, A portable, self-contained neuroprosthetic hand with deep learning-based finger control. Journal of Neural Engineering. 2021;18(5):056051.Google Scholar
- Aly H, Youssef SM. Bio-signal based motion control system using deep learning models: a deep learning approach for motion classification using EEG and EMG signal fusion. Journal of Ambient Intelligence and Humanized Computing. 2021;14(2):991-1002.Google Scholar
- Dolopikos C, Pritchard M, Bird JJ, Faria DR. Electromyography Signal-Based gesture recognition for Human-Machine interaction in Real-Time through model calibration. In: Springer EBooks. ; 2021:898-914.Google ScholarCross Ref
- Jafarzadeh M, Hussey DC, Tadesse Y. Deep learning approach to control of prosthetic hands with electromyography signals. IEEE International Symposium on Measurement and Control in Robotics (ISMCR. Published online September 1, 2019.Google ScholarCross Ref
- Gautam A, Panwar M, Wankhede A, Locomo-Net: a low -Complex deep learning framework for SEMG-Based hand movement recognition for prosthetic control. IEEE Journal of Translational Engineering in Health and Medicine. 2020;8:2100812.Google Scholar
- Abu MS, Rosleesham S, Suboh MZ, Yid MSM, Kornain Z, Jamaluddin NF. Classification of EMG signal for multiple hand gestures based on neural network. Indonesian Journal of Electrical Engineering and Computer Science. 2020;17(1):256.Google Scholar
- Oh DC, Jo YU. Classification of hand gestures based on multi-channel EMG by scale average wavelet transform and convolutional neural network. International Journal of Control Automation and Systems. 2021;19(3):1443-1450.Google Scholar
- Nahid N, Rahman A, Ahad MdAR. Deep Learning Based Surface EMG Hand Gesture Classification for Low-Cost Myoelectric Prosthetic Hand. 2020 Joint 9th International Conference on Informatics, Electronics & Vision (ICIEV) and 2020 4th International Conference on Imaging, Vision & Pattern Recognition (icIVPR),. Published online August 26, 2020.Google Scholar
- Yashuk K, Perikov I, classify gestures by reading muscle activity. (n.d.). Version 2 2018. | Kaggle. https://www.kaggle.com/datasets/kyr7plus/emg-4.Google Scholar
- Frank A. UCI machine learning repository. EMG data for gestures DataSet.(n.d.).https://archive.ics.uci.edu/ml/datasets/EMG+data+for+gestures.Google Scholar
- Baduge SK, Thilakarathna S, Perera JM, Artificial intelligence and smart vision for building and construction 4.0: Machine and deep learning methods and applications. Automation in Construction. 2022;141:104440.Google Scholar
- Moradi R, Berangi R, Minaei B. A survey of regularization strategies for deep models. Artificial Intelligence Review. 2019;53(6):3947-3986.Google Scholar
- Heaton J. Ian Goodfellow, Yoshua Bengio, and Aaron Courville: Deep learning. Genetic Programming and Evolvable Machines. 2017;19(1-2):305-307.Google Scholar
- Toro-Ossaba A, Jaramillo-Tigreros J, Tejada JC, Pena A, González AL, Castanho RA. LSTM Recurrent Neural Network for hand gesture recognition using EMG signals. Applied Sciences. 2022;12(19):9700.Google Scholar
- Nadjib BL, Bilal C, Rebai K. EMG-Based Hand gesture recognition for myoelectric prosthetic hand control. 2021 International Conference on Artificial Intelligence for Cyber Security Systems and Privacy (AI-CSP). Published online November 20, 2021.Google ScholarCross Ref
- Koch P, Dreier M, Maass M, Phan H, Mertins A. RNN With Stacked Architecture for sEMG based Sequence-to-Sequence Hand Gesture Recognition. ," 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, Netherlands, 2021. Published online January 24, 2021.Google Scholar
- Ameur S, Khalifa AB, Bouhlel MS. A novel hybrid bidirectional unidirectional LSTM network for dynamic hand gesture recognition with Leap Motion. Entertainment Computing. 2020;35:100373.Google Scholar
- Li W, Shi P, Yu H. Gesture recognition using surface electromyography and deep learning for prostheses Hand: State-of-the-Art, Challenges, and Future. Frontiers in Neuroscience. 2021;15.Google Scholar
- Arora S, Gupta A, Jain R, Nayyar A. Optimization of the CNN model for hand sign language recognition using ADAM Optimization Technique. In: Lecture Notes in Networks and Systems. ; 2021:89-104.Google Scholar
- Fricke C, Alizadeh J, Zakhary N, Woost TB, Bogdan M, Classen J. Evaluation of three machine learning algorithms for the automatic classification of EMG patterns in GAIT disorders. Frontiers in Neurology. 2021;12.Google Scholar
Index Terms
- Deep Recurrent Neural Network Approach with LSTM Structure for Hand Movement Recognition Using EMG Signals
Recommendations
Scene text recognition using residual convolutional recurrent neural network
Text is a significant tool for human communication, and text recognition in scene images becomes more and more important. In this paper, we propose a residual convolutional recurrent neural network for solving the task of scene text recognition. The ...
EMG-based online classification of gestures with recurrent neural networks
Highlights- Gesture classification from Electromyography (EMG) signals.
- Evaluated on the ...
Graphical abstractDisplay Omitted
AbstractOnline gesture classification can rely on unsupervised segmentation in order to divide the data stream into static and dynamic segments for individual classification. However, this process requires motion detection calibration and adds ...
The Use of Artificial Neural Network in the Classification of EMG Signals
MUSIC '12: Proceedings of the 2012 Third FTRA International Conference on Mobile, Ubiquitous, and Intelligent ComputingThis paper presents the design, optimization and performance evaluation of artificial neural network for the efficient classification of Electromyography (EMG) signals. The EMG signals are collected for different types of volunteer hand motion which are ...
Comments