skip to main content
10.1145/3316551.3316572acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicdspConference Proceedingsconference-collections
research-article

Finger Motion Estimation Based on Sparse Multi-Channel Surface Electromyography Signals Using Convolutional Neural Network

Published: 24 February 2019 Publication History

Abstract

This paper presents a finger motion estimation based on sparse multi-channel surface electromyography (sEMG) signals using a convolutional neural network (CNN). Although classification with CNNs has achieved high accuracy in gesture recognition, the most cases use a high-density sEMG as the signal acquisition method, which is problematic because this requires many sensors for measuring sEMG signals, resulting in high costs. We therefore propose estimating the finger motion with a sparse multi-channel sEMG method using ring-shaped sensors. The finger motion estimation is performed by classifying images generated from the amplitude variations of sEMG signals, and the image classification is achieved with a simple CNN model featuring two pairs of convolutional and pooling layers and two fully connected layers. Experimental results showed that the test accuracy reached 90% in classifying sEMG signals into four types: thumb opened, thumb closed, fingers (excluding thumb) opened, and fingers (excluding thumb) closed.

References

[1]
Chaudhary, A. 2018. Robust Hand Gesture Recognition for Robotic Hand Control. Springer, Nature Singapore Pte Ltd.
[2]
Kosmidou, V. E., and Hadjileontiadis, L. J. 2009. Sign language recognition using intrinsic-mode sample entropy on sEMG and accelerometer data. IEEE Transactions on Biomedical Engineering. 56, 2879--2890.
[3]
Li, K., Zhou, Z., and Lee, C.-H. 2016. Sign transition modeling and a scalable solution to continuous sign language recognition for real-world applications. ACM Transactions on Accessible Computing. 8, 23 pages.
[4]
Benatti, S., Farella, E., and Benini, L. 2014. Towards EMG control interface for smart garments. In Proceedings of the ACM International Symposium on Wearable Computers: Adjunct Program. ISWC '14. 163--170.
[5]
Amma, C., Krings, T., Böer, J., and Schultz, T. 2015. Advancing muscle-computer interfaces with high-density electromyography. In Proceedings of the ACM Conference on Human Factors in Computing Systems. CHI'15. 929--938.
[6]
Liu, L., Liu, P., Clancy, E. A., Scheme, E., and Englehart, K. B. 2013. Electromyogram whitening for improved classification accuracy in upper limb prosthesis control. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 21, 767--774.
[7]
Leonardis, D., et al. 2015. An EMG-controlled robotic hand exoskeleton for bilateral rehabilitation. IEEE Transactions on Haptics. 8, 140--151.
[8]
Rojas-Martínez, M, Mañanas, M. A., and Alonso, J. F. 2012. High-density surface EMG maps from upper-arm and forearm muscles. Journal of Neuroengineering and Rehabilitation. 9:85.
[9]
Zhang, X., and Zhou, P. 2012. High-Density Myoelectric Pattern Recognition Toward Improved Stroke Rehabilitation. IEEE Transactions on Biomedical Engineering. 59, 6, 1649--1657.
[10]
Amma, C., Krings, T., Böer, J., and Schultz, T. 2015. Advancing Muscle-Computer Interfaces with High-Density Electromyography. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. CHI '15. 929--938.
[11]
Stango, A., Negro, F., and Farina, D. 2015. Spatial Correlation of High Density EMG Signals Provides Features Robust to Electrode Number and Shift in Pattern Recognition for Myocontrol. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 23, 2, 189--198.
[12]
Geng, W., Du, Y., Jin, W., Wei, W., Hu, Y., and Li, J. 2016. Gesture recognition by instantaneous surface EMG images. Scientific Reports. 15; 6:36571.
[13]
Atzori, M., Cognolato, M., and Mller, H., 2016. Deep learning with convolutional neural networks applied to electromyography data: A resource for the classification of movements for prosthetic hands. Frontiers in Neurorobotics. 10, 1--10.
[14]
Côté Allard, U., et al. 2016. A convolutional neural network for robotic arm guidance using sEMG based frequency-features. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS. 2464--2470.
[15]
Kanerva, P. 2009. Hyperdimensional computing: an introduction to computing in distributed representation with high-dimensional random vectors. Cognitive Computation. 1, 2, 139--159.
[16]
Moin, A., et al. 2018. An EMG Gesture Recognition System with Flexible High-Density Sensors and Brain-Inspired High-Dimensional Classifier. In Proceedings of IEEE International Symposium on Circuits and Systems, ISCAS. 1--5.
[17]
Zecca, M., Micera, S., Carrozza, M. C., and Dario, P. 2002. Control of multifunctional prosthetic hands by processing the electromyographic signal. Critical Reviews in Biomedical Engineering. 30, 459--485.
[18]
Englehart, K., Hudgins, B., Parker, P. A., and Stevenson, M. 1999. Classification of the myoelectric signal using time-frequency based representations. Medical Engineering & Physics. 21, 431--438.
[19]
Scheme, E., and Englehart, K. 2011. Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. Journal of Rehabilitation Research & Development. 48:643.
[20]
Krizhevsky, A., Sutskever, I, and Hinton, G. E. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems - Volume 1 (NIPS'12). 1097--1105.
[21]
Aloysius, N. and Geetha, M. 2017. A review on deep convolutional neural networks. In Proceedings of International Conference on Communication and Signal Processing. ICCSP. 0588--0592.
[22]
Zhai, X., Jelfs, B., Chan, R. H., and Tin, C. 2017. Self-recalibrating surface EMG pattern recognition for neuroprosthesis control based on convolutional neural network. Frontiers in Neuroscience. 11:379.
[23]
Hartwell, A., Kadirkamanathan, V., and Anderson, S. R. 2018. Compact deep neural networks for computationally efficient gesture classification from electromyography signals. In Proceedings of 7th IEEE International Conference on Biomedical Robotics and Biomechatronics. Biorob. 891--896.
[24]
Becker, V., Oldrati, P., Barrios, L., and Sörös, G. 2018. Touchsense: classifying finger touches and measuring their force with an electromyography armband. In Proceedings of the ACM International Symposium on Wearable Computers. ISWC '18. 1--8.
[25]
Asai, K., and Takase, N. 2017. Finger motion estimation based on frequency conversion of EMG signals and image recognition using convolutional neural network. In Proceedings of 17th International Conference on Control, Automation and Systems. ICCAS. 1366--1371.
[26]
LeCun, Y., Bottou, L., Bengio, Y., and Haffner, P. 1998. Gradient-based learning applied to document recognition. In Proceedings of the IEEE. 86, 2278--2324.

Cited By

View all
  • (2024)Regressing Variations of Joint Angles for Continuously Estimating Hand Finger Movements From sEMG Signals Using Recurrent Neural NetworksProceedings of the 2024 6th International Conference on Image, Video and Signal Processing10.1145/3655755.3655776(155-161)Online publication date: 14-Mar-2024
  • (2023)A Framework and Call to Action for the Future Development of EMG-Based Input in HCIProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580962(1-23)Online publication date: 19-Apr-2023
  • (2023)Motion Intention Estimation of Finger Motions with Spatial Variations of HD EMG Signals2023 15th International Conference on Computer and Automation Engineering (ICCAE)10.1109/ICCAE56788.2023.10111336(356-360)Online publication date: 3-Mar-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICDSP '19: Proceedings of the 2019 3rd International Conference on Digital Signal Processing
February 2019
170 pages
ISBN:9781450362047
DOI:10.1145/3316551
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 February 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Finger motion estimation
  2. convolutional neural network
  3. electromyography signal
  4. image recognition

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICDSP 2019
ICDSP 2019: 2019 3rd International Conference on Digital Signal Processing
February 24 - 26, 2019
Jeju Island, Republic of Korea

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)5
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Regressing Variations of Joint Angles for Continuously Estimating Hand Finger Movements From sEMG Signals Using Recurrent Neural NetworksProceedings of the 2024 6th International Conference on Image, Video and Signal Processing10.1145/3655755.3655776(155-161)Online publication date: 14-Mar-2024
  • (2023)A Framework and Call to Action for the Future Development of EMG-Based Input in HCIProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580962(1-23)Online publication date: 19-Apr-2023
  • (2023)Motion Intention Estimation of Finger Motions with Spatial Variations of HD EMG Signals2023 15th International Conference on Computer and Automation Engineering (ICCAE)10.1109/ICCAE56788.2023.10111336(356-360)Online publication date: 3-Mar-2023
  • (2021)Touch Detection TechnologiesTouch-Based Human-Machine Interaction10.1007/978-3-030-68948-3_3(19-89)Online publication date: 26-Mar-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media