research-article

Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle Stimulation

Authors:

Arinobu Niijima,

Yuki KuboAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 743, Pages 1 - 13

https://doi.org/10.1145/3544548.3581192

Published: 19 April 2023 Publication History

Abstract

Fingertip force control plays an important role in learning motor skills. Exoskeleton gloves have been developed to assist with fingertip force control, but having the equipment on the fingers interferes with finger motion control and tactile sensation. Thus, we present a system for assisting with voluntary fingertip force control that does not require any devices to be worn on the fingers. In this study, we focused particularly on lateral pinch force, which is grip force achieved with the pad of the thumb and the lateral surface of the index finger to grasp objects. We use active bio-acoustic sensing to estimate voluntary pinch force with piezo elements attached to the back of the hand and electrical muscle stimulation (EMS) to the forearm to control involuntary pinch force in a closed-loop system. We developed three prototypes and conducted user studies to investigate whether our system can assist with pinch force control under several target forces, from weak to strong. Our user studies showed that the combination of active bio-acoustic sensing and EMS can assist users in maintaining the pinch force closer to the target force.

Supplementary Material

MP4 File (3544548.3581192-video-preview.mp4)

Video Preview

Download
8.79 MB

MP4 File (3544548.3581192-talk-video.mp4)

Pre-recorded Video Presentation

Download
33.85 MB

References

[1]

Elahe Abdi, Dana Kulić, and Elizabeth Croft. 2020. Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User’s Performance. IEEE Transactions on Biomedical Engineering 67, 12 (2020), 3438–3451. https://doi.org/10.1109/TBME.2020.2987603

[2]

B Abernethy, RJ Neal, MJ Moran, and AW Parker. 1990. Expert-novice differences in muscle activity during the golf swing. In Science and golf: Proceedings of the first World Scientific Congress of Golf. E&FN Spon London, 54–60.

[3]

Jonas Auda, Max Pascher, and Stefan Schneegass. 2019. Around the (virtual) world: infinite walking in virtual reality using electrical muscle stimulation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–8. https://doi.org/10.1145/3290605.3300661

Digital Library

[4]

Vincent Becker, Pietro Oldrati, Liliana Barrios, and Gabor Soros. 2018. Touchsense: classifying finger touches and measuring their force with an electromyography armband. In Proceedings of the 2018 ACM International Symposium on Wearable Computers. 1–8. https://doi.org/10.1145/3267242.3267250

Digital Library

[5]

Delphine Chadefaux, Guillaume Rao, Jean-Loïc Le Carrou, Eric Berton, and Laurent Vigouroux. 2017. The effects of player grip on the dynamic behaviour of a tennis racket. Journal of sports sciences 35, 12 (2017), 1155–1164. https://doi.org/10.1080/02640414.2016.1213411

[6]

Jacob Cohen. 1992. A power primer. Psychological bulletin 112, 1 (1992), 155. https://doi.org/10.1037//0033-2909.112.1.155

[7]

Smita De, Jacob Rosen, Aylon Dagan, Blake Hannaford, Paul Swanson, and Mika Sinanan. 2007. Assessment of tissue damage due to mechanical stresses. The International Journal of Robotics Research 26, 11-12(2007), 1159–1171. https://doi.org/10.1177/0278364907082847

Digital Library

[8]

Carlo J De Luca, L Donald Gilmore, Mikhail Kuznetsov, and Serge H Roy. 2010. Filtering the surface EMG signal: movement artifact and baseline noise contamination. Journal of biomechanics 43, 8 (2010), 1573–1579. https://doi.org/10.1016/j.jbiomech.2010.01.027

[9]

Bachar Dreibati, Cedric Lavet, Antonio Pinti, and Georges Poumarat. 2010. Influence of electrical stimulation frequency on skeletal muscle force and fatigue. Annals of physical and rehabilitation medicine 53, 4 (2010), 266–277.

[10]

Tim Duente, Max Pfeiffer, and Michael Rohs. 2017. Zap++ a 20-channel electrical muscle stimulation system for fine-grained wearable force feedback. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–13. https://doi.org/10.1145/3098279.3098546

Digital Library

[11]

Tim Duente, Justin Schulte, Max Pfeiffer, and Michael Rohs. 2018. Muscleio: muscle-based input and output for casual notifications. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1–21. https://doi.org/10.1145/3214267

Digital Library

[12]

Ayaka Ebisu, Satoshi Hashizume, Kenta Suzuki, Akira Ishii, Mose Sakashita, and Yoichi Ochiai. 2017. Stimulated percussions: method to control human for learning music by using electrical muscle stimulation. In Proceedings of the 8th Augmented Human International Conference. 1–5. https://doi.org/10.1145/3041164.3041202

Digital Library

[13]

Tiago H Falk, Cynthia Tam, Heidi Schellnus, and Tom Chau. 2011. On the development of a computer-based handwriting assessment tool to objectively quantify handwriting proficiency in children. Computer methods and programs in biomedicine 104, 3(2011), e102–e111. https://doi.org/10.1016/j.cmpb.2010.12.010

Digital Library

[14]

Tiago H Falk, Cynthia Tam, Heidi Schwellnus, and Tom Chau. 2010. Grip force variability and its effects on children’s handwriting legibility, form, and strokes. Journal of biomechanical engineering 132, 11 (2010). https://doi.org/10.1115/1.4002611

[15]

Sarah Faltaous, Aya Abdulmaksoud, Markus Kempe, Florian Alt, and Stefan Schneegass. 2021. GeniePutt: Augmenting human motor skills through electrical muscle stimulation. it-Information Technology 63, 3 (2021), 157–166. https://doi.org/10.1515/itit-2020-0035

[16]

Yinfeng Fang, Zhaojie Ju, Xiangyang Zhu, and Honghai Liu. 2014. Finger pinch force estimation through muscle activations using a surface EMG sleeve on the forearm. In 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). IEEE, 1449–1455. https://doi.org/10.1109/FUZZ-IEEE.2014.6891790

[17]

Nobuhiro Funato and Kentaro Takemura. 2017. estimating three-axis contact force for fingertip by emitting vibration actively. In 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 406–411. https://doi.org/10.1109/ROBIO.2017.8324451

[18]

Tricia L Gibo, Darrel R Deo, Zhan Fan Quek, and Allison M Okamura. 2014. Effect of load force feedback on grip force control during teleoperation: A preliminary study. In 2014 IEEE Haptics Symposium (HAPTICS). IEEE, 379–383. https://doi.org/10.1109/HAPTICS.2014.6775485

[19]

Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: an inexpensive and lightweight mechanical exoskeleton for motion capture and force feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 1991–1995. https://doi.org/10.1145/2858036.2858487

Digital Library

[20]

Mahmoud Hassan, Florian Daiber, Frederik Wiehr, Felix Kosmalla, and Antonio Krüger. 2017. Footstriker: an EMS-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1–18. https://doi.org/10.1145/3053332

Digital Library

[21]

Wenjing Hu, Na Wei, Zong-Ming Li, and Ke Li. 2018. Effects of muscle fatigue on directional coordination of fingertip forces during precision grip. PloS one 13, 12 (2018), e0208740. https://doi.org/10.1371/journal.pone.0208740

[22]

Patria A Hume, Justin Keogh, and Duncan Reid. 2005. The role of biomechanics in maximising distance and accuracy of golf shots. Sports medicine 35, 5 (2005), 429–449. https://doi.org/10.2165/00007256-200535050-00005

[23]

Kwangyul Jeong, Franz Konstantin Fuss, Bernd Fuernschuss, and Yehuda Weizman. 2015. Development of a smart kendo sword and assessment of grip pressure of Kamai stance and Kote cut. Procedia Engineering 112(2015), 231–236. https://doi.org/10.1016/j.proeng.2015.07.205

[24]

Shunichi Kasahara, Jun Nishida, and Pedro Lopes. 2019. Preemptive action: accelerating human reaction using electrical muscle stimulation without compromising agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3290605.3300873

Digital Library

[25]

Shunichi Kasahara, Kazuma Takada, Jun Nishida, Kazuhisa Shibata, Shinsuke Shimojo, and Pedro Lopes. 2021. Preserving agency during electrical muscle stimulation training speeds up reaction time directly after removing EMS. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–9. https://doi.org/10.1145/3411764.3445147

Digital Library

[26]

Oliver Beren Kaul, Max Pfeiffer, and Michael Rohs. 2016. Follow the force: Steering the index finger towards targets using EMS. In Proceedings of the 2016 chi conference extended abstracts on human factors in computing systems. 2526–2532. https://doi.org/10.1145/2851581.2892352

Digital Library

[27]

Justin Keogh, S Morrison, and R Barrett. 2006. Age-related differences in inter-digit coupling during finger pinching. European journal of applied physiology 97, 1 (2006), 76–88. https://doi.org/10.1007/s00421-006-0151-7

[28]

Justin W Keogh, Steve Morrison, and Rod Barrett. 2007. Strength training improves the tri-digit finger-pinch force control of older adults. Archives of Physical Medicine and Rehabilitation 88, 8(2007), 1055–1063. https://doi.org/10.1016/j.apmr.2007.05.014

[29]

Yudai Kimoto, Takanori Oku, and Shinichi Furuya. 2019. Neuromuscular and biomechanical functions subserving finger dexterity in musicians. Scientific reports 9, 1 (2019), 1–12. https://doi.org/10.1038/s41598-019-48718-9

[30]

Erin R Komi, Jonathan R Roberts, and SJ Rothberg. 2008. Measurement and analysis of grip force during a golf shot. Proceedings of the Institution of Mechanical Engineers, Part P: Journal of Sports Engineering and Technology 222, 1 (2008), 23–35. https://doi.org/10.1243/17543371JSET9

[31]

Michinari Kono, Takumi Takahashi, Hiromi Nakamura, Takashi Miyaki, and Jun Rekimoto. 2018. Design guideline for developing safe systems that apply electricity to the human body. ACM Transactions on Computer-Human Interaction (TOCHI) 25, 3(2018), 1–36. https://doi.org/10.1145/3184743

Digital Library

[32]

Yuki Kubo, Yuto Koguchi, Buntarou Shizuki, Shin Takahashi, and Otmar Hilliges. 2019. AudioTouch: minimally invasive sensing of micro-gestures via active bio-acoustic sensing. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–13. https://doi.org/10.1145/3338286.3340147

Digital Library

[33]

Francesca Leone, Cosimo Gentile, Anna Lisa Ciancio, Emanuele Gruppioni, Angelo Davalli, Rinaldo Sacchetti, Eugenio Guglielmelli, and Loredana Zollo. 2019. Simultaneous sEMG classification of hand/wrist gestures and forces. Frontiers in Neurorobotics 13 (2019), 42. https://doi.org/10.3389/fnbot.2019.00042

[34]

Jhe-Wei Lin, Chiuan Wang, Yi Yao Huang, Kuan-Ting Chou, Hsuan-Yu Chen, Wei-Luan Tseng, and Mike Y Chen. 2015. Backhand: Sensing hand gestures via back of the hand. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 557–564. https://doi.org/10.1145/2807442.2807462

Digital Library

[35]

Pedro Lopes and Patrick Baudisch. 2013. Muscle-propelled force feedback: bringing force feedback to mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2577–2580. https://doi.org/10.1145/2470654.2481355

Digital Library

[36]

Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: simulating physical impact by combining tactile stimulation with electrical muscle stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 11–19. https://doi.org/10.1145/2807442.2807443

Digital Library

[37]

Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 939–948. https://doi.org/10.1145/2702123.2702461

Digital Library

[38]

Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++ allowing objects to communicate dynamic use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2515–2524. https://doi.org/10.1145/2702123.2702128

Digital Library

[39]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1471–1482. https://doi.org/10.1145/3025453.3025600

Digital Library

[40]

Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding force feedback to mixed reality experiences and games using electrical muscle stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3173574.3174020

Digital Library

[41]

Pedro Lopes, Doăa Yüksel, François Guimbretière, and Patrick Baudisch. 2016. Muscle-plotter: an interactive system based on electrical muscle stimulation that produces spatial output. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 207–217. https://doi.org/10.1145/2984511.2984530

Digital Library

[42]

Stephen A Mascaro and H Harry Asada. 2004. measurement of finger posture and three-axis fingertip touch force using fingernail sensors. IEEE Transactions on Robotics and Automation 20, 1(2004), 26–35. https://doi.org/10.1109/TRA.2003.820931

[43]

Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, 2020. Next steps for human-computer integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15. https://doi.org/10.1145/3313831.3376242

Digital Library

[44]

Sachith Muthukumarana, Denys JC Matthies, Chamod Weerasinghe, Don Samitha Elvitigala, and Suranga Nanayakkara. 2019. CricketCoach: towards creating a better awareness of gripping forces for cricketers. In Proceedings of the 10th Augmented Human International Conference 2019. 1–2. https://doi.org/10.1145/3311823.3311833

Digital Library

[45]

Arinobu Niijima, Takashi Isezaki, Ryosuke Aoki, Tomoki Watanabe, and Tomohiro Yamada. 2018. Controlling maximal voluntary contraction of the upper limb muscles by facial electrical stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–7. https://doi.org/10.1145/3173574.3173968

Digital Library

[46]

Arinobu Niijima and Yuki Kubo. 2021. Assisting with Voluntary Pinch Force Control by Using Electrical Muscle Stimulation and Active Bio-Acoustic Sensing. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology. 11–13. https://doi.org/10.1145/3474349.3480214

Digital Library

[47]

Arinobu Niijima, Toki Takeda, Ryosuke Aoki, and Shinji Miyahara. 2022. Muscle synergies learning with electrical muscle stimulation for playing the piano. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–10. https://doi.org/10.1145/3526113.3545666

Digital Library

[48]

Arinobu Niijima, Toki Takeda, Kentaro Tanaka, Ryosuke Aoki, and Yukio Koike. 2021. Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–17. https://doi.org/10.1145/3478110

Digital Library

[49]

Jun Nishida and Kenji Suzuki. 2017. BioSync: a paired wearable device for blending kinesthetic experience. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3316–3327. https://doi.org/10.1145/3025453.3025829

Digital Library

[50]

Jun Nishida, Yudai Tanaka, Romain Nith, and Pedro Lopes. 2022. DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand Gestures. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–12. https://doi.org/10.1145/3526113.3545630

Digital Library

[51]

Jun Nishida, Keisuke Yagi, Modar Hassan, and Kenji Suzuki. 2019. Wearable kinesthetic I/O device for sharing wrist joint stiffness. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 3306–3310. https://doi.org/10.1109/EMBC.2019.8857538

[52]

Romain Nith, Shan-Yuan Teng, Pengyu Li, Yujie Tao, and Pedro Lopes. 2021. DextrEMS: Increasing Dexterity in Electrical Muscle Stimulation by Combining it with Brakes. In The 34th Annual ACM Symposium on User Interface Software and Technology. 414–430. https://doi.org/10.1145/3472749.3474759

Digital Library

[53]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 31–40. https://doi.org/10.1145/2501988.2501989

Digital Library

[54]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2015. Sensing touch force using active acoustic sensing. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. 355–358. https://doi.org/10.1145/2677199.2680585

Digital Library

[55]

Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE transactions on haptics 10, 4 (2017), 580–600. https://doi.org/10.1109/TOH.2017.2689006

Digital Library

[56]

Dietrich Parlitz, Thomas Peschel, and Eckart Altenmüller. 1998. Assessment of dynamic finger forces in pianists: effects of training and expertise. Journal of biomechanics 31, 11 (1998), 1063–1067. https://doi.org/10.1016/S0021-9290(98)00113-4

[57]

Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, 2011. Scikit-learn: machine learning in python. the Journal of machine Learning research 12, null (2011), 2825–2830. https://doi.org/10.5555/1953048.2078195

Digital Library

[58]

Max Pfeiffer, Tim Duente, and Michael Rohs. 2016. A wearable force feedback toolkit with electrical muscle stimulation. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 3758–3761. https://doi.org/10.1145/2851581.2890238

Digital Library

[59]

Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise control for pedestrians: controlling walking direction using electrical muscle stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2505–2514. https://doi.org/10.1145/2702123.2702190

Digital Library

[60]

Max Pfeiffer and Michael Rohs. 2017. Haptic feedback for wearables and textiles based on electrical muscle stimulation. In Smart textiles. Springer, 103–137. https://doi.org/10.1007/978-3-319-50124-6_6

[61]

Max Pfeiffer, Stefan Schneegass, Florian Alt, and Michael Rohs. 2014. Let me grab this: a comparison of EMS and vibration for haptic feedback in free-hand interaction. In Proceedings of the 5th augmented human international conference. 1–8. https://doi.org/10.1145/2582051.2582099

Digital Library

[62]

Ayane Saito, Wakaba Kuno, Wataru Kawai, Natsuki Miyata, and Yuta Sugiura. 2019. Estimation of fingertip contact force by measuring skin deformation and posture with photo-reflective sensors. In Proceedings of the 10th Augmented Human International Conference 2019. 1–6. https://doi.org/10.1145/3311823.3311824

Digital Library

[63]

Katsuyuki Sakuma, Avner Abrami, Gaddi Blumrosen, Stanislav Lukashov, Rajeev Narayanan, Joseph W Ligman, Vittorio Caggiano, and Stephen J Heisig. 2018. Wearable nail deformation sensing for behavioral and biomechanical monitoring and human-computer interaction. Scientific reports 8, 1 (2018), 1–11. https://doi.org/10.1038/s41598-018-36834-x

[64]

Laura Santos-Carreras, Monika Hagen, Roger Gassert, and Hannes Bleuler. 2012. Survey on surgical instrument handle design: ergonomics and acceptance. Surgical innovation 19, 1 (2012), 50–59. https://doi.org/10.1177/1553350611413611

[65]

Heidi Schwellnus, Heather Carnahan, Azadeh Kushki, Helene Polatajko, Cheryl Missiuna, and Tom Chau. 2013. Writing forces associated with four pencil grasp patterns in grade 4 children. American Journal of Occupational Therapy 67, 2 (2013), 218–227. https://doi.org/10.5014/ajot.2013.005538

[66]

Primož Strojnik, Alojz Kralj, and I Ursic. 1979. Programmed six-channel electrical stimulator for complex stimulation of leg muscles during walking. IEEE Transactions on Biomedical Engineering2 (1979), 112–116. https://doi.org/10.1109/TBME.1979.326520

[67]

Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing electrical muscle stimulation’s dexterity by means of back of the hand actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12. https://doi.org/10.1145/3411764.3445761

Digital Library

[68]

Nobuhiro Takahashi, Shinichi Furuya, and Hideki Koike. 2020. Soft exoskeleton glove with human anatomical architecture: production of dexterous finger movements and skillful piano performance. IEEE Transactions on Haptics(2020). https://doi.org/10.1109/TOH.2020.2993445

Digital Library

[69]

Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 543–552. https://doi.org/10.1145/1978942.1979018

Digital Library

[70]

Sho Tatsuno, Tomohiko Hayakawa, and Masatoshi Ishikawa. 2017. Supportive training system for sports skill acquisition based on electrical stimulation. In 2017 IEEE World Haptics Conference (WHC). IEEE, 466–471. https://doi.org/10.1109/WHC.2017.7989946

[71]

Joseph D Towles, Vincent R Hentz, and Wendy M Murray. 2008. Use of intrinsic thumb muscles may help to improve lateral pinch function restored by tendon transfer. Clinical Biomechanics 23, 4 (2008), 387–394. https://doi.org/10.1016/j.clinbiomech.2007.11.008

[72]

Francisco J Valero-Cuevas. 2000. Predictive modulation of muscle coordination pattern magnitude scales fingertip force magnitude over the voluntary range. Journal of Neurophysiology 83, 3 (2000), 1469–1479. https://doi.org/10.1152/jn.2000.83.3.1469

[73]

Kyosuke Watanabe, Makoto Oka, and Hirohiko Mori. 2020. Feedback control to a static target angle in the middle finger metacarpophalangeal joint using functional electrical stimulation. International Journal of Human–Computer Interaction (2020), 1–11. https://doi.org/10.1080/10447318.2020.1758879

[74]

Eleonora P Westebring-van der Putten, John J van den Dobbelsteen, Richard HM Goossens, Jack J Jakimowicz, and Jenny Dankelman. 2009. Force feedback requirements for efficient laparoscopic grasp control. Ergonomics 52, 9 (2009), 1055–1066. https://doi.org/10.1080/00140130902912803

[75]

Richard W Young. 2003. Evolution of the human hand: the role of throwing and clubbing. Journal of Anatomy 202, 1 (2003), 165–174. https://doi.org/10.1046/j.1469-7580.2003.00144.x

Cited By

Konishi TChoi MShizuki B(2024)Active Acoustic Sensing Based Authentication System Using a Door HandleProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701587(324-330)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701587
Nith RHo YLopes P(2024)SplitBody: Reducing Mental Workload while Multitasking via Muscle StimulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642629(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642629

Index Terms

Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle Stimulation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

Assisting with Voluntary Pinch Force Control by Using Electrical Muscle Stimulation and Active Bio-Acoustic Sensing
UIST '21 Adjunct: Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology

We present a novel wearable system for assisting with voluntary pinch force control that requires no devices on the fingers. We use active bio-acoustic sensing to estimate voluntary pinch force with piezo elements attached to the back of the hand and ...
Effects of Electrical Muscle Stimulation on Memorability of Hand Gestures: A Preliminary Study
Universal Access in Human-Computer Interaction
Abstract
While images and videos can be used to self-learn hand gestures, it can be difficult to learn gestures accurately in terms of the fingers one has to move and when in order to perform gestures by simply observing images or videos, especially with ...
DextrEMS: Increasing Dexterity in Electrical Muscle Stimulation by Combining it with Brakes
UIST '21: The 34th Annual ACM Symposium on User Interface Software and Technology

Electrical muscle stimulation (EMS) is an emergent technique that miniaturizes force feedback, especially popular for untethered haptic devices, such as mobile gaming, VR, or AR. However, the actuation displayed by interactive systems based on EMS is ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
854
Total Downloads

Downloads (Last 12 months)357
Downloads (Last 6 weeks)92

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Konishi TChoi MShizuki B(2024)Active Acoustic Sensing Based Authentication System Using a Door HandleProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701587(324-330)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701587
Nith RHo YLopes P(2024)SplitBody: Reducing Mental Workload while Multitasking via Muscle StimulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642629(1-11)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642629

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Table of Conten