Abstract
Motor skills are omnipresent in our daily lives. Humans seek to learn new skills or improve existing ones. In this work, we explore how the actuation of the human body can be used to augment motor skills. We present GeniePutt, which augments the human performance via electrical muscle stimulation (EMS). We conducted a user study in which we controlled the turning angle of the wrist through GeniePutt to increase participants’ accuracy in a mini-golf scenario. Our results indicate that the best accuracy can be achieved when human capabilities are combined with augmentation performed through EMS.
Funding source: Deutscher Akademischer Austauschdienst
Award Identifier / Grant number: 57460599
Funding statement: This research is funded by the DAAD within the context of the Computing for Intercultural Competences (ComIC) project (Grant No: 57460599).
About the authors
Sarah Faltaous is a PhD student at the Human-Computer Interaction Group of the University Duisburg-Essen. She interested in using novel technologies to improve human life.
Aya Abdulmaksoud is a bachelor student at the German University of Cairo, faculty of computer science and Engineering. She is interested in research relating human interaction with technology and computer science.
Markus Kempe is an IT architect and software developer at Heinrich-Heine-University Düsseldorf in a non-research capacity. His current focus is on RE, DevOps and process automation related to campus processes.
Florian Alt is a professor of Usable Security and Privacy at the Bundeswehr University, Munich. He investigates the role of humans in security-critical systems and looks into how user-centered design processes can be made more secure. Florian was a subcommittee chair for CHI 2020 and 2021, TPC chair of Mensch und Computer 2020 and General Chair of MUM 2019. He holds a PhD in computer science from the University of Stuttgart and a diploma in Media Informatics from LMU Munich.
Stefan Schneegass is a professor of Human-Computer Interaction at the University of Duisburg-Essen, Germany. His current research interest is in the area of human-computer interaction, in particular wearable computing and human augmentation. Stefan received a Ph.D. in computer science from the University of Stuttgart, Germany and a M.Sc. from the University of Duisburg-Essen, Germany.
References
1. Adams, J. A., Gopher, D., and Lintern, G. Effects of visual and proprioceptive feedback on motor learning. Journal of Motor Behavior (1977).10.1037/e573672012-004Search in Google Scholar
2. Adams, V. Electromyostimulation to fight atrophy and to build muscle: facts and numbers. Journal of cachexia, sarcopenia and muscle 9, 4 (2018), 631–634.10.1002/jcsm.12332Search in Google Scholar PubMed PubMed Central
3. Cressman, E. K., and Henriques, D. Y. Sensory recalibration of hand position following visuomotor adaptation. Journal of neurophysiology 102, 6 (2009), 3505–3518.10.1152/jn.00514.2009Search in Google Scholar PubMed
4. Dai, T. H., Liu, J. Z., Sahgal, V., Brown, R. W., and Yue, G. H. Relationship between muscle output and functional mri-measured brain activation. Experimental brain research 140, 3 (2001), 290–300.10.1007/s002210100815Search in Google Scholar PubMed
5. Filipovic, A., Kleinoder, H., Dormann, U., and Mester, J. Electromyostimulation-a systematic review of the effects of different ems methods on selected strength parameters in trained and elite athletes. J. Strength Cond. Res 26 (2012), 2600–2614.10.1519/JSC.0b013e31823f2cd1Search in Google Scholar PubMed
6. Galati, G., Committeri, G., Sanes, J. N., and Pizzamiglio, L. Spatial coding of visual and somatic sensory information in body-centred coordinates. European Journal of Neuroscience 14, 4 (2001), 737–746.10.1046/j.0953-816x.2001.01674.xSearch in Google Scholar PubMed
7. Haith, A., Jackson, C. P., Miall, R. C., and Vijayakumar, S. Unifying the sensory and motor components of sensorimotor adaptation. In Advances in neural information processing systems (2009), pp. 593–600.Search in Google Scholar
8. Hassan, M., Daiber, F., Wiehr, F., Kosmalla, F., and Krüger, A. Footstriker: An ems-based foot strike assistant for running. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 1 (2017), 1–18.10.1145/3053332Search in Google Scholar
9. Horn, R. R., and Williams, A. M. Observational learning: Is it time we took another look? In Skill Acquisition in Sport (2004), Routledge, pp. 199–230.10.4324/9780203646564-15Search in Google Scholar
10. Kannan, K. S., Manoj, K., and Arumugam, S. Labeling methods for identifying outliers. International Journal of Statistics and Systems 10, 2 (2015), 231–238.Search in Google Scholar
11. Kasahara, S., Nishida, J., and Lopes, P. Preemptive action: Accelerating human reaction using electrical muscle stimulation without compromising agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (2019), ACM, p. 643.10.1145/3290605.3300873Search in Google Scholar
12. Kim, B. J., and Robinson, C. J. Postural control and detection of slip/fall initiation in the elderly population. Ergonomics 48, 9 (2005), 1065–1085.10.1080/00140130500071028Search in Google Scholar PubMed
13. Kosmalla, F., Daiber, F., Wiehr, F., and Krüger, A. Climbvis: Investigating in-situ visualizations for understanding climbing movements by demonstration. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (New York, NY, USA, 2017), ISS’17 (2017), ACM, pp. 270–279.10.1145/3132272.3134119Search in Google Scholar
14. Kosmalla, F., Murlowski, C., Daiber, F., and Krüger, A. Slackliner – an interactive slackline training assistant. In Proceedings of the 26th ACM International Conference on Multimedia (New York, NY, USA, 2018), MM’18 (2018), ACM, pp. 154–162.10.1145/3240508.3240537Search in Google Scholar
15. Lopes, P., Ion, A., Mueller, W., Hoffmann, D., Jonell, P., and Baudisch, P. Proprioceptive interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (New York, NY, USA, 2015), CHI’15 (2015), Association for Computing Machinery, pp. 939–948.10.1145/2702123.2702461Search in Google Scholar
16. Lopes, P., Jonell, P., and Baudisch, P. Affordance++: allowing objects to communicate dynamic use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), ACM, pp. 2515–2524.10.1145/2702123.2702128Search in Google Scholar
17. Lopes, P., You, S., Cheng, L.-P., Marwecki, S., and Baudisch, P. Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (2017), ACM, pp. 1471–1482.10.1145/3025453.3025600Search in Google Scholar
18. Lopes, P., You, S., Ion, A., and Baudisch, P. Adding force feedback to mixed reality experiences and games using electrical muscle stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (2018), ACM, p. 446.10.1145/3173574.3174020Search in Google Scholar
19. Lopes, P., Yüksel, D., Guimbretière, F., and Baudisch, P. Muscle-plotter: An interactive system based on electrical muscle stimulation that produces spatial output. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (2016), ACM, pp. 207–217.10.1145/2984511.2984530Search in Google Scholar
20. Newell, K. M. Motor skill acquisition. Annual review of psychology 42, 1 (1991), 213–237.10.1146/annurev.ps.42.020191.001241Search in Google Scholar PubMed
21. Niijima, A., Isezaki, T., Aoki, R., Watanabe, T., and Yamada, T. Controlling maximal voluntary contraction of the upper limb muscles by facial electrical stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2018), CHI’18 (2018), Association for Computing Machinery, pp. 1–7.10.1145/3173574.3173968Search in Google Scholar
22. Pfeiffer, M., Duente, T., and Rohs, M. Let your body move: a prototyping toolkit for wearable force feedback with electrical muscle stimulation. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (2016), ACM, pp. 418–427.10.1145/2935334.2935348Search in Google Scholar
23. Pfeiffer, M., Dünte, T., Schneegass, S., Alt, F., and Rohs, M. Cruise control for pedestrians: Controlling walking direction using electrical muscle stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), pp. 2505–2514.10.1145/2702123.2702190Search in Google Scholar
24. Pfeiffer, M., Dünte, T., Schneegass, S., Alt, F., and Rohs, M. Cruise control for pedestrians: Controlling walking direction using electrical muscle stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (2015), ACM, pp. 2505–2514.10.1145/2702123.2702190Search in Google Scholar
25. Pfeiffer, M., Schneegaß, S., and Alt, F. Supporting interaction in public space with electrical muscle stimulation. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (New York, NY, USA, 2013), UbiComp’13 Adjunct (2013), ACM, pp. 5–8.10.1145/2494091.2494094Search in Google Scholar
26. Rubenstein, L. Z. Falls in older people: epidemiology, risk factors and strategies for prevention. Age and ageing 35, suppl_2 (2006), ii37–ii41.10.1093/ageing/afl084Search in Google Scholar PubMed
27. Schneegass, S., Schmidt, A., and Pfeiffer, M. Creating user interfaces with electrical muscle stimulation. Interactions 24, 1 (Dec. 2016), 74–77.10.1145/3019606Search in Google Scholar
28. Sherrington, C.The integrative action of the nervous system. CUP Archive, 1952.Search in Google Scholar
29. Smits-Engelsman, B. C., Niemeijer, A. S., and van Galen, G. P. Fine motor deficiencies in children diagnosed as dcd based on poor grapho-motor ability. Human movement science 20, 1-2 (2001), 161–182.10.1016/S0167-9457(01)00033-1Search in Google Scholar
30. Stifani, N. Motor neurons and the generation of spinal motor neurons diversity. Frontiers in cellular neuroscience 8 (2014), 293.10.3389/fncel.2014.00293Search in Google Scholar
31. Tamaki, E., Miyaki, T., and Rekimoto, J. Possessedhand: Techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2011), CHI’11 (2011), ACM, pp. 543–552.10.1145/1978942.1979018Search in Google Scholar
32. Teka, W. W., Hamade, K. C., Barnett, W. H., Kim, T., Markin, S. N., Rybak, I. A., and Molkov, Y. I. From the motor cortex to the movement and back again. PloS one 12, 6 (2017), e0179288.10.1371/journal.pone.0179288Search in Google Scholar
33. Thelen, E. Coupling perception and action in the development of skill: A dynamic approach. In Sensory-Motor Organizations and Development in Infancy and Early Childhood (Dordrecht, 1990), H. Bloch and B. I. Bertenthal, Eds. (1990), Springer, Netherlands, pp. 39–56.10.1007/978-94-009-2071-2_3Search in Google Scholar
34. Vahdat, S., Darainy, M., Milner, T. E., and Ostry, D. J. Functionally specific changes in resting-state sensorimotor networks after motor learning. Journal of Neuroscience 31, 47 (2011), 16907–16915.10.1523/JNEUROSCI.2737-11.2011Search in Google Scholar
35. Ward, A. R., and Shkuratova, N. Russian electrical stimulation: the early experiments. Physical therapy 82, 10 (2002), 1019–1030.10.1093/ptj/82.10.1019Search in Google Scholar
36. Wolpert, D. M., and Flanagan, J. R. Motor learning. Current biology 20, 11 (2010), R467–R472.10.1016/j.cub.2010.04.035Search in Google Scholar
37. Wolpert, D. M., Ghahramani, Z., and Flanagan, J. R. Perspectives and problems in motor learning. Trends in cognitive sciences 5, 11 (2001), 487–494.10.1016/S1364-6613(00)01773-3Search in Google Scholar
38. Wong, J. D., Kistemaker, D. A., Chin, A., and Gribble, P. L. Can proprioceptive training improve motor learning? Journal of neurophysiology 108, 12 (2012), 3313–3321.10.1152/jn.00122.2012Search in Google Scholar PubMed PubMed Central
39. Wulf, G., McNevin, N., and Shea, C. H. The automaticity of complex motor skill learning as a function of attentional focus. The Quarterly Journal of Experimental Psychology Section A 54, 4 (2001), 1143–1154.10.1080/713756012Search in Google Scholar PubMed
© 2021 Walter de Gruyter GmbH, Berlin/Boston
