skip to main content
10.1145/3526113.3545630acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article
Public Access

DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand Gestures

Published: 28 October 2022 Publication History

Abstract

We engineered DigituSync, a passive-exoskeleton that physically links two hands together, enabling two users to adaptively transmit finger movements in real-time. It uses multiple four-bar linkages to transfer both motion and force, while still preserving congruent haptic feedback. Moreover, we implemented a variable-length linkage that allows adjusting the force transmission ratio between the two users and regulates the amount of intervention, which enables users to customize their learning experience. DigituSync's benefits emerge from its passive design: unlike existing haptic devices (motor-based exoskeletons or electrical muscle stimulation), DigituSync has virtually no latency and does not require batteries/electronics to transmit or adjust movements, making it useful and safe to deploy in many settings, such as between students and teachers in a classroom. We validated DigituSync by means of technical evaluations and a user study, demonstrating that it instantly transfers finger motions and forces with the ability of adaptive force transmission, which allowed participants to feel more control over their own movements and to feel the teacher's intervention was more responsive. We also conducted two exploratory sessions with a music teacher and deaf-blind users, which allowed us to gather experiential insights from the teacher's side and explore DigituSync in applications.

References

[1]
Dorit H. Aaron and Caroline W. Stegink Jansen. 2003. Development of the Functional Dexterity Test (FDT): Construction, validity, reliability, and normative data. Journal of Hand Therapy 16, 1: 12–21. https://doi.org/10.1016/S0894-1130(03)80019-4
[2]
Z.A. Abbas and J.S. North. 2018. Good-vs. poor-trial feedback in motor learning: The role of self-efficacy and intrinsic motivation across levels of task difficulty. Learning and Instruction 55: 105–112. https://doi.org/10.1016/j.learninstruc.2017.09.009
[3]
Tomohiro Aka, Shiroku Tatsuru, and Koki Tamashiro. 2011. SKELETONICS SUIT. Retrieved September 19, 2019 from https://ars.electronica.art/nextidea/skeletonics-suit/
[4]
Judith Amores, Xavier Benavides, and Pattie Maes. 2015. ShowMe: A Remote Collaboration System that Supports Immersive Gestural Communication. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ’15, 1343–1348. https://doi.org/10.1145/2702613.2732927
[5]
J. Arata, M. Hattori, S. Ichikawa, and M. Sakaguchi. 2014. Robotically Enhanced Rubber Hand Illusion. IEEE Transactions on Haptics 7, 4: 526–532. https://doi.org/10.1109/TOH.2014.2304722
[6]
J. Arata, K. Ohmoto, R. Gassert, O. Lambercy, H. Fujimoto, and I. Wada. 2013. A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism. In 2013 IEEE International Conference on Robotics and Automation, 3902–3907. https://doi.org/10.1109/ICRA.2013.6631126
[7]
Edwin Johnatan Avila Mireles, Jacopo Zenzeri, Valentina Squeri, Pietro Morasso, and Dalia De Santis. 2017. Skill Learning and Skill Transfer Mediated by Cooperative Haptic Interaction. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 7: 832–843. https://doi.org/10.1109/TNSRE.2017.2700839
[8]
Alison Batchelder, T. F. McLaughlin, K. P. Weber, K. Mark Derby, and Tootie Gow. 2009. The Effects of Hand-Over-Hand and a Dot-to-Dot Tracing Procedure on Teaching an Autistic Student to Write his Name. Journal of Developmental and Physical Disabilities 21, 2: 131–138. https://doi.org/10.1007/s10882-009-9131-2
[9]
Carola Beresford-Cooke, Lynn Williams, and Nicholas Pole. 2003. Shiatsu theory and practice: a comprehensive text for the student and professional. Churchill Livingstone, Edinburgh.
[10]
Mayumi Bono, Rui Sakaida, Ryosaku Makkino, Tomohiro Okada, Kouhei Kikuchi, Mio Cibulka, Louisa Willoughby, Shimako Iwasaki, and Satoshi Fukushima. 2018. Tactile Japanese sign language and finger Braille: An example of data collection for minority languages in Japan. In The 11th edition of the Language Resources and Evaluation Conference (LREC). Retrieved from http://lrec-conf.org/workshops/lrec2018/W1/pdf/18027_W1.pdf
[11]
Dominic A. Brandy. 1995. The O'Connor Tweezer Dexterity Test as a Screening Tool for Hiring Surgical Hair Restoration Assistants. The American Journal of Cosmetic Surgery 12, 4: 313–316. https://doi.org/10.1177/074880689501200406
[12]
Scott Brave and Andrew Dahley. 1997. inTouch: A Medium for Haptic Interpersonal Communication. In CHI ’97 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’97), 363–364. https://doi.org/10.1145/1120212.1120435
[13]
A. Chiri, N. Vitiello, F. Giovacchini, S. Roccella, F. Vecchi, and M. C. Carrozza. 2012. Mechatronic Design and Characterization of the Index Finger Module of a Hand Exoskeleton for Post-Stroke Rehabilitation. IEEE/ASME Transactions on Mechatronics 17, 5: 884–894. https://doi.org/10.1109/TMECH.2011.2144614
[14]
Tim Duente, Max Pfeiffer, and Michael Rohs. 2017. Zap++: a 20-channel electrical muscle stimulation system for fine-grained wearable force feedback. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, 1–13. https://doi.org/10.1145/3098279.3098546
[15]
Ayaka Ebisu, Satoshi Hashizume, Kenta Suzuki, Akira Ishii, Mose Sakashita, and Yoichi Ochiai. 2017. Stimulated percussions: method to control human for learning music by using electrical muscle stimulation. In Proceedings of the 8th Augmented Human International Conference on - AH ’17, 1–5. https://doi.org/10.1145/3041164.3041202
[16]
Cathy Fang, Yang Zhang, Matthew Dworman, and Chris Harrison. 2020. Wireality: Enabling Complex Tangible Geometries in Virtual Reality with Worn Multi-String Haptics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20), 1–10. https://doi.org/10.1145/3313831.3376470
[17]
C. Farrer, G. Valentin, and J. M. Hupé. 2013. The time windows of the sense of agency. Consciousness and Cognition 22, 4: 1431–1441. https://doi.org/10.1016/j.concog.2013.09.010
[18]
Feng Feng and Tony Stockman. 2019. Augmented Visuotactile Feedback Support Sensorimotor Synchronization Skill for Rehabilitation. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 1–6. https://doi.org/10.1145/3290607.3312812
[19]
Rebecca Fribourg, Nami Ogawa, Ludovic Hoyet, Ferran Argelaguet, Takuji Narumi, Michitaka Hirose, and Anatole Lecuyer. 2020. Virtual Co-Embodiment: Evaluation of the Sense of Agency while Sharing the Control of a Virtual Body among Two Individuals. IEEE Transactions on Visualization and Computer Graphics: 1–1. https://doi.org/10.1109/TVCG.2020.2999197
[20]
G. Ganesh, A. Takagi, R. Osu, T. Yoshioka, M. Kawato, and E. Burdet. 2014. Two is better than one: Physical interactions improve motor performance in humans. Scientific Reports 4: 3824 EP-. Retrieved from https://doi.org/10.1038/srep03824
[21]
S. Gentry, E. Feron, and R. Murray-Smith. 2005. Human-human haptic collaboration in cyclical Fitts’ tasks. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, 3402–3407. https://doi.org/10.1109/IROS.2005.1545064
[22]
Takashi Goto, Swagata Das, Katrin Wolf, Pedro Lopes, Yuichi Kurita, and Kai Kunze. 2020. Accelerating Skill Acquisition of Two-Handed Drumming using Pneumatic Artificial Muscles. In Proceedings of the Augmented Humans International Conference, 1–9. https://doi.org/10.1145/3384657.3384780
[23]
Rob Gray. 2017. Transfer of Training from Virtual to Real Baseball Batting. Frontiers in Psychology 8: 2183. https://doi.org/10.3389/fpsyg.2017.02183
[24]
Graham Grindlay. 2008. Haptic Guidance Benefits Musical Motor Learning. In 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 397–404. https://doi.org/10.1109/HAPTICS.2008.4479984
[25]
Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16), 1991–1995. https://doi.org/10.1145/2858036.2858487
[26]
Takayoshi Hagiwara, Gowrishankar Ganesh, Maki Sugimoto, Masahiko Inami, and Michiteru Kitazaki. 2020. Individuals Prioritize the Reach Straightness and Hand Jerk of a Shared Avatar over Their Own. iScience 23, 12: 101732. https://doi.org/10.1016/j.isci.2020.101732
[27]
Shin Hanagata and Yasuaki Kakehi. 2018. Paralogue: A Remote Conversation System Using a Hand Avatar which Postures are Controlled with Electrical Muscle Stimulation. In Proceedings of the 9th Augmented Human International Conference on - AH ’18, 1–3. https://doi.org/10.1145/3174910.3174951
[28]
B. Hannaford, L. Wood, D. A. McAffee, and H. Zak. 1991. Performance evaluation of a six-axis generalized force-reflecting teleoperator. IEEE Transactions on Systems, Man, and Cybernetics 21, 3: 620–633. https://doi.org/10.1109/21.97455
[29]
Mariam Hassib, Max Pfeiffer, Stefan Schneegass, Michael Rohs, and Florian Alt. 2017. Emotion Actuator: Embodied Emotional Feedback through Electroencephalography and Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 6133–6146. https://doi.org/10.1145/3025453.3025953
[30]
Pilwon Heo, Gwang Min Gu, Soo-jin Lee, Kyehan Rhee, and Jung Kim. 2012. Current hand exoskeleton technologies for rehabilitation and assistive engineering. International Journal of Precision Engineering and Manufacturing 13, 5: 807–824. https://doi.org/10.1007/s12541-012-0107-2
[31]
Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. In The 31st Annual ACM Symposium on User Interface Software and Technology - UIST ’18, 901–912. https://doi.org/10.1145/3242587.3242657
[32]
M. Hirano, M. Sakurada, and S. Furuya. 2020. Overcoming the ceiling effects of experts’ motor expertise through active haptic training. Science Advances 6, 47: eabd2558. https://doi.org/10.1126/sciadv.abd2558
[33]
Masato Hirano, Yudai Kimoto, and Shinichi Furuya. 2020. Specialized Somatosensory–Motor Integration Functions in Musicians. Cerebral Cortex 30, 3: 1148–1158. https://doi.org/10.1093/cercor/bhz154
[34]
Simon Holland, Anders J. Bouwer, Mathew Dalgelish, and Topi M. Hurtig. 2010. Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction - TEI ’10, 21. https://doi.org/10.1145/1709886.1709892
[35]
Kevin Huang, Thad Starner, Ellen Do, Gil Weiberg, Daniel Kohlsdorf, Claas Ahlrichs, and Ruediger Leibrandt. 2010. Mobile music touch: mobile tactile stimulation for passive learning. In Proceedings of the 28th international conference on Human factors in computing systems - CHI ’10, 791. https://doi.org/10.1145/1753326.1753443
[36]
Alexandra Ion, Johannes Frohnhofen, Ludwig Wall, Robert Kovacs, Mirela Alistar, Jack Lindsay, Pedro Lopes, Hsiang-Ting Chen, and Patrick Baudisch. 2016. Metamaterial Mechanisms. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, 529–539. https://doi.org/10.1145/2984511.2984540
[37]
Alexandra Ion, David Lindlbauer, Philipp Herholz, Marc Alexa, and Patrick Baudisch. 2019. Understanding Metamaterial Mechanisms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3290605.3300877
[38]
Alexandra Ion, Ludwig Wall, Robert Kovacs, and Patrick Baudisch. 2017. Digital Mechanical Metamaterials. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 977–988. https://doi.org/10.1145/3025453.3025624
[39]
Shoya Ishimaru, Syed Saqib Bukhari, Carina Heisel, Nicolas Großmann, Pascal Klein, Jochen Kuhn, and Andreas Dengel. 2018. Augmented Learning on Anticipating Textbooks with Eye Tracking. In Positive Learning in the Age of Information, Olga Zlatkin-Troitschanskaia, Gabriel Wittum and Andreas Dengel (eds.). Springer Fachmedien Wiesbaden, Wiesbaden, 387–398. https://doi.org/10.1007/978-3-658-19567-0_23
[40]
Shoya Ishimaru, Soumy Jacob, Apurba Roy, Syed Saqib Bukhari, Carina Heisel, Nicolas GroBmann, Michael Thees, Jochen Kuhn, and Andreas Dengel. 2017. Cognitive State Measurement on Learning Materials by Utilizing Eye Tracker and Thermal Camera. In 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), 32–36. https://doi.org/10.1109/ICDAR.2017.378
[41]
Ekaterina Ivanova, Axel Krause, Marie Schalicke, Franziska Schellhardt, Natalie Jankowski, Josy Achner, Henning Schmidt, Michael Joebges, and Jorg Kruger. 2017. Let's do this together: Bi-Manu-Interact, a novel device for studying human haptic interactive behavior. In 2017 International Conference on Rehabilitation Robotics (ICORR), 708–713. https://doi.org/10.1109/ICORR.2017.8009331
[42]
Shixin Jiang and Jun Rekimoto. 2020. Mediated-Timescale Learning: Manipulating Timescales in Virtual Reality to Improve Real-World Tennis Forehand Volley. In 26th ACM Symposium on Virtual Reality Software and Technology, 1–2. https://doi.org/10.1145/3385956.3422128
[43]
Lynette A. Jones and Susan J. Lederman. 2006. Human hand function. Oxford University Press, New York, NY, US. https://doi.org/10.1093/acprof:oso/9780195173154.001.0001
[44]
Shunichi Kasahara, Mitsuhito Ando, Kiyoshi Suganuma, and Jun Rekimoto. 2016. Parallel Eyes: Exploring Human Capability and Behaviors with Paralleled First Person View Sharing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16), 1561–1572. https://doi.org/10.1145/2858036.2858495
[45]
Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: Integrating First-person View with Out-of-body Vision Generation for Human-human Augmentation. In Proceedings of the 5th Augmented Human International Conference (AH ’14), 46:1-46:8. https://doi.org/10.1145/2582051.2582097
[46]
Shunichi Kasahara, Kazuma Takada, Jun Nishida, Kazuhisa Shibata, Shinsuke Shimojo, and Pedro Lopes. 2021. Preserving Agency During Electrical Muscle Stimulation Training Speeds up Reaction Time Directly After Removing EMS. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–9. https://doi.org/10.1145/3411764.3445147
[47]
Hiroki Kawasaki, Hiroyuki Iizuka, Shin Okamoto, Hideyuki Ando, and Taro Maeda. 2010. Collaboration and skill transmission by first-person perspective view sharing system. In 19th International Symposium in Robot and Human Interactive Communication, 125–131. https://doi.org/10.1109/ROMAN.2010.5598668
[48]
Charles R. Kelley. 1969. What is Adaptive Training? Human Factors: The Journal of the Human Factors and Ergonomics Society 11, 6: 547–556. https://doi.org/10.1177/001872086901100602
[49]
Yudai Kimoto, Takanori Oku, and Shinichi Furuya. 2019. Neuromuscular and biomechanical functions subserving finger dexterity in musicians. Scientific Reports 9, 1: 12224. https://doi.org/10.1038/s41598-019-48718-9
[50]
David Kirk, Tom Rodden, and Danaë Stanton Fraser. 2007. Turn it this way: grounding collaborative action with remote gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’07, 1039–1048. https://doi.org/10.1145/1240624.1240782
[51]
Michinari Kono, Yoshio Ishiguro, Takashi Miyaki, and Jun Rekimoto. 2018. Design and Study of a Multi-Channel Electrical Muscle Stimulation Toolkit for Human Augmentation. In Proceedings of the 9th Augmented Human International Conference on - AH ’18, 1–8. https://doi.org/10.1145/3174910.3174913
[52]
Keitaro Kurosaki, Hiroki Kawasaki, Daisuke Kondo, Hiroyuki Iizuka, Hideyuki Ando, and Taro Maeda. 2011. Skill transmission for hand positioning task through view-sharing system. In Proceedings of the 2nd Augmented Human International Conference on - AH ’11, 1–4. https://doi.org/10.1145/1959826.1959846
[53]
Catherine E. Lang and Marc H. Schieber. 2003. Differential Impairment of Individuated Finger Movements in Humans After Damage to the Motor Cortex or the Corticospinal Tract. Journal of Neurophysiology 90, 2: 1160–1170. https://doi.org/10.1152/jn.00130.2003
[54]
Nianlong Li, Han-Jong Kim, LuYao Shen, Feng Tian, Teng Han, Xing-Dong Yang, and Tek-Jin Nam. 2020. HapLinkage: Prototyping Haptic Proxies for Virtual Hand Tools Using Linkage Mechanism. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, 1261–1274. https://doi.org/10.1145/3379337.3415812
[55]
Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15, 2515–2524. https://doi.org/10.1145/2702123.2702128
[56]
Azumi Maekawa, Shota Takahashi, MHD Yamen Saraiji, Sohei Wakisaka, Hiroyasu Iwata, and Masahiko Inami. 2019. Naviarm: Augmenting the Learning of Motor Skills using a Backpack-type Robotic Arm System. In Proceedings of the 10th Augmented Human International Conference 2019 on - AH2019, 1–8. https://doi.org/10.1145/3311823.3311849
[57]
Vittorio Megaro, Jonas Zehnder, Moritz Bächer, Stelian Coros, Markus Gross, and Bernhard Thomaszewski. 2017. A computational design tool for compliant mechanisms. ACM Transactions on Graphics 36, 4: 1–12. https://doi.org/10.1145/3072959.3073636
[58]
A. Melendez-Calderon, L. Bagutti, B. Pedrono, and E. Burdet. 2011. Hi5: A versatile dual-wrist device to study human-human interaction and bimanual control. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2578–2583. https://doi.org/10.1109/IROS.2011.6094422
[59]
Luke E. Miller, Matthew R. Longo, and Ayse P. Saygin. 2014. Tool morphology constrains the effects of tool use on body representations. Journal of Experimental Psychology: Human Perception and Performance 40, 6: 2143–2153. https://doi.org/10.1037/a0037777
[60]
Sosuke Miura and Masanori Sugimoto. 2006. Supporting children's rhythm learning using vibration devices. In CHI ’06 extended abstracts on Human factors in computing systems - CHI EA ’06, 1127. https://doi.org/10.1145/1125451.1125664
[61]
Ken Nakagaki, Chikara Inamura, Pasquale Totaro, Thariq Shihipar, Chantine Akikyama, Yin Shuang, and Hiroshi Ishii. 2015. Linked-Stick: Conveying a Physical Experience using a Shape-Shifting Stick. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ’15, 1609–1614. https://doi.org/10.1145/2702613.2732712
[62]
S. Nakagawara, H. Kajimoto, N. Kawakami, S. Tachi, and I. Kawabuchi. 2005. An Encounter-Type Multi-Fingered Master Hand Using Circuitous Joints. In Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2667–2672. https://doi.org/10.1109/ROBOT.2005.1570516
[63]
Marla Narazani. 2018. Designing Foot-Based Interaction for Wearable Skill Transfer Systems. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers - UbiComp ’18, 1787–1788. https://doi.org/10.1145/3267305.3277818
[64]
Jun Nishida, Soichiro Matsuda, Hiroshi Matsui, Shan-Yuan Teng, Ziwei Liu, Kenji Suzuki, and Pedro Lopes. 2020. HandMorph: a Passive Exoskeleton that Miniaturizes Grasp. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, 565–578. https://doi.org/10.1145/3379337.3415875
[65]
Jun Nishida, Kei Nakai, Akira Matsushita, and Kenji Suzuki. 2015. Haptic Augmentation of Surgical Operation Using a Passive Hand Exoskeleton. In Haptic Interaction: Perception, Devices and Applications, Hiroyuki Kajimoto, Hideyuki Ando and Ki-Uk Kyung (eds.). Springer Japan, Tokyo, 237–243. https://doi.org/10.1007/978-4-431-55690-9_45
[66]
Jun Nishida and Kenji Suzuki. 2017. bioSync: A Paired Wearable Device for Blending Kinesthetic Experience. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17), 3316–3327. https://doi.org/10.1145/3025453.3025829
[67]
Jun Nishida, Hikaru Takatori, Kosuke Sato, and Kenji Suzuki. 2015. CHILDHOOD: Wearable Suit for Augmented Child Experience. In Proceedings of the 2015 Virtual Reality International Conference (VRIC ’15), 22:1-22:4. https://doi.org/10.1145/2806173.2806190
[68]
Jun Nishida, Keisuke Yagi, Modar Hassan, and Kenji Suzuki. 2019. Wearable Kinesthetic I/O Device for Sharing Wrist Joint Stiffness. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 3306–3310. https://doi.org/10.1109/EMBC.2019.8857538
[69]
Takanori Oku and Shinichi Furuya. 2017. Skilful force control in expert pianists. Experimental Brain Research 235, 5: 1603–1615. https://doi.org/10.1007/s00221-017-4926-3
[70]
Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI ’15, 2505–2514. https://doi.org/10.1145/2702123.2702190
[71]
Ilia G. Polushin, Amir Takhmar, and Rajni V. Patel. 2015. Projection-Based Force-Reflection Algorithms With Frequency Separation for Bilateral Teleoperation. IEEE/ASME Transactions on Mechatronics 20, 1: 143–154. https://doi.org/10.1109/TMECH.2014.2307334
[72]
K. Reed, M. Peshkin, J.E. Colgate, and J. Patton. 2004. Initial studies in human-robot-human interaction: Fitts’ law for two people. In IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA ’04. 2004, 2333-2338 Vol.3. https://doi.org/10.1109/ROBOT.2004.1307410
[73]
Kyle Reed, Michael Peshkin, Mitra J. Hartmann, Marcia Grabowecky, James Patton, and Peter M. Vishton. 2006. Haptically Linked Dyads: Are Two Motor-Control Systems Better Than One? Psychological Science 17, 5: 365–366. https://doi.org/10.1111/j.1467-9280.2006.01712.x
[74]
Kyle Reed, Michael Peshkin, Mitra Hartmann, James Patton, Peter Vishton, and Marcia Grabowecky. 2006. Haptic cooperation between people, and between people and machines. In 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2109–2114. https://doi.org/10.1109/IROS.2006.282489
[75]
W. S. Rehm. 1998. “The man who made Peekskill famous”: Dr. C.R. Johnston–first blind chiropractor. Chiropractic History: The Archives and Journal of the Association for the History of Chiropractic 18, 2: 81–92.
[76]
Katja Rogers, Michael Weber, Amrei Röhlig, Matthias Weing, Jan Gugenheimer, Bastian Könings, Melina Klepsch, Florian Schaub, Enrico Rukzio, and Tina Seufert. 2014. P.I.A.N.O.: Faster Piano Learning with Interactive Projection. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS ’14, 149–158. https://doi.org/10.1145/2669485.2669514
[77]
Ron J.C.M. Salden, Fred Paas, Nick J. Broers, and Jeroen J.G. van Merriënboer. 2004. Mental Effort and Performance as Determinants for the Dynamic Selection of Learning Tasks in Air Traffic Control Training. Instructional Science 32, 1/2: 153–172. https://doi.org/10.1023/B:TRUC.0000021814.03996.ff
[78]
MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami. 2018. Fusion: Full Body Surrogacy for Collaborative Communication. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH ’18), 7:1-7:2. https://doi.org/10.1145/3214907.3214912
[79]
Sotaro Shimada, Kensuke Fukuda, and Kazuo Hiraki. 2009. Rubber Hand Illusion under Delayed Visual Feedback. PLOS ONE 4, 7: 1–5. https://doi.org/10.1371/journal.pone.0006185
[80]
Isabelle M. Shuggi, Hyuk Oh, Patricia A. Shewokis, and Rodolphe J. Gentili. 2017. Mental workload and motor performance dynamics during practice of reaching movements under various levels of task difficulty. Neuroscience 360: 166–179. https://doi.org/10.1016/j.neuroscience.2017.07.048
[81]
C. Stein and E. J. Yerxa. 1990. A Test of Fine Finger Dexterity. American Journal of Occupational Therapy 44, 6: 499–504. https://doi.org/10.5014/ajot.44.6.499
[82]
Andrea Story. 1997. Hand-Over-Hand Guidance: What Lesson Do We Teach? The National Federation of the Blind Magazine for Parents and Teachers of Blind Children Vol. 23, No. 2. Retrieved September 2, 2021 from https://nfb.org/images/nfb/publications/fr/fr14/fr04setc.htm
[83]
Atsushi Takagi, Gowrishankar Ganesh, Toshinori Yoshioka, Mitsuo Kawato, and Etienne Burdet. 2017. Physically interacting individuals estimate the partner's goal to enhance their movements. Nature Human Behaviour 1: 0054 EP-. Retrieved from https://doi.org/10.1038/s41562-017-0054
[84]
Atsushi Takagi, Masaya Hirashima, Daichi Nozaki, and Etienne Burdet. 2019. Individuals physically interacting in a group rapidly coordinate their movement by estimating the collective goal. eLife 8: e41328. https://doi.org/10.7554/eLife.41328
[85]
Atsushi Takagi, Francesco Usai, Gowrishankar Ganesh, Vittorio Sanguineti, and Etienne Burdet. 2018. Haptic communication between humans is tuned by the hard or soft mechanics of interaction. PLOS Computational Biology 14, 3: e1005971. https://doi.org/10.1371/journal.pcbi.1005971
[86]
Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing Electrical Muscle Stimulation's Dexterity by means of Back of the Hand Actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–12. https://doi.org/10.1145/3411764.3445761
[87]
Nobuhiro Takahashi, Hayato Takahashi, and Hideki Koike. 2019. Soft Exoskeleton Glove Enabling Force Feedback for Human-Like Finger Posture Control with 20 Degrees of Freedom. In 2019 IEEE World Haptics Conference (WHC), 217–222. https://doi.org/10.1109/WHC.2019.8816142
[88]
Ryo Takizawa, Takayoshi Hagiwara, Adrien Verhulst, Masaaki Fukuoka, Michiteru Kitazaki, and Maki Sugimoto. 2021. Dynamic Shared Limbs: An Adaptive Shared Body Control Method Using EMG Sensors. In Augmented Humans Conference 2021, 10–18. https://doi.org/10.1145/3458709.3458932
[89]
Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI ’11, 543. https://doi.org/10.1145/1978942.1979018
[90]
Sho Tatsuno, Tomohiko Hayakawa, and Masatoshi Ishikawa. 2017. Trajectory adjustment system for learning based on electrical stimulation. In Proceedings of the 8th Augmented Human International Conference on - AH ’17, 1–4. https://doi.org/10.1145/3041164.3041197
[91]
Sho Tatsuno, Tomohiko Hayakawa, and Masatoshi Ishikawa. 2017. Supportive training system for sports skill acquisition based on electrical stimulation. In 2017 IEEE World Haptics Conference (WHC), 466–471. https://doi.org/10.1109/WHC.2017.7989946
[92]
Joseph Tiffin and E. J. Asher. 1948. The Purdue Pegboard: norms and studies of reliability and validity. Journal of Applied Psychology 32, 3: 234–247. https://doi.org/10.1037/h0061266
[93]
P. Toiviainen and T. Eerola. 2016. MIDI toolbox 1.1. GitHub repository. Retrieved from https://github.com/miditoolbox/1.1
[94]
Genki Toyama and Tomoko Hashida. 2018. A Detachable Exoskeleton Interface that Duplicates the User's Hand Posture and Motions. In Proceedings of the 9th Augmented Human International Conference, 1–5. https://doi.org/10.1145/3174910.3174923
[95]
Hsin-Ruey Tsai, Jun Rekimoto, and Bing-Yu Chen. 2019. ElasticVR: Providing Multilevel Continuously-Changing Resistive Force and Instant Impact Using Elasticity for VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19, 1–10. https://doi.org/10.1145/3290605.3300450
[96]
Dishita G Turakhia, Yini Qi, Lotta-Gili Blumberg, Andrew Wong, and Stefanie Mueller. 2021. Can Physical Tools that Adapt their Shape based on a Learner's Performance Help in Motor Skill Training? In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction, 1–12. https://doi.org/10.1145/3430524.3440636
[97]
Dishita G Turakhia, Andrew Wong, Yini Qi, Lotta-Gili Blumberg, Yoonji Kim, and Stefanie Mueller. 2021. Adapt2Learn: A Toolkit for Configuring the Learning Algorithm for Adaptive Physical Tools for Motor-Skill Learning. In Designing Interactive Systems Conference 2021, 1301–1312. https://doi.org/10.1145/3461778.3462128
[98]
Thomas Waltemate, Irene Senna, Felix Hülsmann, Marieke Rohde, Stefan Kopp, Marc Ernst, and Mario Botsch. 2016. The Impact of Latency on Perceptual Judgments and Motor Performance in Closed-loop Interaction in Virtual Reality. In Proceedings of the 22Nd ACM Conference on Virtual Reality Software and Technology (VRST ’16), 27–35. https://doi.org/10.1145/2993369.2993381
[99]
A. Wege and G. Hommel. 2005. Development and control of a hand exoskeleton for rehabilitation of hand injuries. In 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, 3046–3051. https://doi.org/10.1109/IROS.2005.1545506
[100]
Daniel M. Wegner, Betsy Sparrow, and Lea Winerman. 2004. Vicarious Agency: Experiencing Control Over the Movements of Others. Journal of Personality and Social Psychology 86, 6: 838–848. https://doi.org/10.1037/0022-3514.86.6.838
[101]
Nadir Weibel, Danilo Gasques, Janet Johnson, Thomas Sharkey, Zhuoqun Robin Xu, Xinming Zhang, Enrique Zavala, Michael Yip, and Konrad Davis. 2020. ARTEMIS: Mixed-Reality Environment for Immersive Surgical Telementoring. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1–4. https://doi.org/10.1145/3334480.3383169
[102]
Robrecht P.R.D. van der Wel, Natalie Sebanz, and Guenther Knoblich. 2012. The sense of agency during skill learning in individuals and dyads. Consciousness and Cognition 21, 3: 1267–1279. https://doi.org/10.1016/j.concog.2012.04.001
[103]
J. P. Whitney, Tianyao Chen, J. Mars, and J. K. Hodgins. 2016. A hybrid hydrostatic transmission and human-safe haptic telepresence robot. In 2016 IEEE International Conference on Robotics and Automation (ICRA), 690–695.
[104]
Christopher D. Wickens, Shaun Hutchins, Thomas Carolan, and John Cumming. 2013. Effectiveness of Part-Task Training and Increasing-Difficulty Training Strategies: A Meta-Analysis Approach. Human Factors: The Journal of the Human Factors and Ergonomics Society 55, 2: 461–470. https://doi.org/10.1177/0018720812451994
[105]
Louisa Willoughby, Howard Manns, Shimako Iwasaki, and Meredith Bartlett. 2020. From Seeing to Feeling: How Do Deafblind People Adapt Visual Sign Languages? In Dynamics of Language Changes: Looking Within and Across Languages, Keith Allan (ed.). Springer Singapore, Singapore, 235–252. https://doi.org/10.1007/978-981-15-6430-7_15
[106]
Xiao Xiao and Hiroshi Ishii. 2011. MirrorFugue: communicating hand gesture in remote piano collaboration. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction - TEI ’11, 13. https://doi.org/10.1145/1935701.1935705
[107]
Hongyi Xu, Espen Knoop, Stelian Coros, and Moritz Bächer. 2018. Bend-it: design and fabrication of kinetic wire characters. ACM Transactions on Graphics 37, 6: 1–15. https://doi.org/10.1145/3272127.3275089
[108]
Jing Xu, Naveed Ejaz, Benjamin Hertler, Meret Branscheidt, Mario Widmer, Andreia V. Faria, Michelle D. Harran, Juan C. Cortes, Nathan Kim, Pablo A. Celnik, Tomoko Kitago, Andreas R. Luft, John W. Krakauer, and Jörn Diedrichsen. 2017. Separable systems for recovery of finger strength and control after stroke. Journal of Neurophysiology 118, 2: 1151–1163. https://doi.org/10.1152/jn.00123.2017
[109]
Vibol Yem, Kevin Vu, Yuki Kon, and Hiroyuki Kajimoto. 2018. Effect of Electrical Stimulation Haptic Feedback on Perceptions of Softness-Hardness and Stickiness While Touching a Virtual Object. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 89–96. https://doi.org/10.1109/VR.2018.8446403
[110]
Toshihiro Yukawa and Tetsuya Kumada. 2010. Continuously variable transmission using quadric crank chains. In 2010 8th IEEE International Conference on Industrial Informatics, 1043–1048. https://doi.org/10.1109/INDIN.2010.5549598
[111]
Beste F. Yuksel, Kurt B. Oleson, Lane Harrison, Evan M. Peck, Daniel Afergan, Remco Chang, and Robert JK Jacob. 2016. Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty Based on Brain State. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5372–5384. https://doi.org/10.1145/2858036.2858388
[112]
Beste Filiz Yuksel, Daniel Afergan, Evan Peck, Garth Griffin, Lane Harrison, Nick Chen, Remco Chang, and Robert Jacob. 2015. Braahms: A Novel Adaptive Musical Interface Based On Users’ Cognitive State. https://doi.org/10.5281/ZENODO.1181418
[113]
Ran Zhang, Thomas Auzinger, Duygu Ceylan, Wilmot Li, and Bernd Bickel. 2017. Functionality-aware retargeting of mechanisms to 3D shapes. ACM Transactions on Graphics 36, 4: 1–13. https://doi.org/10.1145/3072959.3073710
[114]
Roger Zimmermann, Elaine Chew, Sakire Arslan Ay, and Moses Pawar. 2008. Distributed musical performances: Architecture and stream management. ACM Transactions on Multimedia Computing, Communications, and Applications 4, 2: 1–23. https://doi.org/10.1145/1352012.1352018

Cited By

View all
  • (2024)Passive Haptic Rehearsal for Augmented Piano Learning in the WildProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997488:4(1-26)Online publication date: 21-Nov-2024
  • (2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
  • (2024)Nervous System Interception: A New Paradigm for HapticsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686715(1-5)Online publication date: 13-Oct-2024
  • Show More Cited By

Index Terms

  1. DigituSync: A Dual-User Passive Exoskeleton Glove That Adaptively Shares Hand Gestures

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
    October 2022
    1363 pages
    ISBN:9781450393201
    DOI:10.1145/3526113
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Exoskeletons
    2. Haptics
    3. Mechanics
    4. Skill sharing

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    UIST '22

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)603
    • Downloads (Last 6 weeks)47
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Passive Haptic Rehearsal for Augmented Piano Learning in the WildProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997488:4(1-26)Online publication date: 21-Nov-2024
    • (2024)Motor-Skill-Download System Using Electrical Muscle Stimulation for Enhancing Piano PlayingCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681942(313-317)Online publication date: 5-Oct-2024
    • (2024)Nervous System Interception: A New Paradigm for HapticsAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686715(1-5)Online publication date: 13-Oct-2024
    • (2024)SeaHare: An omidirectional electric wheelchair integrating independent, remote and shared control modalitiesProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675657(1-16)Online publication date: 27-Oct-2024
    • (2024)Understanding the Effects of Restraining Finger Coactivation in Mid-Air Typing: from a Neuromechanical PerspectiveProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676441(1-18)Online publication date: 13-Oct-2024
    • (2024)JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676440(1-15)Online publication date: 13-Oct-2024
    • (2024)DexteriSync: A Hand Thermal I/O Exoskeleton for Morphing Finger Dexterity ExperienceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676422(1-12)Online publication date: 13-Oct-2024
    • (2024)An Accessible, Three-Axis Plotter for Enhancing Calligraphy Learning through Generated MotionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642792(1-11)Online publication date: 11-May-2024
    • (2023)Learning Effects and Retention of Electrical Muscle Stimulation in Piano PlayingProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611373(104-108)Online publication date: 8-Oct-2023
    • (2023)Robust Finger Interactions with COTS Smartwatches via Unsupervised Siamese AdaptationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606794(1-14)Online publication date: 29-Oct-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media