skip to main content
10.1145/3025453.3025829acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

bioSync: A Paired Wearable Device for Blending Kinesthetic Experience

Published: 02 May 2017 Publication History

Abstract

We present a novel, paired, wearable system for combining the kinesthetic experiences of two persons. These devices allow users to sense and combine muscle contraction and joint rigidity bi-directionally. This is achieved through kinesthetic channels based on electromyogram (EMG) measurement and electrical muscle stimulation (EMS). We developed a pair of wearable kinesthetic input-output (I/O) devices called bioSync that uses specially designed electrodes to perform biosignal measurement and stimulation simultaneously on the same electrodes.
In a user study, participants successfully evaluated the strength of their partners' muscle contractions while exerting their own muscles. We confirmed that the pair of devices could help participants synchronize their hand movements through tapping, without visual and auditory feedback. The proposed interpersonal kinesthetic communication system can be used to enhance interactions such as clinical gait rehabilitation and sports training, and facilitate sharing of physical experiences with Parkinson's patients, thereby enhancing understanding of the physical challenges they face in daily life.

Supplementary Material

suppl.mov (pn2859-file3.m4v)
Supplemental video
suppl.mov (pn2859p.mp4)
Supplemental video

References

[1]
Jun Nishida, Kanako Takahashi, and Kenji Suzuki. 2015. A wearable stimulation device for sharing and augmenting kinesthetic feedback. In Proceedings of the 6th Augmented Human International Conference (AH '15). ACM, NY, NY, USA, 211--212.
[2]
Jun Nishida, Kenji Suzuki. 2016. bioSync: Wearable haptic I/O device for synchronous kinesthetic interaction. In Proceedings of IEEE Virtual Reality (VR), pp.243--244.
[3]
Jun Nishida and Kenji Suzuki. 2016. bioSync: Synchronous Kinesthetic Experience among People. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, NY, NY, USA, 3742--3745.
[4]
Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: integrating first-person view with out-of-body vision generation for human-human augmentation. In Proceedings of the 5th Augmented Human International Conference (AH '14). ACM, NY, NY, USA, Article 46, 8 pages.
[5]
Shunichi Kasahara, Mitsuhito Ando, Kiyoshi Suganuma, and Jun Rekimoto. 2016. Parallel Eyes: Exploring Human Capability and Behaviors with Paralleled First Person View Sharing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 1561--1572.
[6]
Hiroyuki Iizuka, Daisuke Kondo, Hiroki Kawasaki, Hideyuki Ando, and Taro Maeda. 2011. Coordinated behavior between visually coupled dyads. In Proceedings of the 2nd Augmented Human International Conference (AH '11). ACM, NY, NY, USA, Article 23, 4 pages.
[7]
H. Kawasaki, H. Iizuka, S. Okamoto, H. Ando and T. Maeda. 2010. Collaboration and skill transmission by first-person perspective view sharing system, 19th International Symposium in Robot and Human Interactive Communication, Viareggio, pp. 125--131.
[8]
Scott Brave and Andrew Dahley. 1997. inTouch: a medium for haptic interpersonal communication. In CHI '97 Extended Abstracts on Human Factors in Computing Systems (CHI EA '97). ACM, NY, NY, USA, 363--364.
[9]
Ken Nakagaki, Chikara Inamura, Pasquale Totaro, Thariq Shihipar, Chantine Akikyama, Yin Shuang, and Hiroshi Ishii. 2015. Linked-Stick: Conveying a Physical Experience using a Shape-Shifting Stick. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, NY, NY, USA, 1609--1614.
[10]
Jeremy N. Bailenson, Nick Yee, Scott Brave, Dan Merget and David Koslow. 2007. Virtual Interpersonal Touch: Expressing and Recognizing Emotions Through Haptic Devices. Journal of Human Computer Interaction. vol.22, No.3, 325--353.
[11]
Daniel Leithinger, Sean Follmer, Alex Olwal, and Hiroshi Ishii. 2014. Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration. In Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST '14). ACM, NY, NY, USA, 461--470.
[12]
Hideyuki Nakanishi, Kazuaki Tanaka, and Yuya Wada. 2014. Remote handshaking: touch enhances video-mediated social telepresence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 2143--2152.
[13]
Scott Brave, Clifford Nass and Erenee Sirinian. 2001. Force-Feedback in computer-mediated communication. Proceedings of HCI International '2001 (the 9th International Conference on Human-Computer Interaction), New Orleans, USA, Volume 3, 145--149.
[14]
N. Igarashi, K. Suzuki, H. Kawamoto and Y. Sankai. 2010. bioLights: Light emitting wear for visualizing lower-limb muscle activity, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, 6393--6396.
[15]
Y. Tsubouchi and K. Suzuki. 2010. BioTones: A wearable device for EMG auditory biofeedback. In Proc of Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, 6543--6546.
[16]
Dozza, M., Horak, F.B. and Chiari, L. 2007. Auditory biofeedback substitutes for loss of sensory information in maintaining stance. Experimental Brain Research, Vol.178, No.1, 37--48.
[17]
Raafat Shalaby, Thomas Schauer, Wolfgang Liedecke and Jorg Raisch. 2010. Amplifier design for EMG recording from stimulation electrodes during functional electrical stimulation leg cycling ergometry, Biomedizinische Technik/Biomedical Engineering. Vol. 56, Issue 1, 23--33.
[18]
Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 939--948.
[19]
Emi Tamaki, Takashi Miyaki, and Jun Rekimoto. 2011. PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NY, NY, USA, 543--552.
[20]
Pedro Lopes, Patrik Jonell, and Patrick Baudisch. 2015. Affordance++: Allowing Objects to Communicate Dynamic Use. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2515--2524.
[21]
Pedro Lopes and Patrick Baudisch. 2013. Muscle-propelled force feedback: bringing force feedback to mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 2577--2580.
[22]
Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, NY, NY, USA, 11--19.
[23]
Y. Muraoka. 2001. Development of an emg recording device from stimulation electrodes for functional electrical stimulation. Frontiers of Medical and Biological Engineering: The International Journal of the Japan Society of Medical Electronics and Biological Engineering, vol.11, No.4, 323--333.
[24]
C. M. Harris and D. M. Wolpert. 1998. Signal-dependent noise determines motor planning. Nature, 394, pp.780--784
[25]
Manami Katoh, Narihiro Nishimura, Maki Yokoyama, Taku Hachisu, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2013. Optimal selection of electrodes for muscle electrical stimulation using twitching motion measurement. In Proceedings of the 4th Augmented Human International Conference (AH '13). ACM, NY, NY, USA, 237--238.
[26]
S. Iwarsson. 1999. The housing enabler: An objective tool for assessing accessibility, The British Journal of Occupational Therapy, vol.62, No.11, pp.491--497.
[27]
G. P. Rosati Papini, M. Fontana and M. Bergamasco. 2016. Desktop Haptic Interface for Simulation of Hand-Tremor. IEEE Transactions on Haptics, vol. 9, no. 1, 33--42, Jan.-March 1.
[28]
Jun Nishida, Hikaru Takatori, Kosuke Sato, and Kenji Suzuki. 2015. CHILDHOOD: wearable suit for augmented child experience. In ACM SIGGRAPH 2015 Emerging Technologies (SIGGRAPH '15). ACM, NY, NY, USA, Article 7.
[29]
Suzuki, K., Mito, G., Kawamoto, H., Hasegawa, Y. and Sankai, Y. 2007. Intention-based walking support for paraplegia patients with Robot Suit HAL, Advanced Robotics, Vol.21, pp.1441--1469.
[30]
Bertrand Philippe, Daniel Gonzalez-Franco, Arthur Pointeau, and Christian Cherene. 2014. The Machine to be Another - Embodied Telepresence using human performers. Prix Ars Electronica (2014).

Cited By

View all
  • (2024)CoplayingVR: Understanding User Experience in Shared Control in Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785088:3(1-25)Online publication date: 9-Sep-2024
  • (2024)Real-Time Bidirectional Head Rotation Sharing for Collaborative Interaction EnhancementProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3688878(1-3)Online publication date: 7-Oct-2024
  • (2024)Light Up Fireflies: Towards Understanding the Design of Interpersonal Bodily Intertwinement in Bodily PlayCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678813(169-174)Online publication date: 14-Oct-2024
  • Show More Cited By

Index Terms

  1. bioSync: A Paired Wearable Device for Blending Kinesthetic Experience

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. blending kinesthetic experience
    2. electrical muscle stimulation
    3. electromyogram signals
    4. rehabilitation

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)169
    • Downloads (Last 6 weeks)18
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)CoplayingVR: Understanding User Experience in Shared Control in Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785088:3(1-25)Online publication date: 9-Sep-2024
    • (2024)Real-Time Bidirectional Head Rotation Sharing for Collaborative Interaction EnhancementProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3688878(1-3)Online publication date: 7-Oct-2024
    • (2024)Light Up Fireflies: Towards Understanding the Design of Interpersonal Bodily Intertwinement in Bodily PlayCompanion Proceedings of the 2024 Annual Symposium on Computer-Human Interaction in Play10.1145/3665463.3678813(169-174)Online publication date: 14-Oct-2024
    • (2024)DexteriSync: A Hand Thermal I/O Exoskeleton for Morphing Finger Dexterity ExperienceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676422(1-12)Online publication date: 13-Oct-2024
    • (2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
    • (2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
    • (2024)ExBreath: Explore the Expressive Breath System as Nonverbal Signs towards Semi-unintentional ExpressionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650870(1-7)Online publication date: 11-May-2024
    • (2024)Paired-EMS: Enhancing Electrical Muscle Stimulation (EMS)-based Force Feedback Experience by Stimulating Both Muscles in Antagonistic PairsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642841(1-7)Online publication date: 11-May-2024
    • (2024)Motionless Movement: Towards Vibrotactile Kinesthetic DisplaysProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642499(1-16)Online publication date: 11-May-2024
    • (2024)Electrical Muscle Stimulation System for Automatic Reproduction of Secret Information Without Exposing Biometric DataHCI for Cybersecurity, Privacy and Trust10.1007/978-3-031-61382-1_15(234-249)Online publication date: 1-Jun-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media