skip to main content
10.1145/3311823.3311849acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahConference Proceedingsconference-collections
research-article
Public Access

Naviarm: Augmenting the Learning of Motor Skills using a Backpack-type Robotic Arm System

Published: 11 March 2019 Publication History

Abstract

We present a wearable haptic assistance robotic system for augmented motor learning called Naviarm. This system comprises two robotic arms that are mounted on a user's body and are used to transfer one person's motion to another offline. Naviarm pre-records the arm motion trajectories of an expert via the mounted robotic arms and then plays back these recorded trajectories to share the expert's body motion with a beginner. The Naviarm system is an ungrounded system and provides mobility for the user to conduct a variety of motions. In this paper, we focus on the temporal aspect of motor skill and use a mime performance as a case study learning task. We verified the system effectiveness for motor learning using the conducted experiments. The results suggest that the proposed system has benefits for learning sequential skills.

References

[1]
Mohammed Al-Sada, Keren Jiang, Shubhankar Ranade, Xinlei Piao, Thomas Höglund, and Tatsuo Nakajima. 2018. HapticSerpent: A Wearable Haptic Feedback Robot for VR. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, LBW624.
[2]
CA Avizzano, Jorge Solis, A Frisoli, and M Bergamasco. 2002. Motor learning skill experiments using haptic interface capabilities. In Proc. of 11th IEEE International Workshop on Robot and Human Interactive Communication. 198--203.
[3]
Robert Bogue. 2015. Robotic exoskeletons: a review of recent progress. Industrial Robot: An International Journal 42, 1 (2015), 5--10.
[4]
Laura Marchal Crespo and David J Reinkensmeyer. 2008. Haptic guidance can enhance motor learning of a steering task. Journal ofmotor behavior 40, 6 (2008), 545--557.
[5]
Takahiro Endo and Haruhisa Kawasaki. 2015. A fine motor skill training system using multi-fingered haptic interface robot. International Journal of HumanComputer Studies 84 (2015), 41--50.
[6]
David Feygin, Madeleine Keehner, and R Tendick. 2002. Haptic guidance: Experimental evaluation of a haptic training method for a perceptual motor skill. In Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2002. HAPTICS 2002. Proceedings. 10th Symposium on. IEEE, 40--47.
[7]
Katsuya Fujii, Sophia S Russo, Pattie Maes, and Jun Rekimoto. 2015. MoveMe: 3D haptic support for a musical instrument. In Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology. ACM, 9.
[8]
R Brent Gillespie, M OâÃŹModhrain, Philip Tang, David Zaretzky, and Cuong Pham. 1998. The virtual teacher. In Proceedings of the ASME Dynamic Systems and Control Division, Vol. 64. American Society of Mechanical Engineers, 171--178.
[9]
Diego Felipe Paez Granados, Breno A Yamamoto, Hiroko Kamide, Jun Kinugawa, and Kazuhiro Kosuge. 2017. Dance Teaching by a Robot: Combining Cognitive and Physical Human-Robot Interaction for Supporting the Skill Learning Process. IEEE Robotics and Automation Letters 2, 3 (2017), 1452--1459.
[10]
Graham Grindlay. 2008. Haptic guidance benefits musical motor learning. In Haptic interfaces for virtual environment and teleoperator systems, 2008. haptics 2008. symposium on. IEEE, 397--404.
[11]
Ration Internationale D E Gymnastique. 2017. 2017 - 2020 CODE OF POINTS Rhythmic Gymnastics. January (2017).
[12]
Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 525.
[13]
Keita Higuchi, Tetsuro Shimada, and Jun Rekimoto. 2011. Flying sports assistant: external visual imagery representation for sports training. In Proceedings of the 2nd Augmented Human International Conference. ACM, 7.
[14]
Michitaka Hirose, Koichi Hirota, Tetsuro Ogi, Hiroaki Yano, Naoyuki Kakehi, Makoto Saito, and Mutsuhiro Nakashige. 2001. HapticGEAR: the development of a wearable force display system for immersive projection displays. In Virtual Reality, 2001. Proceedings. IEEE. IEEE, 123--129.
[15]
Atsushi Hiyama, Yusuke Doyama, Mariko Miyashita, Eikan Ebuchi, Masazumi Seki, and Michitaka Hirose. 2011. Wearable display system for handing down intangible cultural heritage. In International Conference on Virtual and Mixed Reality. Springer, 158--166.
[16]
Dennis Landin and Edward P Hebert. 1999. The influence of self-talk on the performance of skilled female tennis players. Journal of applied sport psychology 11, 2 (1999), 263--282.
[17]
Jaebong Lee and Seungmoon Choi. 2010. Effects of haptic guidance and disturbance on motor learning: Potential advantage of haptic disturbance. In Haptics Symposium, 2010 IEEE. IEEE, 335--342.
[18]
Jeff Lieberman and Cynthia Breazeal. 2007. TIKL: Development of a wearable vibrotactile feedback suit for improved human motor learning. IEEE Transactions on Robotics 23, 5 (2007), 919--926.
[19]
Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1471--1482.
[20]
Dan Morris, Hong Tan, Federico Barbagli, Timothy Chang, and Kenneth Salisbury. 2007. Haptic feedback enhances force skill learning. In EuroHaptics Conference, 2007 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics 2007. Second Joint. IEEE, 21--26.
[21]
Kazuki Nagai, Soma Tanoue, Katsuhito Akahane, and Makoto Sato. 2015. Wearable 6-DoF wrist haptic device SPIDAR-W. In SIGGRAPH Asia 2015 Haptic Media And Contents Design. ACM, 19.
[22]
National Institution of Technology and Evaluation. 2013. Human Characteristics Database. (2013). http://www.tech.nite.go.jp/human/
[23]
Jim B Plunkett. 2010. Robotic golf swing trainer. (Oct. 52010). US Patent 7,806,780.
[24]
Research Institute of Human Engineering for Quality Life. 2008. Japanese Anthropometric Database 2004-2006. (2008). https://www.hql.jp/database/cat/size/size2004
[25]
MHD Yamen Saraiji, Tomoya Sasaki, Kai Kunze, Kouta Minamizawa, and Masahiko Inami. 2018. MetaArms: Body Remapping Using Feet-Controlled Artificial Arms. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 65--74.
[26]
MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami. 2018. Fusion: full body surrogacy for collaborative communication. In ACM SIGGRAPH2018 EmergingTechnologies. ACM, 7.
[27]
Misako Sawada, Shiro Mori, and Motonobu Ishii. 2002. Effect of metaphorical verbal instruction on modeling of sequential dance skills by young children. Perceptual and motor skills 95, 3_suppl (2002), 1097--1105.
[28]
Roland Sigrist, Georg Rauter, Robert Riener, and Peter Wolf. 2013. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychonomic bulletin & review 20, 1 (2013), 21--53.
[29]
Junya Tominaga, Kensaku Kawauchi, and Jun Rekimoto. 2014. Around me: a system with an escort robot providing a sports player's self-images. In Proceedings of the 5th Augmented Human International Conference. ACM, 43.
[30]
Seijiro Tsutsui and Kuniyasu Imanaka. 2003. Effect of manual guidance on acquiring a new bimanual coordination pattern. Research quarterly for exercise and sport 74, 1 (2003), 104--109.
[31]
Shuo Yan, Gangyi Ding, Zheng Guan, Ningxiao Sun, Hongsong Li, and Longfei Zhang. 2015. OutsideMe: Augmenting Dancer's External Self-Image by Using A Mixed Reality System. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 965--970.
[32]
Xing-Dong Yang, Walter F Bischof, and Pierre Boulanger. 2008. Validating the performance of haptic motor skill training. (2008).
[33]
Hiroaki Yano, Masayuki Yoshie, and Hiroo Iwata. 2003. Development of a non-grounded haptic interface using the gyro effect. In null. IEEE, 32.

Cited By

View all
  • (2024)JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676440(1-15)Online publication date: 13-Oct-2024
  • (2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
  • (2023)A Wearable Upper Limb Exoskeleton for Intuitive Teleoperation of Anthropomorphic ManipulatorsMachines10.3390/machines1104044111:4(441)Online publication date: 30-Mar-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
AH2019: Proceedings of the 10th Augmented Human International Conference 2019
March 2019
301 pages
ISBN:9781450365475
DOI:10.1145/3311823
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 March 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Augmented learning
  2. Haptics
  3. Motor Learning
  4. Robotics
  5. Wearable Device

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

AH2019

Acceptance Rates

AH2019 Paper Acceptance Rate 26 of 53 submissions, 49%;
Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)170
  • Downloads (Last 6 weeks)21
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)JetUnit: Rendering Diverse Force Feedback in Virtual Reality Using Water JetsProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676440(1-15)Online publication date: 13-Oct-2024
  • (2024)Can a Smartwatch Move Your Fingers? Compact and Practical Electrical Muscle Stimulation in a SmartwatchProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676373(1-15)Online publication date: 13-Oct-2024
  • (2023)A Wearable Upper Limb Exoskeleton for Intuitive Teleoperation of Anthropomorphic ManipulatorsMachines10.3390/machines1104044111:4(441)Online publication date: 30-Mar-2023
  • (2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
  • (2023)Towards Designing for Everyday Embodied Remembering: Findings from a Diary StudyProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595999(2611-2624)Online publication date: 10-Jul-2023
  • (2023)I Need a Third Arm! Eliciting Body-based Interactions with a Wearable Robotic ArmProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581184(1-15)Online publication date: 19-Apr-2023
  • (2023)Morphing Identity: Exploring Self-Other Identity Continuum through Interpersonal Facial Morphing ExperienceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580853(1-15)Online publication date: 19-Apr-2023
  • (2023)CoboDeck: A Large-Scale Haptic VR System Using a Collaborative Mobile Robot2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00045(297-307)Online publication date: Mar-2023
  • (2023)Trajectory learning by therapists' demonstrations for an upper limb rehabilitation exoskeletonIEEE Robotics and Automation Letters10.1109/LRA.2023.3285081(1-8)Online publication date: 2023
  • (2022)VoLearnProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35345766:2(1-26)Online publication date: 7-Jul-2022
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media