skip to main content
10.1145/2821592.2821620acmconferencesArticle/Chapter ViewAbstractPublication PagesvrstConference Proceedingsconference-collections
short-paper

Augmented reality-aided tele-presence system for robot manipulation in industrial manufacturing

Published: 13 November 2015 Publication History

Abstract

This work investigates the use of a highly immersive telepresence system for industrial robotics. A Robot Operating System integrated framework is presented where a remote robot is controlled through operator's movements and muscle contractions captured with a wearable device. An augmented 3D visual feedback is sent to the user providing the remote environment scenario from the robot's point of view and additional information pertaining to the task execution. The system proposed, using robot mounted RGB-D camera, identifies known objects and relates their pose to robot arm pose and to targets relevant to the task execution. The system is preliminary validated during a pick-and-place task using a Baxter robot. The experiment shows the practicability and the effectiveness of the proposed approach.

Supplementary Material

ZIP File (p237-peppoloni.zip)

References

[1]
Avizzano, C. A., et al. 2014. A novel wearable biometric capture system. In IEEE MED.
[2]
Filippeschi, A., et al. 2015. Encountered-type haptic interface for virtual interaction with real objects based on implicit surface haptic rendering for remote palpation. In Intelligent Robots and Systems (IROS), 2015 IEEE/RSJ International Conference on, IEEE.
[3]
Folgheraiter, M., et al. 2012. Measuring the improvement of the interaction comfort of a wearable exoskeleton. International Journal of Social Robotics 4, 3, 285--302.
[4]
Geiger, L., et al. 2010. The influence of telemanipulation-systems on fine motor performance. In IEEE AHCI, 44--49.
[5]
Khassanov, Y., et al. 2014. Inertial motion capture based reference trajectory generation for a mobile manipulator. In IEEE/ACM HRI, 202--203.
[6]
Kron, A., and Schmidt, G. 2003. A bimanual haptic telepresence system-design issues and experimental results. In Proc. of Int. Workshop on High-Fidelity Telepresence and Teleaction in HUMANOIDS.
[7]
Nitsch, V., and Farber, B. 2013. A meta-analysis of the effects of haptic interfaces on task performance with teleoperation systems. Haptics, IEEE Transactions on 6, 4, 387--398.
[8]
Nitsch, V. 2012. Haptic human-machine interaction in teleoperation systems and its implications for the design and effective use of haptic interfaces.
[9]
Peppoloni, L., et al. 2013. A novel 7 degrees of freedom model for upper limb kinematic reconstruction based on wearable sensors. In IEEE SISY, 105--110.
[10]
Radi, M., et al. 2010. Telepresence technology for production: from manual to automated assembly. In Haptics: Generating and Perceiving Tangible Sensations. Springer, 256--261.
[11]
Rosenberg, L. B. 1993. Virtual fixtures: Perceptual tools for telerobotic manipulation. In IEEE VR, 76--82.
[12]
Ruffaldi, E., et al. 2014. A novel approach to motion tracking with wearable sensors based on probabilistic graphical models. In IEEE ICRA.
[13]
Vogel, J., et al. 2011. EMG-based teleoperation and manipulation with the DLR LWR-III. In IEEE IROS, 672--678.
[14]
Xia, T., et al. 2012. Augmented reality environment with virtual fixtures for robotic telemanipulation in space. In IEEE IROS, 5059--5064.

Cited By

View all
  • (2025)Towards future of work in immersive environments and its impact on the Quality of Working Life: a scoping reviewi-com10.1515/icom-2024-0019Online publication date: 15-Jan-2025
  • (2025)An immersive spatially consistent multi-modal augmented virtuality human-machine interface for telerobotic systemsComputers in Industry10.1016/j.compind.2025.104260167(104260)Online publication date: May-2025
  • (2024)The Cyber-Physical Control Room: A Mixed Reality Interface for Mobile Robot Teleoperation and Human-Robot TeamingProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634981(762-771)Online publication date: 11-Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology
November 2015
237 pages
ISBN:9781450339902
DOI:10.1145/2821592
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. augmented and mixed reality
  2. tele-operation and tele-presence
  3. tracking and sensing

Qualifiers

  • Short-paper

Funding Sources

  • Regione Toscana

Conference

VRST '15

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)43
  • Downloads (Last 6 weeks)2
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Towards future of work in immersive environments and its impact on the Quality of Working Life: a scoping reviewi-com10.1515/icom-2024-0019Online publication date: 15-Jan-2025
  • (2025)An immersive spatially consistent multi-modal augmented virtuality human-machine interface for telerobotic systemsComputers in Industry10.1016/j.compind.2025.104260167(104260)Online publication date: May-2025
  • (2024)The Cyber-Physical Control Room: A Mixed Reality Interface for Mobile Robot Teleoperation and Human-Robot TeamingProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634981(762-771)Online publication date: 11-Mar-2024
  • (2024)Learning Variable Compliance Control From a Few Demonstrations for Bimanual Robot with Haptic Feedback Teleoperation System2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS58592.2024.10801731(12663-12670)Online publication date: 14-Oct-2024
  • (2023)Augmented reality‐based telepresence in a robotic manipulation task: An experimental evaluationIET Collaborative Intelligent Manufacturing10.1049/cim2.120855:4Online publication date: 19-Oct-2023
  • (2022)Early Field Experiences Through Telepresence RobotsResearch, Practice, and Innovations in Teacher Education During a Virtual Age10.4018/978-1-6684-5316-2.ch001(1-20)Online publication date: 18-Nov-2022
  • (2022)Perception-Motion Coupling in Active Telepresence: Human Behavior and Teleoperation Interface DesignACM Transactions on Human-Robot Interaction10.1145/357159912:3(1-24)Online publication date: 18-Nov-2022
  • (2022)Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic InterfacesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517719(1-33)Online publication date: 29-Apr-2022
  • (2020)Leveraging depth data in remote robot teleoperation interfaces for general object manipulationInternational Journal of Robotics Research10.1177/027836491988856539:1(39-53)Online publication date: 1-Jan-2020
  • (2020)Systematic literature review on augmented reality in smart manufacturing: Collaboration between human and computational intelligenceJournal of Manufacturing Systems10.1016/j.jmsy.2020.10.017Online publication date: Nov-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media