S. K. Ong
ABSTRACT
Advancements in robotics have gained much momentum in recent years. Industrial robotic systems are increasingly being used outside the factory floor, evident by the growing presence of service robots in personal environments. In light of these trends, there is currently a pressing need of identifying new ways of programming robots safely, quickly and more intuitively. These methods should focus on service robots and address long outstanding Human-Robot Interaction issues in industrial robotics simultaneously. In this paper, the potential of using an Augmented Reality (AR) environment to facilitate immersive robot programming in unknown environments is explored. The benefits of an AR environment over conventional robot programming approaches are discussed, followed by a description of the Robot Programming using AR (RPAR) system developed in this research. New methodologies for programming two classes of robotic tasks using RPAR are proposed. A number of case studies are presented and the results discussed.
- Aleoti, J., Caselli, S., and Reggiani, M. 2004. Leveraging on a Virtual Environment for Robot Programming by Demonstration. Robotics and Autonomous Systems 47, 2--3, 153--161.Google Scholar
- Azuma, R. T. 1997. A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6, 4, 355--385.Google ScholarDigital Library
- Besl, P. J. 1992. A Method for Registration of 3D Shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2, 239--256. Google ScholarDigital Library
- Bobrow, J. E., Dubowsky, S., and Gibson, J. S. 1985. Time-Optimal Control of Robotic Manipulators along Specified Paths. International Journal of Robotics Research 4, 3, 3--17.Google ScholarCross Ref
- Craig, J. J. 1989. Introduction to Robotics, Mechanics and Control. Addison-Wesley. Google ScholarDigital Library
- Delson, N., and West, H. 1994a. Robot Programming by Human Demonstration: The Use of Human Variation in Identifying Obstacle Free Trajectories. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), vol. 1, 564--571.Google Scholar
- Delson, N., and West, H. 1994b. Robot Programming by Human Demonstration: The Use of Human Variation in Improving 3D Robot Trajectories. In Proceedings of the IEEE/RSJ/GI International Conference on Intelligent Robots and Systems (IROS), vol. 2, 1248--1255.Google Scholar
- Farin, G. 2002. Curves and Surfaces for CAGD: A Practical Guide, 5th Ed. Morgan-Kaufman. Google ScholarDigital Library
- Friedrich, H., Munch, S., Dillmann, R., Bocionek, S., and Sassin, M. 1996. Robot Programming by Demonstration (RPD): Supporting the Induction by Human Interaction. Machine Learning 23, 2--3, 163--189. Google ScholarDigital Library
- Furcy, D. 2004. Speeding Up the Convergence of Online Heuristic Search and Scaling Up Offline Heuristic Search. PhD thesis, Georgia Institute of Technology. Google ScholarDigital Library
- Hoschek, J. 1988. Intrinsic Parametrization for Approximation. Computer Aided Geometric Design 5, 1, 27--31. Google ScholarDigital Library
- Kaiser, M., Retey, A., and Dillmann, R. 1995. Robot Skill Acquisition via Human Demonstration. In Proceedings of the 7th International Conference on Advanced Robotics (ICAR), 763--768.Google Scholar
- Kato, H., and Billinghurst, M. 1999. Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System. In Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, San Francisco, 85--94. Google ScholarDigital Library
- Mackay, D. J. C. 1995. Bayesian Methods for Neural Networks: Theory and Applications. Lecture Notes, University of Cambridge Programme for Industry, July.Google Scholar
- Nanotek, E., Zimmerman, T., and Fluckiger, L. 1995. Model Based Vision as Feedback for Virtual Reality Robotics Environment. In Proceedings of the IEEE Virtual Reality Annual International Symposium (VRAIS), 110--117. Google ScholarDigital Library
- Pettersen, T., Pretlove, J., Skourup, C., Engedal, T., and Lokstad, T. 2003. Augmented Reality for Programming Industrial Robots. In Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR), 319--320. Google ScholarDigital Library
- Rastogi, A., and Milgram, P. 1995. Augmented Telerobotic Control: A Visual Interface for Unstructured Environments. In Proceedings of the KBS/Robotics Conference, 16--18.Google Scholar
- Schwald, B., and Laval, B. 2003. An Augmented Reality System for Training and Assistance to Maintenance in the Industrial Context. Journal of WSCG 11, 1, 425--432.Google Scholar
- Sung, J. A. 2004. Least Squares Orthogonal Distance Fitting of Curves and Surfaces in Space. Springer-Verlag.Google Scholar
- U.S. Department Of Labor, 2006. OSHA Technical Manual, Industrial Robots and Robot System Safety, Section IV: Chapter 4. Available: http://www.osha.gov/dts/osta/otm/otm iv/otm iv 4.html, last accessed on 10 Sept. 2006.Google Scholar
Index Terms
- Methodologies for immersive robot programming in an augmented reality environment
Recommendations
Assisting Manipulation and Grasping in Robot Teleoperation with Augmented Reality Visual Cues
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsTeleoperating industrial manipulators in co-located spaces can be challenging. Facilitating robot teleoperation by providing additional visual information about the environment and the robot affordances using augmented reality (AR), can improve task ...
Projection-based Augmented Reality Interface for Robot Grasping Tasks
ICRCA 2019: Proceedings of the 2019 4th International Conference on Robotics, Control and AutomationThis paper presents an augmented reality (AR) interface for robot programming of pick-and-place tasks as well as assembly operations. The aim of the AR interface is to increase the intuitiveness and ease of robot programming. Marker tracking is used to ...
Robot Programming Using Augmented Reality
CW '09: Proceedings of the 2009 International Conference on CyberWorldsHuman-robot interaction issues, especially for industrial robots, have largely been confined to finding better ways to reconfigure or program the robots. In this paper, an Augmented Reality based Robot Programming (RPAR-II) system is proposed. A virtual ...
Comments