Nutan Chen
ABSTRACT
To explore an intuitive human-robot interface for service robots, this work develops effective and user-friendly approaches which combine the real time remote vision-based teleoperation and autonomous grasping. In the first approach, hand gestures are identified and used to activate autonomy, which can reduce grasping time and provide more natural grasping poses. A potential energy algorithm is introduced to assist grasping during teleoperation in another approach. This allows us to perform online adjustments to reach a pre-grasp pose without requiring premature object contact or regrasping strategies.
- Bachmann, E. R., McGhee, R. B., Yun, X., and Zyda, M. J. 2001. Inertial and magnetic posture tracking for inserting humans into networked virtual environments. In In ACM Symposium on Virtual Reality Software and Technology (VRST, ACM, 9--16. Google Scholar
Digital Library
- Brook, P., Ciocarlie, M., and Hsiao, K. 2011. Collaborative grasp planning with multiple object representations. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, 2851--2858.Google Scholar
- Cheung, Y. 2009. Adaptive Semi-autonomous Teleoperation of a Multi-agent Robotic System. Stevens Institute of Technology.Google Scholar
- Fischler, M. A., and Bolles, R. C. 1981. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 6 (June), 381--395. Google ScholarDigital Library
- Fong, T., and Nourbakhsh, I. 2005. Interaction challenges in human-robot space exploration. Interactions 12, 1 (March), 42--45. Google ScholarDigital Library
- Fukuda, O., Tsuji, T., Kaneko, M., and Otsuka, A. 2003. A human-assisting manipulator teleoperated by emg signals and arm motions. Robotics and Automation, IEEE Transactions on 19, 2 (apr), 210--222.Google Scholar
- Gallagher, G., 2011. Hand detection. http://www.ros.org/wiki/mit-ros-pkg/KinectDemos/HandDetection.Google Scholar
- Guo, C., Tarn, T.-J., Xi, N., and Bejczy, A. 1995. Fusion of human and machine intelligence for telerobotic systems. In Robotics and Automation, 1995. Proceedings., 1995 IEEE International Conference on, vol. 3, 3110--3115 vol. 3. Google ScholarDigital Library
- Hong, S.-H., Jeon, J. W., and Yoon, J. S. 2001. A robot graphic simulator for tele-operation. In Industrial Electronics, 2001. Proceedings. ISIE 2001. IEEE International Symposium on, vol. 1, 195--200 vol. 1.Google Scholar
- Jacobsen, S., Olivier, M., Smith, F., Knutti, D., Johnson, R., Colvin, G., and Scroggin, W. 2004. Research robots for applications in artificial intelligence, teleoperation and entertainment. The International Journal of Robotics Research 23, 4--5, 319--330.Google ScholarCross Ref
- Lee, D. 2008. Semi-autonomous teleoperation of multiple wheeled mobile robots over the internet. ASME Conference Proceedings 2008, 43352, 147--154.Google ScholarCross Ref
- Miller, A., and Allen, P. 2004. Graspit! a versatile simulator for robotic grasping. Robotics Automation Magazine, IEEE 11, 4 (dec.), 110--122.Google Scholar
- OpenNI-Organization, 2011. Openni user guide. http://www.openni.org/images/stories/pdf/OpenNI_UserGuide.pdf.Google Scholar
- Rosen, J., Hannaford, B., MacFarlane, M., and Sinanan, M. 1999. Force controlled and teleoperated endoscopic grasper for minimally invasive surgery-experimental performance evaluation. Biomedical Engineering, IEEE Transactions on 46, 10 (oct.), 1212--1221.Google ScholarCross Ref
- Tezuka, T., Goto, A., Kashiwa, K., Yoshikawa, H., and Kawano, R. 1994. A study on space interface for teleoperation system. In Robot and Human Communication, 1994. RO-MAN '94 Nagoya, Proceedings., 3rd IEEE International Workshop on, 62--67.Google Scholar
- Zhang, Z. 1992. Iterative point matching for registration of free-form curves. Rapport de recherche RR-1658, INRIA.Google Scholar
Index Terms
- Intuitive interaction for robotic grasping
Recommendations
Strategies for human-in-the-loop robotic grasping
HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot InteractionHuman-in-the loop robotic systems have the potential to handle complex tasks in unstructured environments, by combining the cognitive skills of a human operator with autonomous tools and behaviors. Along these lines, we present a system for remote human-...
Vocal Interaction with a 7-DOF Robotic Arm for Object Detection, Learning and Grasping
HRI '16: The Eleventh ACM/IEEE International Conference on Human Robot InteractionThis work presents preliminary results on the de- velopment of a system for multimodal interaction between a user and a robotic arm for human-robot cooperation tasks. In particular the system allows the user to ask the robot to grasp objects lying on a ...
An integrated system for user-adaptive robotic grasping
This paper presents an integrated system that combines learning, a natural-language interface, and robotic grasping to enable the transfer of grasping skills from nontechnical users to robots. The system consists of two parts: a natural-language ...
Comments