Skip to main content

Human-Robot Coordination in Agile Robot Manipulation

  • Conference paper
  • First Online:
Social Robotics (ICSR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 13086))

Included in the following conference series:

  • 2671 Accesses

Abstract

With the practical demands in flexible and adaptive robot manipulation skills in various environment settings, there are more challenges to be tackled to enable the robot with valid responsive behaviors in task handling. This paper discuss on the methods to achieve agile robot manipulations tasks with the advantages from human-robot teleoperation, robot perception, knowledge-based robot programming, robot motion planning and robot skill learning. Teleoperation serves as a typical Human-Robot Interaction (HRI) manner to allow the human user to guide the robot behavior in a direct manner. Robot automation, including the sensor perception (object detection, pose estimation etc.), motion planning and motion control that can handle well defined problems, but is also lack of general sense of understanding capability and not good at solving not fully defined task challenges. An agile robotic system should have a knowledge database which defines the skill sets required for the robot to handle various robot tasks. Meanwhile, the system should be able to take human assistance inputs through HRI when the robot is stuck. Moreover, the system should be able to pick up new skill set with each human knowledge input. Methodology discussion is the main scope of the paper, and preliminary experiments on telemanipulation with UR5 robot are demonstrated to show the flexible robot guidance through HRI inputs. Future work will aim to add in perception, motion planning, and picking up skill modules to come up with a more agile solution in handling variation of tasks.

This research was supported by Agency for Science, Technology and Research (A*STAR) under its RIE2020 Advanced Manufacturing and Engineering (AME) Industry Alignment Fund—Pre-Positioning Programme (IAF-PP) grant number A19E4a0101. All authors are with Institute for Infocomm Research (I\(^2\)R), A*STAR, Singapore.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Stenmark, M., Malec, J.: Knowledge-based instruction of manipulation tasks for industrial robotics. Robot. Comput.-Integr. Manuf. 33, 56–67 (2015)

    Article  Google Scholar 

  2. Stenmark, M., Malec, J.: Knowledge-based industrial robotics. In: The 12th Scandinavian Conference on Artificial Intelligence (SCAI). IOS Press (2013)

    Google Scholar 

  3. Miller, N., et al.: Motion capture from inertial sensing for untethered humanoid teleoperation. In: 4th IEEE/RAS International Conference on Humanoid Robots, vol. 2. IEEE (2004)

    Google Scholar 

  4. Yuan, Q., et al.: Task-orientated robot teleoperation using wearable IMUs. In: 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE (2017)

    Google Scholar 

  5. Tee, K.P., Wu, Y.: Experimental evaluation of divisible human-robot shared control for teleoperation assistance. In: TENCON 2018–2018 IEEE Region 10 Conference. IEEE (2018)

    Google Scholar 

  6. Weng, C., et al.: A telemanipulation-based human-robot collaboration method to teach aerospace masking skills. IEEE Trans. Ind. Inform. 16(5), 3076–3084 (2019)

    Article  Google Scholar 

  7. Yuan, Q., et al.: Flexible telemanipulation based handy robot teaching on tape masking with complex geometry. Robot. Comput.-Integr. Manuf. 66, 101990 (2020)

    Article  Google Scholar 

  8. Quintero, C.P., et al.: Flexible virtual fixture interface for path specification in tele-manipulation. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE (2017)

    Google Scholar 

  9. Pan, J., et al.: Real-time collision detection and distance computation on point cloud sensor data. In: 2013 IEEE International Conference on Robotics and Automation. IEEE (2013)

    Google Scholar 

  10. Diankov, R., Kuffner, J.: Openrave: a planning architecture for autonomous robotics. Technical Report CMU-RI-TR-08-34 79. Robotics Institute, Pittsburgh, PA (2008)

    Google Scholar 

  11. Chitta, S.: MoveIt!: an introduction. In: Koubaa, A. (ed.) Robot Operating System (ROS). SCI, vol. 625, pp. 3–27. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-26054-9_1

    Chapter  Google Scholar 

  12. Sucan, I.A., Moll, M., Kavraki, L.E.: The open motion planning library. IEEE Robot. Autom. Mag. 19(4), 72–82 (2012)

    Article  Google Scholar 

  13. LaValle, S.M.: Planning Algorithms. Cambridge University Press, Cambridge (2006)

    Book  Google Scholar 

  14. Kuffner, J.J., LaValle, S.M.: RRT-connect: an efficient approach to single-query path planning. In: Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No. 00CH37065), vol. 2. IEEE (2000)

    Google Scholar 

  15. Suárez-Ruiz, F., Zhou, X., Pham, Q.C.: Can robots assemble an IKEA chair? Sci. Robot. 3(17), eaat6385 (2018)

    Google Scholar 

  16. Yuan, Q., et al.: A mirrored motion remapping method in telemanipulation-based face-to-face dual-arm robot teaching. In: 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM). IEEE (2019)

    Google Scholar 

  17. Supplementary Video. https://www.youtube.com/watch?v=crnbbfZPVbg

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qilong Yuan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yuan, Q., Leong, I.S.W. (2021). Human-Robot Coordination in Agile Robot Manipulation. In: Li, H., et al. Social Robotics. ICSR 2021. Lecture Notes in Computer Science(), vol 13086. Springer, Cham. https://doi.org/10.1007/978-3-030-90525-5_46

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90525-5_46

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90524-8

  • Online ISBN: 978-3-030-90525-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics