Skip to main content

Real-Time Model Based Visual Servoing Tasks on a Humanoid Robot

  • Chapter
Intelligent Autonomous Systems 12

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 193))

Abstract

Several model based techniques have been used to apply various domestic service tasks on humanoid robots ( through teleoperation, learning, ...). But for many reasons, it is more suitable to study the interaction between the robot and its environment using the Sensor Based Control in these cases. In this paper we present a work of integration of real-time visual servoing techniques in performing self localization and different manipulation tasks on a humanoid robot in closed loop.

Real-time model based tracking techniques are used to apply 3D visual servoing tasks on the Nao humanoid robot. Elementary tasks used by the robot to perform a concrete scenario are detailed with their corresponding control laws. Experimental results are presented for the following tasks: self-localization of the robot while walking, head servoing for the visibility task, detection, tracking and manipulation of environment’s objects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Brock, O., Kuffner, J., Xiao, J.: Motion for manipulation tasks. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 615–645. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  2. Evrard, P., Mansard, N., Stasse, O., Kheddar, A., Schau, T., Weber, C., Peer, A., Buss, M.: Intercontinental, multimodal, wide-range telecooperation using a humanoid robot. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2009, pp. 5635–5640 (2009)

    Google Scholar 

  3. Nitzsche, N., Schmidt, G.: A mobile haptic interface mastering a mobile teleoperator. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2004, vol. 4, pp. 3912–3917 (September-October 2004)

    Google Scholar 

  4. Houston, K., Sieber, A., Eder, C., Vittorio, O., Menciassi, A., Dario, P.: A teleoperation system with novel haptic device for micromanipulation. Int. Journal of Robotics and Automation 26(3) (2011)

    Google Scholar 

  5. Miller, W.T.: Sensor-based control of robotic manipulators using a general learning algorithm. IEEE Journal of Robotics and Automation 3(2), 157–165 (1987)

    Article  Google Scholar 

  6. Dang, H., Allen, P.: Robot learning of everyday object manipulations via human demonstration. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2010, pp. 1284–1289 (October 2010)

    Google Scholar 

  7. Jain, A., Kemp, C.: Pulling open novel doors and drawers with equilibrium point control. In: IEEE-RAS Int. Conf. on Humanoid Robots, pp. 498–505 (December 2009)

    Google Scholar 

  8. Mansard, N., Stasse, O., Chaumette, F., Yokoi, K.: Visually-guided grasping while walking on a humanoid robot. In: IEEE Int. Conf. on Robotics and Automation, pp. 3041–3047 (April 2007)

    Google Scholar 

  9. Quinlan, M.J., Middleton, R.H.: Multiple Model Kalman Filters: A Localization Technique for RoboCup Soccer. In: Baltes, J., Lagoudakis, M.G., Naruse, T., Ghidary, S.S. (eds.) RoboCup 2009. LNCS, vol. 5949, pp. 276–287. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  10. Billington, D., Estivill-Castro, V., Hexel, R., Rock, A.: Using Temporal Consistency to Improve Robot Localisation. In: Lakemeyer, G., Sklar, E., Sorrenti, D.G., Takahashi, T. (eds.) RoboCup 2006: Robot Soccer World Cup X. LNCS (LNAI), vol. 4434, pp. 232–244. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  11. Haverinen, J., Kemppainen, A.: Global indoor self-localization based on the ambient magnetic field. Int. Journal of Robotics and Autonomous Systems 57(10), 1028–1035 (2009)

    Article  Google Scholar 

  12. Thuilot, B., Martinet, P., Cordesses, L., Gallice, J.: Position based visual servoing: keeping the object in the field of vision. In: IEEE Int. Conf. on Robotics and Automation, vol. 2 (2002)

    Google Scholar 

  13. Gouaillier, D., Hugel, V., Blazevic, P., Kilner, C., Monceaux, J., Lafourcade, P., Marnier, B., et al.: Mechatronic design of nao humanoid. In: IEEE Int. Conf. on Robotics and Automation, pp. 769–774 (May 2009)

    Google Scholar 

  14. Chaumette, F., Hutchinson, S.: Visual servo control. i. basic approaches. IEEE Robotics Automation Magazine 13(4), 82–90 (2006)

    Article  Google Scholar 

  15. Cervera, E.: A Cross-Platform Network-Ready Visual Servo Simulator. In: IEEE Int. Conf. on Intelligent Robots and Systems (IROS 2006), Beijing (China), pp. 2314–2319 (2006)

    Google Scholar 

  16. Marchand, E., Spindler, F., Chaumette, F.: Visp for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robotics Automation Magazine 12, 40–52 (2005)

    Article  Google Scholar 

  17. Comport, A., Marchand, E., Pressigout, M., Chaumette, F.: Real-time markerless tracking for augmented reality: the virtual visual servoing framework. IEEE Transactions on Visualization and Computer Graphics 12(4), 615–628 (2006)

    Article  Google Scholar 

  18. Galindo, C., Fernandez-Madrigal, J.-A., Gonzalez, J., Saffiotti, A.: Robot task planning using semantic maps. Robotics and Autonomous Systems 56(11), 955–966 (2008)

    Article  Google Scholar 

  19. Stasse, O., Verrelst, B., Vanderborght, B., Yokoi, K.: Strategies for humanoid robots to dynamically walk over large obstacles. IEEE Transactions on Robotics 25(4), 960–967 (2009)

    Article  Google Scholar 

  20. Sorribes, J., Prats, M., Morales, A.: Visual tracking of a jaw gripper based on articulated 3d models for grasping. In: IEEE Int. Conf. on Robotics and Automation, pp. 2302–2307 (May 2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amine Abou Moughlbay .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Moughlbay, A.A., Cervera, E., Martinet, P. (2013). Real-Time Model Based Visual Servoing Tasks on a Humanoid Robot. In: Lee, S., Cho, H., Yoon, KJ., Lee, J. (eds) Intelligent Autonomous Systems 12. Advances in Intelligent Systems and Computing, vol 193. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33926-4_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33926-4_30

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33925-7

  • Online ISBN: 978-3-642-33926-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics