Skip to main content
Log in

The UJI librarian robot

  • Original Research Paper
  • Published:
Intelligent Service Robotics Aims and scope Submit manuscript

Abstract

This paper describes the UJI librarian robot, a mobile manipulator that is able to autonomously locate a book in an ordinary library, and grasp it from a bookshelf, by using eye-in-hand stereo vision and force sensing. The robot is only provided with the book code, a library map and some knowledge about its logical structure and takes advantage of the spatio-temporal constraints and regularities of the environment by applying disparate techniques such as stereo vision, visual tracking, probabilistic matching, motion estimation, multisensor-based grasping, visual servoing and hybrid control, in such a way that it exhibits a robust and dependable performance. The system has been tested, and experimental results show how it is able to robustly locate and grasp a book in a reasonable time without human intervention.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Tomizawa T, Ohya A, Yuta S (2003) Remote book browsing system using a mobile manipulator. In: IEEE international conference on robotics and automation, Taipei, Taiwan, September, pp 256–261

  2. Suthakorn J, Lee S, Zhou Y, Choudhury S, Chirikjian GS (2003) An enhanced robotic library system for an off-site shelving facility. In: Proceedings of the 2003 international conference on field and service robotics (FSR), Mt. Fuji-Lake Yamanaka, Japan

  3. Prats M, Sanz PJ, del Pobil AP, Martínez E, Marín R (2007) Towards multipurpose autonomous manipulation with the UJI service robot. Robotica J 25(2): 245–256

    Google Scholar 

  4. del Pobil AP, Serna MA (1995) Spatial representation and motion planning. Springer, Berlin

    Google Scholar 

  5. Gupta K, del Pobil AP (eds) (1998) Practical motion planning in robotics. Wiley, New York

    MATH  Google Scholar 

  6. Bort L, del Pobil AP (2000) Using speech to guide a mobile robot manipulator. In: Proceedings of IEEE international conference on systems, man and cybernetics. Nashville, Tennessee, USA, pp 2356–2361

  7. Gupta K, del Pobil AP, Choset H (eds) (2000) Lecture notes of the workshop on integrating sensors with mobility and manipulation. In: IEEE International Conferences on Robotics and Automation

  8. Choset H, Lynch KM, Hutchinson S, Kantor GA, Burgard W, Kavraki LE et al (2005) Principles of robot motion: theory, algorithms, and implementations. MIT Press, Cambridge

    MATH  Google Scholar 

  9. Thrun S, Burgard W, Fox D (2005) Probabilistic robotics. MIT Press, Cambridge

    MATH  Google Scholar 

  10. Faugeras O, Luong QT, Papadopoulo T (2001) The geometry of multiple images. MIT Press, Cambridge. ISBN: 0-262-06220-8

    MATH  Google Scholar 

  11. Elgammal A, Duraiswami R, Davis L (2003) Probabilistic tracking in joint feature-spatial spaces. In: IEEE conference on computer vision and pattern recognition

  12. Lowe D (1992) Robust model-based motion tracking through the integration of search and estimation. Int J Comput Vis 113–122

  13. Schulenburg J Gocr. Available on: http://www-e.unimagdeburg.de/jschulen/ocr/

  14. Mason M (1981) Compliance and force control for computer-controlled manipulators. IEEE Trans Syst Man Cybern 11(6): 418–432

    Article  Google Scholar 

  15. Schutter JD, Brussels HV (1988) Compliant robot motion I. A formalism for specifying compliant motion tasks. Int J Robot Res 7(4): 3–17 doi:10.1177/027836498800700401

    Google Scholar 

  16. Kröger T, Finkemeyer B, Thomas U, Wahl F (2004) Compliant motion programming: the task frame formalism revisited. In: Mechatronics & Robotics, Aachen, Germany

  17. Baeten J, Bruyninckx H, Schutter JD (2003) Integrated vision/force robotic servoing in the task frame formalism. Int J Robot Res 22(10–11): 941–954 doi:10.1177/027836490302210010

    Article  Google Scholar 

  18. Marrone F, Raimondi F, Strobel M (2002) Compliant interaction of a domestic service robot with a human and the environment. In: Proceedings of 33rd international symposium on robotics, Stockholm

  19. Mezouar Y, Prats M, Martinet P (2007) External hybrid vision/ force control. In: International conference on advanced robotics (ICAR’07), Jeju, Korea

  20. Hosoda K, Igarashi K, Asada M (1996) Hybrid visual servoing/ force control in unknown environment. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Osaka, Japan, pp 097–1103

  21. Morel G, Malis E, Boudet S (1998) Impedance based combination of visual and force control. In: IEEE international conference on robotics and automation, ICRA’98, vol 2. Leuven, Belgique, pp 1743–1748

  22. Espiau B, Chaumette F, Rives P (1992) A new approach to visual servoing in Robotics. IEEE Trans Robotics Auto 8(3): 313–326 ISSN: 1042–296X

    Article  Google Scholar 

  23. Hutchinson S, Hager GD, Corke PI (1996) A tutorial on visual servo control. IEEE Trans Robotics Auto 12(5): 651–670 ISSN: 1042–296X

    Article  Google Scholar 

  24. Prats M, Ramos-Garijo R, Sanz P, del Pobil A (2004) Autonomous localization and extraction of books in a library. In: Groen F, et al., Intelligent autonomous systems, vol 8. IOS Press, Amsterdam, pp 1138–1145

  25. Horaud RP, Dornaika F, Espiau B (1998) Visually guided object grasping. IEEE Trans Robotics Auto 14(4): 525–532 ISSN: 1042–296X

    Article  Google Scholar 

  26. del Pobil AP, Prats M, Ramos R, Sanz P, Cervera E (2005) The UJI librarian robot. In: Video Proceedings of international conference on robotics and automation (ICRA’05), Barcelona, Spain. Available on the web: http://www.robot.uji.es/documents/videos/librarian/pobil.mov

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mario Prats.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Prats, M., Martínez, E., Sanz, P.J. et al. The UJI librarian robot. Intel Serv Robotics 1, 321–335 (2008). https://doi.org/10.1007/s11370-008-0028-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11370-008-0028-1

Keywords

Navigation