Skip to main content
Log in

A Navigation System for Assistant Robots Using Visually Augmented POMDPs

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

Assistant robots have received special attention from the research community in the last years. One of the main applications of these robots is to perform care tasks in indoor environments such as houses, nursing homes or hospitals, and therefore they need to be able to navigate robustly for long periods of time. This paper focuses on the navigation system of SIRA, a robotic assistant for elderly and/or blind people based on a Partially Observable Markov Decision Process (POMDP) to global localize the robot and to direct its goal-oriented actions. The main novel feature of our approach is that it combines sonar and visual information in a natural way to produce state transitions and observations in the framework of Markov Decision Processes. Besides this multisensorial fusion, a two-level layered planning architecture that combines several planning objectives (such as guiding to a goal room and reducing locational uncertainty) improves the robustness of the navigation system, as it’s shown in our experiments with SIRA navigating corridors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • ActivMedia Robotics. 2003. PeopleBot Operations Manual.

  • Bellman, R. 1957. Dynamic Programming. Princeton University Press.

  • Brants, T. 1996. “Estimating Markov models structures”. In Proc. Fourth Conference on Spoken Language Processing.

  • Burgard, W., Fox, D., Henning, D., and Schmidt, T. 1996. Estimating the absolute position of a mobile robot using position probability grids. In Proc. of Thirteen National Conference on Artificial Intelligence.

  • Cassandra, A. 1994. Optimal policies for partially observable Markov decision processes. Technical Report CS-94-14, Brown University, Department of Computer Science, Providence, RI.

  • Fox, D. 1998. Active Markov Localization for Mobile Robots. Robotics and Autonomous System (special issue Euromicro’97).

  • Fox, D., Burgard W., Dellaert, F. and Thrun, S. 1999. Monte Carlo Localization: Efficient position estimation for mobile robots. In Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI’99).

  • Gechter, F., Thomas V., and Charpillet, F. 2001. Robot localization by stochastic vision based device. The 5thWorld Multi-Conference on Systemics, Cybernetics and Informatics, SCI 2001.

  • Goldberg, D., and Mataric, M.J. 1999. Augmented Markov models. USC Institute for Robotics and Intelligent Systems Technical Report IRIS-99-367.

  • Gutmann, J.S., Burgard, W., Fox, D., and Konolige, K. 1998. An experimental comparison of localization methods. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’98).

  • Haigh, K.Z., Phelps, J., and Geib, C.W. 2002. An open agent architecture for assisting elder independence. In theFirst International Joint Conference on Autonomous Agents and MultiAgent Systems (AAMAS), pp. 578–586.

  • Howard, R.A. 1960. Dynamic Programming and Markov Processes. The MIT Press: Cambridge, Massachusetts.

    Google Scholar 

  • Kaelbling, L.P., Cassandra, A.R., and Kurien, J.A. 1996. Acting under uncertainty: Discrete bayesian models for mobile robot navigation. In Proc. of the IEEE/RSJ International Conference on Itelligent Robots and Systems.

  • Kaelbling, L.P., Littman, M.L., and Cassandra, A.R. 1998. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101: pp. 99–134.

    Article  MathSciNet  Google Scholar 

  • Koenig, S. and Simmons, R. 1998. Xavier: A robot navigation architecture based on partially observable Markov decision process models. Artificial Intelligence and Mobile Robots, pp. 91–122.

  • Konolige, K. 1997. Improved occupancy grids for map building. Autonomous Robots 4(4):351–367.

    Article  Google Scholar 

  • Konolige, K., and Myers, K. 1998. The Saphira architecture for autonomous mobile robots. In AI and Mobile Robots, Kortenkamp et al. (Eds.) MIT Press, pp. 211–242.

  • Lay, K., Prassler, E., Dillmann, R., Grunwald, G., Hägele, M., Lawitzky, G., Stopp, A., and von Seelen, W. 2001. MORPHA: Communication and interaction with intelligent, anthropomorphic robot assistants. In Tagungsband Statustage Leitprojekte Mensch-Technik-Interaktion in der Wissensgesellschaft.

  • Littman, L. 1994. The witness algorithm: Solving partially observable Markov decision processes. Technical Report CS-94-04, Brown University, Department of Computer Science, Providence, RI.

  • López, E., Barea, R., Bergasa, L.M., and Escudero, M.S. 2002. Aplicación del método de Markov a la localización de un robot móvil en entornos interiores. In Proceedings of the “Seminario Anual de Automática, Electrónica Industrial e Instrumentación” (SAAEI’02), vol. 1, pp. 339-342.

  • López, E., Barea, R., Bergasa, L.M., and Escudero, M.S. 2004. A human-robot cooperative learning system for easy installation of assistant robots in new working environments. Journal of Intelligent and Robotic Systems, 40:233–265.

    Article  Google Scholar 

  • Lovejoy, W.S. 1991. A survey of algorithmic methods for partially observed Markov decision processes. Annals of Operations Research, 28(1):47–65.

    Google Scholar 

  • Montemerlo, M., Pineau, J., Roy, N., Thrun, S., and Verma, V. 2002. Experiences with a mobile robotic guide for the elderly. In Proc. of the AAAI National Conference on Artificial Intelligence. Edmonton, Canada.

  • Nourbakhsh, I., Powers, R., and Birchfield, S. 1995. DERVISH: An office navigating robot. Artificial Intelligence Magazine, 16(2).

  • Papadimitriou, C., Tsitsiklis, J. 1987. The complexity of Markov decision processes. Mathematics of Operations Research, 12(3): 441–450.

    Google Scholar 

  • Pineau, J., Gordon, G., and Thrun, S. 2003. Point-based value iteration: An anytime algorithm for POMDPs. International Joint Conference on Artificial Intelligence (IJCAI). Acapulco, Mexico, pp. 1025–1032.

  • Pineau, J. and Thrun, S. 2002. An integrated approach to hierarchy and abstraction for POMDPs, Technical Report CMU-RI-TR-02-21, Carnegie Mellon University, Pittsburgh, PA.

  • Puterman, M.L. 1994. Markov Decision Processes—Discrete Stochastic Dynamic Programming. John Wiley & Sons, Inc.: New York, NY.

    Google Scholar 

  • Regini, L., Tascini, G., and Zingaretti, P. 2002. Appearance-based Robot Navigation. Artificial Intelligence and Intelligent Agents AIIA 2002.

  • Roy, N. 2003. Finding aproximate POMDP solutions through belief compression. PhD Thesis, CMU-RI-TR-03-25. Robotics Insititute, Carnegie Mellon University, 2003.

  • Roy, N., Baltus, G., Fox, D., Gemperle, F., Goetz, J., Hirsch, T., Magaritis, D., Montemerlo, M., Pineau, J., Schulte, J., and Thrun, S. 2000. Towards personal service robots for the elderly. In Proc. of the Workshop on Interactive Robotics and Entertainment (WIRE), Pittsburgh, PA.

  • Saffiotti, A. 1994. Pick-up what? In Current Trends in AI Planning, X. Bäckström and E. Sandewall (Eds.), IOS Press: Amsterdam, Netherlands.

    Google Scholar 

  • Saffiotti, A., Ruspini, E.H., and Konolige, K. 1993. Integrating reactivity and goal-directedness in a fuzzy controller. In Proceedings of the 2nd Fuzzy IEEE Conference.

  • Theocharous, G. and Mahadevan, S. 2002. Approximate planning with hierarchical partially observable markov decision processs for robot navigation. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA).

  • Thrun, S. 2002. Probabilistic algorithms in robotics. Technical Report CMU-CS-00-126. Carnegie Mellon University.

  • Winston, P.H. 1984. Artificial Intelligence. Addison-Wesley.

  • Yairi, T., Togami, M., and Hori, K. 2003. Learning topological structures of pomdp-based state transition models by state splitting method. In Proceedings of the 21th IASTED International Conference on Applied Informatics, pp. 7–12.

  • Zanichelli, F. 1999. Topological maps and robust localization for autonomous navigation. IJCAI Workshop on Adaptive Spatial Representations of Dynamic Environments.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to María Elena López.

Rights and permissions

Reprints and permissions

About this article

Cite this article

López, M.E., Bergasa, L.M., Barea, R. et al. A Navigation System for Assistant Robots Using Visually Augmented POMDPs. Auton Robot 19, 67–87 (2005). https://doi.org/10.1007/s10514-005-0607-3

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-005-0607-3

Keywords

Navigation