Skip to main content
Log in

A hierarchical and adaptive mobile manipulator planner with base pose uncertainty

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

We present a hierarchical and adaptive mobile manipulator planner (HAMP) that plans for both the base and the arm in a judicious manner—allowing the manipulator to change its configuration autonomously when needed if the current arm configuration is in collision with the environment as the mobile manipulator moves along the planned path. This is in contrast to current implemented approaches that are conservative and fold the arm into a fixed home configuration. Our planner first constructs a base roadmap and then for each node in the roadmap it checks for collision status of current manipulator configuration along the edges formed with adjacent nodes, if the current manipulator configuration is in collision, the manipulator C-space is searched for a new reachable configuration such that it is collision-free as the mobile manipulator moves along the edge and a path from current configuration to the new reachable configuration is computed. We show that HAMP is probabilistically complete. We compared HAMP with full 9D PRM and observed that the full 9D PRM is outperformed by HAMP in each of the performance criteria, i.e., computational time, percentage of successful attempts, base path length, and most importantly, undesired motions of the arm. We also evaluated the tree versions of HAMP, with RRT and bi-directional RRT as core underlying sub-planners, and observed similar advantages, although the time saving for bi-directional RRT version is modest. We then present an extension of HAMP (we call it HAMP-U) that uses belief space planning to account for localization uncertainty associated with the mobile base position and ensures that the resultant path for the mobile manipulator has low uncertainty at the goal. Our experimental results show that the paths generated by HAMP-U are less likely to result in collision and are safer to execute than those generated by HAMP (without incorporating uncertainty), thereby showing the importance of incorporating base pose uncertainty in our overall HAMP algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Notes

  1. Thanks to the anonymous referee for pointing this out.

  2. Note that there are other options here, e.g., one could simply construct the base roadmap for the base only, however, this could lead to several nodes/edges being invalidated in the subsequent stage.

  3. We are using multiple possible goal configurations because empirically it was faster than searching for a single goal configuration. Most likely, it is because the likelihood of multiple goal configurations being difficult to reach would be significantly lower.

References

  • Agha-mohammadi, A., Chakravorty, S., & Amato, N. (2014). FIRM: Sampling-based feedback motion planning under motion uncertainty and imperfect measurements. The International Journal of Robotics Research, 33(2), 268–304.

    Article  Google Scholar 

  • Berenson, D., Kuffner, J., & Choset, H. (2008). An optimization approach to planning for mobile manipulation. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 1187–1192).

  • Bouilly, B., Simeon, T., & Alami, R. (1995). A numerical technique for planning motion strategies of a mobile robot in presence of uncertainty. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 1327–1332).

  • Burns, B., & Brock, O. (2007). Sampling-based motion planning with sensing uncertainty. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 3313–3318).

  • Choset, H., Lynch, K. M., Hutchinson, S., Kantor, G. A., Burgard, W., Kavraki, L. E., et al. (2005). Principles of robot motion: Theory, algorithms, and implementations, chap. 7. Cambridge, MA: MIT Press.

    Google Scholar 

  • Ciocarlie, M., Hsiao, K., Jones, E. G., Chitta, S., Rusu, R. B., & Sucan, I. A. (2010). Towards reliable grasping and manipulation in household environments. In: RSS 2010 Workshop on Strategies and Evaluation for Mobile Manipulation in Household Environments (pp. 1–12).

  • Fraichard, T., & Mermond, R. (1998). Path planning with uncertainty for car-like robots. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 27–32).

  • Gochev, K., Safonova, A., & Likhachev, M. (2012). Planning with adaptive dimensionality for mobile manipulation. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 2944–2951).

  • Gonzalez, J.,&Stentz, A. (2005). Planning with uncertainty in position: an optimal and efficient planner. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS) (pp. 1327–1332). Edmenton, Canada.

  • Guibas, L., Hsu, D., Kurniawati, H., & Rehman, E. (2008). Bounded uncertainty roadmaps for path planning. In Workshop on Algorithmic Foundations of Robotics (WAFR).

  • Hornung, A., & Bennewitz, M. (2012). Adaptive level-of-detail planning for efficient humanoid navigation. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 997–1002).

  • Hornung, A., Phillips, M., Jones, E. G., Bennewitz, M., Likhachev, M., & Chitta, S. (2012). Navigation in three-dimensional cluttered environments for mobile manipulation. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 423–429).

  • Hornung, A., Wurm, K. M., Bennewitz, M., Stachniss, C., & Burgard, W. (2013). OctoMap: An efficient probabilistic 3D mapping framework based on octrees. Autonomous Robots, 34(3), 189–206.

    Article  Google Scholar 

  • Hsu, D., Latombe, J. C., & Kurniawati, H. (2006). On the probabilistic foundations of probabilistic roadmap planning. International Journal of Robotics Research (IJRR), 25(7), 627–643.

    Article  Google Scholar 

  • Huang, Y., & Gupta, K. (2008). RRT-SLAM for motion planning with motion and map uncertainty for robot exploration. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS) (pp. 22–26).

  • Huang, Y., & Gupta, K. (2009). Collision-probability constrained PRM for a manipulator with base pose uncertainty. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS) (pp. 1426–1432).

  • Kaelbling, L., Littman, M., & Cassandra, A. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101, 99–134.

    Article  MATH  MathSciNet  Google Scholar 

  • Kavraki, L. E., Svestka, P., Latombe, J. C., & Overmars, M. H. (1996). Probabilistic roadmaps for path planning in high-dimensional configuration spaces. IEEE Transactions on Robotics and Automation, 12(4), 566–580.

    Article  Google Scholar 

  • Kuffner, J., & LaValle, S. (2000). RRT-connect: An efficient approach to single-query path planning. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 995–1001).

  • Kurniawati, H., Du, Y., Hsu, D., & Lee, W. S. (2009). Motion planning under uncertainty for robotic tasks with long time horizons. In Proceedings of the International Symposium on Robotics Research.

  • Kurniawati, H., Bandyopadhyay, T., & Patrikalakis, N. (2012). Global motion planning under uncertain motion, sensing, and environment map. Autonomous Robots, 33(3), 255–272.

    Article  Google Scholar 

  • Lambert, A., & Gruyer, D. (2003). Safe path planning in an uncertain-configuration space. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 4185–4190). Roma, Italy.

  • Lavalle, S. M. (1998). Rapidly-exploring random trees: A new tool for path planning. Technical Report 98–11, Computer Science Department, Iowa State University.

  • Lazanas, A., & Latombe, J. C. (1995). Motion planning with uncertainty: A landmark approach. Artificial Intelligence, 76(1–2), 287–317.

    Article  Google Scholar 

  • Marder-Eppstein, E., Berger, E., Foote, T., Gerkey, B. P., & Konolige, K. (2010). The office marathon: Robust navigation in an indoor office environment. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 300–307).

  • Melchior, N. A., & Simmons, R. (2007). Particle RRT for path planning with uncertainty. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 1617–1624). Roma, Italy.

  • Missiuro, P., & Roy, N. (2006). Adapting probabilistic roadmaps to handle uncertain maps. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 1261–1267).

  • Monastero, A.,&Fiorini, P. (2009). Target pose computation for nonholonomic mobile manipulators. In Proceedings of the IEEE International Conference on Advanced Robotics (pp. 1–8).

  • Nakhaei, A., & Lamiraux, F. (2008). A framework for planning motions in stochastic maps. In Proceedings of the International Conference on Control, Automation, Robotics and Vision (ICARCV) (pp. 1959–1964).

  • Pineau, J., Gordon, G., & Thrunn, S. (2003). Point-based value iteration: An anytime algorithm for pomdps. In: International Joint Conferences on Artificial Intelligence (pp. 1025–1032).

  • Platt, R., Tedrake, R., Kaelbling, L., & Lozano-Perez, T. (2010). Belief space planning assuming maximum likelihood observations. In Proceedings of Robotics: Science and Systems. Zaragoza, Spain.

  • Prentice, S., & Roy, N. (2009). The belief roadmap: Efficient planning in belief space by factoring the covariance. The International Journal of Robotics Research, 28(11–12), 1448–1465.

    Article  Google Scholar 

  • Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., & Ng, A. Y. (2009). ROS: An open-source robot operating system. In Proceedings Open-Source Software workshop of the International Conference on Robotics and Automation (ICRA).

  • Roy, N., & Thrun, S. (1999). Coastal navigation with mobile robots. Advances in Neural Processing Systems, 12, 1043–1049.

    Google Scholar 

  • Rusu, R. B., Blodow, N., Marton, Z. C., & Beetz, M. (2009). Close-range scene segmentation and reconstruction of 3d point cloud maps for mobile manipulation in domestic environments. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 1–6).

  • Saxena, A., Driemeyer, J., & Ng, A. Y. (2008). Robotic grasping of novel objects using vision. The International Journal of Robotics Research, 27(2), 157–173.

    Article  Google Scholar 

  • Scholz, J., Chitta, S., Marthi, B., & Likhachev, M. (2011). Cart pushing with a mobile manipulation system: Towards navigation with moveable objects. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) Shanghai, China.

  • Smallwood, R., & Sondik, E. (1973). The optimal control of partially observable markov processes over a finite horizon. Operation Research, 21(5), 1071–1088.

    Article  MATH  Google Scholar 

  • Stilman, M. (2007). Task constrained motion planning in robot joint space. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 3074–3081).

  • Şucan, I. A., Moll, M., & Kavraki, L. E. (2012). The open motion planning library. IEEE Robotics & Automation Magazine, 19(4), 72–82. http://ompl.kavrakilab.org.

  • Tan, J., & Xi, N. (2001). Unified model approach for planning and control of mobile manipulators. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 3145–3152).

  • Tanner, H. G., & Kyriakopoulos, K. J. (2000). Nonholonomic motion planning for mobile manipulators. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) (pp. 1233–1238).

  • Torabi, L., Kazemi, M., & Gupta, K. (2007). Configuration space based efficient view planning and exploration with occupancy grids. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS) (pp. 2827–2832).

  • van den Berg, J., Abbeel, P., & Goldberg, K. (2011). LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information. The International Journal of Robotics Research, 30(7), 895–913.

    Article  Google Scholar 

  • Vannoy, J., & Xiao, J. (2008). Real-time adaptive motion planning (RAMP) of mobile manipulators in dynamic environments with unforeseen changes. IEEE Transctions on Robotics, 24(5), 1199–1212.

    Article  Google Scholar 

  • Yamamoto, Y., & Yun, X. (1994). Coordinating locomotion and manipulation of a mobile manipulator. IEEE Transactions Automatic Control, 39(6), 1326–1332.

    Article  MATH  Google Scholar 

  • Yang, J., Dymond, P., & Jenkin, M. (2011). Exploiting hierarchical probabilistic motion planning for robot reachable workspace estimation. In Informatics in Control Automation and Robotics, LNEE85 pp. 229–241. Springer.

  • Yang, Y., & Brock, O. (2010). Elastic roadmaps—Motion generation for autonomous mobile manipulation. Autonomous Robot, 28(1), 113–130.

    Article  Google Scholar 

  • Yao, Z., & Gupta, K. (2007). Path planning with general end-effector constraints. Robotics and Autonomous Systems, 55(4), 316–327.

    Article  Google Scholar 

  • Yu, Y., & Gupta, K. (2004). C-space entropy: A measure for view planning and exploration for general robot-sensor systems in unknown environments. International Journal of Robotics Research, 23(12), 1197–1223.

    Article  Google Scholar 

Download references

Acknowledgments

The work has been partly funded by an NSERC Discovery Grant of Kamal Gupta. We would like to thank the anonymous reviewer for insightful comments that helped us improve the paper. A preliminary and earlier part of this work was presented at HUMANOIDS 2014 conference.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vinay Pilania.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mpg 52612 KB)

Supplementary material 2 (mpg 24172 KB)

Supplementary material 3 (mpg 45160 KB)

Supplementary material 4 (mpg 31470 KB)

Supplementary material 5 (mpg 49570 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pilania, V., Gupta, K. A hierarchical and adaptive mobile manipulator planner with base pose uncertainty. Auton Robot 39, 65–85 (2015). https://doi.org/10.1007/s10514-015-9427-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-015-9427-2

Keywords

Navigation