Skip to main content
Log in

Extending Behavior Trees for Representing and Planning Robot Adjoint Actions in Partially Observable Environments

  • Regular Paper
  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Behavior Trees (BTs) have received increasing popularity in the robotics community, serving as an efficient way of modeling robot behavior and structuring behavior interactions. Utilizing automated planning with BT task-level robot control has been proven efficiently reactive to environment dynamics, allowing iterative expansion of BT action nodes while executing the tree. However, existing BT-based planning approaches plan the new actions under the assumption of a fully observable environment model, which shows limitations when the robot has only partial observations on the environment states. In a partially observable domain, an expected robotic plan is an interleaved and adjoint sequence of robot acting and sensing actions. Each acting action is decided upon new observations received by a sensing action. It remains a challenge to efficiently obtain the partially observable states by interacting between robot sensing and acting actions. This paper first proposes a novel Adjoint Sensing and Acting (ASA) model that explicitly abstracts robot actions and specifies an adjoint interaction scheme between them to tackle this challenge. Then, we extend the classical formulation of BTs to represent and realize the ASA model, which proposes a new atomic ASA-BT structure for representing the partially observable environment states and modeling ASA action components. Finally, we cast the problem of planning adjoint acting and sensing actions as a Partially Observable Markov Decision Process (POMDP), which plans out an efficient ASA-based plan. By comparing with the classical BT approach, we experimentally demonstrate that plans from ASA-BT based planning approach can efficiently obtain the partially observable states with fewer time costs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Availability of data and materials

All data generated or analyzed during this study are included in this published article. The source codes used during the research are available from the corresponding author on reasonable request.

References

  1. Colledanchise, M., Ögren, P.: Behavior Trees in Robotics and AI: An Introduction[M]. CRC Press, Boca Raton (2018)

    Book  Google Scholar 

  2. Brooks, R.: A robust layered control system for a mobile robot[J]. IEEE J Robot Autom 2(1), 14–23 (1986)

    Article  Google Scholar 

  3. Nehaniv, C.L., Dautenhahn, K., Dautenhahn, K. (eds.): Imitation in Animals and Artifacts[M]. MIT Press, Cambridge (2002)

    Google Scholar 

  4. Nilsson, N.: Teleo-reactive programs for agent control[J]. J Artif Intell Res 1, 139–158 (1993)

    Article  Google Scholar 

  5. Colledanchise, M., Almeida, D., Ögren, P.: Towards blended reactive planning and acting using behavior trees[C]. In: 2019 International Conference on Robotics and Automation (ICRA), pp.8839–8845. IEEE (2019)

  6. Garrett, C.R., Lozano-Pérez, T., Kaelbling, L.P.: Backward-forward search for manipulation planning[C]. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.6366–6373. IEEE (2015)

  7. Kuestenmacher, A., Akhtar, N., Plöger, P.G., et al.: Towards robust task execution for domestic service robots[J]. J. Intell. Robot. Sys. 76(1), 5–33 (2014)

    Article  Google Scholar 

  8. Ross, S., Pineau, J., Paquet, S., et al.: Online planning algorithms for POMDPs[J]. J. Artif. Intell. Res. 32, 663–704 (2008)

    Article  MathSciNet  Google Scholar 

  9. Pereira, T., Moreira, A., Veloso, M.: Optimal perception planning with informed heuristics constructed from visibility maps[J]. J. Intell. Robot. Sys. 93(3-4), 547–570 (2019)

    Article  Google Scholar 

  10. Ingrand, F., Ghallab, M.: Deliberation for autonomous robots: A survey[J]. Artif. Intell. 247, 10–44 (2017)

    Article  MathSciNet  Google Scholar 

  11. Bohg, J., Hausman, K., Sankaran, B., et al.: Interactive perception: Leveraging action in perception and perception in action[J]. IEEE Trans. Robot. 33(6), 1273–1291 (2017)

    Article  Google Scholar 

  12. Geffner, H., Bonet, B.: A concise introduction to models and methods for automated planning[J]. Synth. Lect. Artif. Intell. Mach. Learn. 8(1), 1–141 (2013)

    MATH  Google Scholar 

  13. Nau, D.S., Ghallab, M., Traverso, P.: Blended planning and acting: preliminary approach, research challenges[C]. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, pp.4047–4051 (2015)

  14. Giunchiglia, E., Colledanchise, M., Natale, L., et al.: Conditional behavior trees: definition, executability, and applications[C]. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp.1899–1906. IEEE (2019)

  15. Colledanchise, M., Natale, L.: Improving the parallel execution of behavior trees[C]. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.7103–7110. IEEE (2018)

  16. Merrill, B.: Building utility decisions into your existing behavior tree[J]. Game AI Pro: Collected Wisdom of Game AI Professionals, p. 127 (2013)

  17. Rovida, F., Grossmann, B., Krüger, V.: Extended behavior trees for quick definition of flexible robotic tasks[C]. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.6793–6800. IEEE (2017)

  18. Hannaford, B., Hu, D., Zhang, D., et al.: Simulation results on selector adaptation in behavior trees[J]. arXiv:1606.09219 (2016)

  19. Colledanchise, M., Marzinotto, A., Ögren, P.: Performance analysis of stochastic behavior trees[C]. In: IEEE International Conference on Robotics and Automation (ICRA), pp.3265–3272. IEEE (2014)

  20. Flórez-Puga, G., Gomez-Martin, M., Diaz-Agudo, B., et al.: Dynamic expansion of behavior trees[C]. In: Proceedings of Artificial Intelligence and Interactive Digital Entertainment Conference, pp.36–41. AAAI Press (2008)

  21. Banerjee, B.: Autonomous acquisition of behavior trees for robot control[C]. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp.3460–3467. IEEE (2018)

  22. Colledanchise, M., Parasuraman, R., Ögren, P.: Learning of behavior trees for autonomous agents[J]. IEEE Transactions on Games 11(2), 183–189 (2018)

    Article  Google Scholar 

  23. French, K., Wu, S., Pan, T., et al.: Learning behavior trees from demonstration[C]. In: 2019 International Conference on Robotics and Automation (ICRA), pp.7791–7797. IEEE (2019)

  24. Biggar, O, Zamani, M.: A framework for formal verification of behavior trees with linear temporal logic[J]. IEEE Robot. Autom. Lett. 5(2), 2341–2348 (2020)

    Article  Google Scholar 

  25. Ghallab, M., Nau, D., Traverso, P.: Automated Planning and Acting[M]. Cambridge University Press, Cambridge (2016)

    MATH  Google Scholar 

  26. Ong, S.C.W., Wei, S., Hsu, D., Sun, W.: Planning under uncertainty for robotic tasks with mixed observability[J]. Int. J. Robot. Res. 29(8), 1053–1068 (2010)

    Article  Google Scholar 

  27. Colledanchise, M., Ögren, P.: How behavior trees modularize hybrid control systems and generalize sequential behavior compositions, the subsumption architecture, and decision trees[J]. IEEE Trans. Robot. 33(2), 372–389 (2016)

    Article  Google Scholar 

  28. Peterson, G.L., Duffy, J.P., Hooper, D.J.: Dynamic behavior sequencing for hybrid robot architectures[J]. Int. J. Robot. Res. 64(2), 179–196 (2011)

    Google Scholar 

  29. Somani, A., Ye, N., Hsu, D., et al.: DESPOT: Online POMDP planning with regularization[C]. NIPS 13, 1772–1780 (2013)

    MATH  Google Scholar 

  30. Cai, P., Luo, Y., Hsu, D., et al.: HyP-DESPOT: A hybrid parallel algorithm for online planning under uncertainty[J]. Int. J. Robot. Res.: 0278364920937074 (2020)

  31. Luo, Y., Bai, H., Hsu, D., et al.: Importance sampling for online planning under uncertainty[J]. Int. J. Robot. Res. 38(2-3), 162–181 (2019)

    Article  Google Scholar 

Download references

Funding

This work is supported by the Key Laboratory of Software Engineering for Complex Systems. The work is also supported by the National Natural Science Foundation of China under Grant No.61872371.

Author information

Authors and Affiliations

Authors

Contributions

Dr. Shuo Yang made primary contributions to the conception or design of the work. Professor Xinjun Mao made optimization of the software architecture and concept reconsideration. Mr. Shuo Wang contributed to the software development in the experiments and revised it critically for important intellectual content. Mr. Yantao Bai made the acquisition, analysis, or interpretation of data.

Corresponding authors

Correspondence to Shuo Yang or Xinjun Mao.

Ethics declarations

Ethical Approval

Approval was obtained from the ethics committee of the National University of Defense Technology.

Consent to participate

Informed consent was obtained from all individual participants included in the study.

Consent for Publication

The participant has consented to the submission of the research manuscript to the journal.

Competing interests

The authors have no conflicts of interest to declare that are relevant to the content of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, S., Mao, X., Wang, S. et al. Extending Behavior Trees for Representing and Planning Robot Adjoint Actions in Partially Observable Environments. J Intell Robot Syst 102, 36 (2021). https://doi.org/10.1007/s10846-021-01396-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10846-021-01396-0

Keywords

Navigation