Skip to main content
SpringerLink
Log in

Multi-Robot Dynamic Task Allocation for Exploration and Destruction

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Environmental exploration is one of the common tasks in the robotic domain which is also known as foraging. In comparison with the typical foraging tasks, our work focuses on the Multi-Robot Task Allocation (MRTA) problem in the exploration and destruction domain, where a team of robots is required to cooperatively search for targets hidden in the environment and attempt to destroy them. As usual, robots have the prior knowledge about the suspicious locations they need to explore but they don’t know the distribution of interested targets. So the destruction task is dynamically generated along with the execution of exploration task. Each robot has different strike ability and each target has uncertain anti-strike ability, which means either the robot or target is likely to be damaged in the destruction task according to that whose ability is higher. The above setting significantly increases the complexity of exploration and destruction problem. The auction-based approach, vacancy chain approach and a deep Q-learning approach based on strategy-level selection are employed in this paper to deal with this problem. A new simulation system based on Robot Operating System and Gazebo is specially built for this MRTA problem. Subsequently, extensive simulation results are provided to show that all proposed approaches are able to solve the MRTA problem in exploration and destruction domain. In addition, experimental results are further analyzed to show that each method has its own advantages and disadvantages.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Argall, B.D., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstration. Robot. Auton. Syst. 57(5), 469–483 (2009)

    Article  Google Scholar 

  2. Attiya, G., Hamam, Y.: Task allocation for maximizing reliability of distributed systems: a simulated annealing approach. J. Parallel Distrib. Comput. 66(10), 1259–1266 (2006)

    Article  Google Scholar 

  3. Bekey, I.: Formation flying picosat swarms for forming extremely large apertures. First Workshop on Innovative System Concepts 633, 57–64 (2006)

    Google Scholar 

  4. Bektas, T.: The multiple traveling salesman problem: an overview of formulations and solution procedures. Omega 34(3), 209–219 (2006)

    Article  MathSciNet  Google Scholar 

  5. Chase, I.D., Weissburg, M., Dewitt, T.H.: The vacancy chain process: a new mechanism of resource distribution in animals with application to hermit crabs. Anim. Behav. 36(5), 1265–1274 (1988)

    Article  Google Scholar 

  6. Dahl, T.S., Matarić, M., Sukhatme, G.S.: Multi-robot task allocation through vacancy chain scheduling. Robot. Auton. Syst. 57(6), 674–687 (2009)

    Article  Google Scholar 

  7. Dahl, T.S., Matarić, M.J., Sukhatme, G.S.: A Machine Learning Method for Improving Task Allocation in Distributed Multi-Robot Transportation. Springer, Berlin (2006)

    Book  Google Scholar 

  8. Dai, W., Lu, H., Xiao, J., Zheng, Z.: Task allocation without communication based on incomplete information game theory for multi-robot systems. J. Intell. Robot. Syst. 94(3), 841–856 (2019)

    Article  Google Scholar 

  9. Parker, E.L.: L-alliance: Task-oriented multi-robot learning in behavior-based systems. Adv. Robot. 11(4), 305–322 (1997)

    Article  Google Scholar 

  10. Ferber, J.: Multi-Agent Systems: an introduction to distributed artificial intelligence. Addison-wesley longman publishing co. Inc (1999)

  11. Gage, A.: Multi-robot task allocation using affect. Dissertation Abstracts International, volume: 65-12, section: B page: 6470.;Major professor: Robin (2004)

  12. Gerkey, B.P., Matari, M.J.: Sold!: auction methods for multirobot coordination. IEEE Trans. robot. autom 18(5), 758–768 (2002)

    Article  Google Scholar 

  13. Gerkey, B.P., Matarić, M. J.: A systems. In: International Journal of Robotics Research, p. 2004 (2004)

  14. Horst, J.V.D., Noble, J.: Distributed and centralized task allocation: when and where to use them. In: IEEE International Conference on Self-Adaptive & Self-Organizing Systems Workshop, pp. 1–8 (2010)

  15. Horst, V.D.: Johannes: Market-based Task Allocation in Distributed Satellite Systems. Ph.D. thesis, University of Southampton (2012)

  16. Jennings, N.R.: Controlling cooperative problem solving in industrial multi-agent systems using joint intentions. Artif. Intell. 75(2), 195–240 (1995)

    Article  MathSciNet  Google Scholar 

  17. Jiang, Y., Hu, J., Lin, D.: Decision making of networked multiagent systems for interaction structures. IEEE Press (2011)

  18. Jiang, Y., Zhou, Y., Wang, W.: Task allocation for undependable multiagent systems in social networks. IEEE press (2013)

  19. Kalra, N., Ferguson, D., Stentz, A.: Hoplites: a market-based framework for planned tight coordination in multirobot teams. In: IEEE International Conference on Robotics and Automation, pp. 1170–1177 (2005)

  20. Kapetanakis, S., Kudenko, D.: Improving on the reinforcement learning of coordination in cooperative multi-agent systems. Aaai/iaai, pp. 326–331 (2002)

  21. Koenig, N., Howard, A.: Design and use paradigms for gazebo, an open-source multi-robot simulator. In: Ieee/Rsj International Conference on Intelligent Robots and Systems, Vol.3. pp. 2149–2154 (2004)

  22. Koenig, S., Keskinocak, P., Tovey, C.: Progress on agent coordination with cooperative auctions. In: Twenty-Fourth AAAI Conference on Artificial Intelligence, pp. 1713–1717 (2010)

  23. Koenig, S., Tovey, C., Lagoudakis, M., Markakis, V., Kempe, D., Keskinocak, P., Kleywegt, A., Meyerson, A., Jain, S.: The power of sequential single-item auctions for agent coordination. In: National Conference on Artificial Intelligence, pp. 1625–1629 (2006)

  24. Kovac, K., Zivkovic, I., Basic, B.D.: Simulation of multi-robot reinforcement learning for box-pushing problem. In: Electrotechnical Conference, 2004. Melecon 2004. Proceedings of the IEEE Mediterranean, Vol. 2. pp. 603–606 (2004)

  25. Lagoudakis, M.G., Berhault, M., Koenig, S., Keskinocak, P.: Simple auctions with performance guarantees for multi-robot task allocation. In: Ieee/Rsj International Conference on Intelligent Robots and Systems, Vol. 1. pp. 698–705 (2004)

  26. Lagoudakis, M.G., Markakis, E., Kempe, D., Keskinocak, P., Kleywegt, A.J., Koenig, S., Tovey, C.A., Meyerson, A., Jain, S.: Auction-based multi-robot routing. In: Robotics: Science & Systems, pp. 343–350 (2005)

  27. Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P.: Mordatch I.: Multi-agent actor-critic for mixed cooperative-competitive environments (2017)

  28. Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., Riedmiller, M.: Playing atari with deep reinforcement learning. Computer Science (2013)

  29. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G.: Human-level control through deep reinforcement learning. Nature 518(7540), 529 (2015)

    Article  Google Scholar 

  30. Mosteo, A.: A survey of multi-robot task allocation. Mosteo. Com, pp. 1–27 (2010)

  31. Oh, G., Kim, Y., Ahn, J., Choi, H.L.: Market-based task assignment for cooperative timing missions in dynamic environments. J. Intell. Robot. Syst. 87(1), 97–123 (2017)

    Article  Google Scholar 

  32. Parker, L.E.: Alliance: an architecture for fault tolerant multi-robot cooperation. IEEE Trans Rob Autom 14 (2), 220–240 (1995)

    Article  Google Scholar 

  33. Parker, L.E.: Distributed algorithms for multi-robot observation of multiple moving targets. Auton. Robot. 12(3), 231–255 (2002)

    Article  Google Scholar 

  34. Quigley, M.: Ros : an open-source robot operating system. In: Proc. IEEE ICRA Workshop on Open Source Robotics (2009)

  35. Schoenig, A., Pagnucco, M.: Evaluating sequential single-item auctions for dynamic task allocation. In: Ai 2010: Advances in Artificial Intelligence - Australasian Joint Conference, Adelaide, Australia, December 7-10, 2010. Proceedings, pp. 506–515 (2010)

  36. Smith, R.G.: The contract net protocol: High-Level communication and control in a distributed problem solver. IEEE Computer Society (1980)

  37. Tampuu, A., Matiisen, T., Kodelja, D., Kuzovkin, I., Korjus, K., Aru, J., Aru, J., Vicente, R.: Multiagent cooperation and competition with deep reinforcement learning. Plos One 12(4), e0172,395 (2017)

    Article  Google Scholar 

  38. Taylor, M.E., Stone, P.: Behavior transfer for value-function-based reinforcement learning. In: International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 53–59 (2005)

  39. Tegelberg, A., Kopp, S.: Agent coordination with regret clearing. In: National Conference on Artificial Intelligence, pp. 101–107 (2008)

  40. Tovey, C., Lagoudakis, M.G., Jain, S., Koenig, S.: The Generation of Bidding rules for Auction-Based Robot Coordination. Springer, Netherlands (2005)

    Book  Google Scholar 

  41. Vincent, P., Rubin, I.: A framework and analysis for cooperative search using Uav swarms. In: ACM Symposium on Applied Computing, pp. 79–86 (2004)

  42. Volle, K., Rogers, J.D., Brink, K.: Scalable cooperative control algorithms for the weapon target assignment problem. In: AIAA Guidance, Navigation, and Control Conference (2015)

  43. Wei, C., Hindriks, K.V., Jonker, C.M.: Dynamic task allocation for multi-robot search and retrieval tasks. Appl. Intell. 45(2), 1–19 (2016)

    Article  Google Scholar 

  44. Werger, B.B., Mataric, M.J.: Broadcast of local eligibility: behavior-based control for strongly cooperative robot teams. In: International Conference on Autonomous Agents, pp. 21–22 (2000)

  45. White, H.C.: Matching, vacancies, and mobility. J. Polit. Econ. 78(1), 97–105 (1970)

    Article  Google Scholar 

  46. Ye, D., Zhang, M., Sutanto, D.: Self-adaptation-based dynamic coalition formation in a distributed agent network: a mechanism and a brief survey. IEEE Trans. Parallel Distrib. Syst. 24(5), 1042–1051 (2013)

    Article  Google Scholar 

  47. Zedadra, O., Seridi, H., Jouandeau, N., Fortino, G.: A cooperative switching algorithm for multi-agent foraging. Eng. Appl. Artif. Intel. 50(C), 302–319 (2016)

    Article  Google Scholar 

  48. Zhao, W., Meng, Q., Chung, P.W.: A heuristic distributed task allocation method for multivehicle multitask problems and its application to search and rescue scenario. IEEE Transactions on Cybernetics 46(4), 902–915 (2016)

    Article  Google Scholar 

  49. Zheng, X., Koenig, S.: K-Swaps: cooperative negotiation for solving task-allocation problems. In: International Jont Conference on Artifical Intelligence, pp. 373–378 (2009)

  50. Zlot, R., Stentz, A.: . Market-based multirobot coordination using task abstraction 24, 167–177 (2003)

    Google Scholar 

  51. Zlot, R., Stentz, A., Dias, M.B., Thayer, S.: Multi-robot exploration controlled by a market economy. In: IEEE International Conference on in Robotics & Automation, pp. 3016–3023 (2002)

  52. Zomaya, A.Y., Teh, Y.H.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Trans. Parallel Distrib. Syst. 12(9), 899–911 (2001)

    Article  Google Scholar 

Download references

Acknowledgements

Our work is supported by National Science Foundation of China (NO. 61773393 and NO. U1813205), and graduate school of National University of Defense Technology. All members of the NuBot research group are gratefully acknowledged.

Author information

Author notes

    Authors and Affiliations

    1. College of Intelligence Science and Technology, National University of Defense Technology, Changsha, Hunan, China

      Wei Dai, Huimin Lu, Junhao Xiao, Zhiwen Zeng & Zhiqiang Zheng

    Authors
    1. Wei Dai
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Huimin Lu
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Junhao Xiao
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Zhiwen Zeng
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Zhiqiang Zheng
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Huimin Lu.

    Additional information

    Publisher’s Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Wei Dai and Huimin Lu contributed equally to this work

    Rights and permissions

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Dai, W., Lu, H., Xiao, J. et al. Multi-Robot Dynamic Task Allocation for Exploration and Destruction. J Intell Robot Syst 98, 455–479 (2020). https://doi.org/10.1007/s10846-019-01081-3

    Download citation

    • Received:

    • Accepted:

    • Published:

    • Issue Date:

    • DOI: https://doi.org/10.1007/s10846-019-01081-3

    Keywords

    Search

    Navigation