Abstract
We propose a learning method that decides the period of activity according to environmental characteristics and the behavioral strategies in the multi-agent continuous cooperative patrol problem. With recent advances in computer and sensor technologies, agents, which are intelligent control programs running on computers and robots, obtain high autonomy so that they can operate in various fields without pre-defined knowledge. However, cooperation/coordination between agents is sophisticated and complicated to implement. We focus on the activity cycle length (ACL) which is the time length from when an agent starts a patrol to when the agent returns to a charging base in the context of a cooperative patrol where agents, like robots, have batteries with limited capacity. A long ACL will enable an agent to visit distant locations, but the agent will require a long rest time to recharge. The basic idea of our method is that if agents have long-life batteries, they can appropriately shorten the ACL, and thus can visit important locations with a short interval of time by recharging frequently. However, appropriate ACL must depend on many elements such as environmental size, number of agents, workload in an environment, and other agents’ behavior and ACLs. Therefore, we propose a method in which agents autonomously learn the appropriate ACL on the basis of the number of events detected per cycle. We experimentally indicate that our agents are able to learn appropriate ACL depending on established spatial divisional cooperation. We also report the details of the analysis of the experimental results to understand the behaviors of agents with different ACLs.
T. Sugawara—This work was partly supported by JSPS KAKENHI (17KT0044).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ahmadi, M., Stone, P.: A multi-robot system for continuous area sweeping tasks. In: Proceedings of the 2006 IEEE International Conference on Robotics and Automation, pp. 1724–1729 (2006)
Bentz, W., Panagou, D.: An energy-aware redistribution method for multi-agent dynamic coverage networks. In: 2016 IEEE 55th Conference on Decision and Control (CDC), pp. 2644–2651 (2016). https://doi.org/10.1109/CDC.2016.7798661
Cao, Y., Yu, W., Ren, W., Chen, G.: An overview of recent progress in the study of distributed multi-agent coordination. IEEE Trans. Industr. Inf. 9(1), 427–438 (2013). https://doi.org/10.1109/TII.2012.2219061
Chen, X., Yum, T.P.: Patrol districting and routing with security level functions. In: 2010 IEEE International Conference on Systems, Man and Cybernetics, pp. 3555–3562, October 2010. https://doi.org/10.1109/ICSMC.2010.5642353
Chevaleyre, Y.: Theoretical analysis of the multi-agent patrolling problem. In: Proceedings of Intelligent Agent Technology, pp. 302–308 (2005)
Portugal, D., Rocha, R.: A survey on multi-robot patrolling algorithms. In: Camarinha-Matos, L.M. (ed.) DoCEIS 2011. IAICT, vol. 349, pp. 139–146. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-19170-1_15
Hasegawa, E., Ishii, Y., Tada, K., Kobayashi, K., Yoshimura, J.: Lazy workers are necessary for long-term sustainability in insect societies. Sci. Rep. 6, 20846 (2016)
Jensen, E., Franklin, M., Lahr, S., Gini, M.: Sustainable multi-robot patrol of an open polyline. In: 2011 IEEE International Conference on Robotics and Automation, pp. 4792–4797, May 2011. https://doi.org/10.1109/ICRA.2011.5980279
Machado, A., Ramalho, G., Zucker, J.-D., Drogoul, A.: Multi-agent patrolling: an empirical analysis of alternative architectures. In: Simão Sichman, J., Bousquet, F., Davidsson, P. (eds.) MABS 2002. LNCS (LNAI), vol. 2581, pp. 155–170. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-36483-8_11
Mersheeva, V., Friedrich, G.: Multi-UAV monitoring with priorities and limited energy resources. In: International Conference on Automated Planning and Scheduling (2015)
Pasqualetti, F., Durham, J.W., Bullo, F.: Cooperative patrolling via weighted tours: performance analysis and distributed algorithms. IEEE Trans. Rob. 28(5), 1181–1188 (2012). https://doi.org/10.1109/TRO.2012.2201293
Popescu, M.I., Rivano, H., Simonin, O.: Multi-robot patrolling in wireless sensor networks using bounded cycle coverage. In: 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 169–176, November 2016. https://doi.org/10.1109/ICTAI.2016.0035
Santana, H., Ramalho, G., Corruble, V., Ratitch, B.: Multi-agent patrolling with reinforcement learning. In: Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3, pp. 1122–1129 AAMAS 2004. IEEE Computer Society, Washington, DC, USA (2004). https://doi.org/10.1109/AAMAS.2004.180
Sipahioglu, A., Kirlik, G., Parlaktuna, O., Yazici, A.: Energy constrained multi-robot sensor-based coverage path planning using capacitated arc routing approach. Robot. Auton. Syst. 58(5), 529–538 (2010). https://doi.org/10.1016/j.robot.2010.01.005
Stump, E., Michael, N.: Multi-robot persistent surveillance planning as a vehicle routing problem. In: 2011 IEEE International Conference on Automation Science and Engineering, pp. 569–575 (2011). https://doi.org/10.1109/CASE.2011.6042503
Sugiyama, A., Sea, V., Sugawara, T.: Effective task allocation by enhancing divisional cooperation in multi-agent continuous patrolling tasks. In: 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 33–40, November 2016. https://doi.org/10.1109/ICTAI.2016.0016
Sugiyama, A., Sugawara, T.: Improvement of robustness to environmental changes by autonomous divisional cooperation in multi-agent cooperative patrol problem. In: Demazeau, Y., Davidsson, P., Bajo, J., Vale, Z. (eds.) PAAMS 2017. LNCS (LNAI), vol. 10349, pp. 259–271. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59930-4_21
Sugiyama, A., Wu, L., Sugawara, T.: Learning of activity cycle length based on battery limitation in multi-agent continuous cooperative patrol problems. In: Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, pp. 62–71. INSTICC, SciTePress (2019). https://doi.org/10.5220/0007567400620071
Wooldridge, M.: An Introduction to MultiAgent Systems, 2nd edn. Wiley, Hoboken (2009)
Yoneda, K., Kato, C., Sugawara, T.: Autonomous learning of target decision strategies without communications for continuous coordinated cleaning tasks. In: 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT), vol. 2, pp. 216–223, November 2013. https://doi.org/10.1109/WI-IAT.2013.112
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Sugiyama, A., Wu, L., Sugawara, T. (2019). Improvement of Multi-agent Continuous Cooperative Patrolling with Learning of Activity Length. In: van den Herik, J., Rocha, A., Steels, L. (eds) Agents and Artificial Intelligence. ICAART 2019. Lecture Notes in Computer Science(), vol 11978. Springer, Cham. https://doi.org/10.1007/978-3-030-37494-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-37494-5_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37493-8
Online ISBN: 978-3-030-37494-5
eBook Packages: Computer ScienceComputer Science (R0)