Abstract
There are many real scenarios in which some correlated complex problems have to be addressed by different autonomous learners working in parallel. In such a scenario, the collaboration among the learners can be extremely useful since they can share acquired knowledge so as to reach a reduction in the learning time, an increase in the learning quality, or both of them. Anyway, in some cases, it is not always feasible to collaborate with other learners. This is because the problems to solve are not compatible or they can have dissimilar boundary conditions leading to very different problem solutions. In this paper, we propose an approach to collaborative learning which leverages cellular automata for efficiently solving a set of compatible and sufficiently similar problems. In this direction, the notion of compatibility and similarity between problems is also given and discussed. A case study based on the maze problem will show the effectiveness of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aledhari, M., Razzak, R., Parizi, R.M., Saeed, F.: Federated learning: a survey on enabling technologies, protocols, and applications. IEEE Access 8, 140699–140725 (2020)
Beigy, H., Meybodi, M.: A mathematical framework for cellular learning automata. Adv. Complex Syst. 7(3–4), 295–319 (2004). https://doi.org/10.1142/S0219525904000202
Burke, E., Gustafson, S., Kendall, G.: A puzzle to challenge genetic programming. In: Foster, J.A., Lutton, E., Miller, J., Ryan, C., Tettamanzi, A. (eds.) EuroGP 2002. LNCS, vol. 2278, pp. 238–247. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45984-7_23
Cicirelli, F., Guerrieri, A., Spezzano, G., Vinci, A.: IoT Edge Solutions for Cognitive Buildings. Internet of Things, Springer, Heidelberg (2022). https://doi.org/10.1007/978-3-031-15160-6
Cicirelli, F., Gentile, A.F., Greco, E., Guerrieri, A., Spezzano, G., Vinci, A.: An energy management system at the edge based on reinforcement learning. In: 2020 IEEE/ACM 24th International Symposium on Distributed Simulation and Real Time Applications (DS-RT), pp. 1–8. IEEE (2020)
Cicirelli, F., Guerrieri, A., Mastroianni, C., Scarcello, L., Spezzano, G., Vinci, A.: Balancing energy consumption and thermal comfort with deep reinforcement learning. In: IEEE 2nd International Conference on Human-Machine Systems (2021)
Greco, E., Spezzano, G.: Human-centered Reinforcement Learning for Lighting and Blind Control in Cognitive Buildings. In: Cicirelli, F., Guerrieri, A., Spezzano, G., Vinci, A. (eds.) IoT Edge Solutions for Cognitive Buildings. Internet of Things, pp. 285–303. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-15160-6_13. Chap 13
Iba, H.: Evolutionary learning of communicating agents. Inf. Sci. 108(1–4), 181–205 (1998)
Khan, I., Guerrieri, A., Spezzano, G., Vinci, A.: Occupancy prediction in buildings: an approach leveraging LSTM and Federated Learning. In: The IEEE 2022 DASC/PiCom/CBDCom/CyberSciTech. IEEE (2022)
Li, L., Fan, Y., Tse, M., Lin, K.Y.: A review of applications in federated learning. Comput. Industr. Eng. 149, 106854 (2020)
Li, T., Sahu, A.K., Talwalkar, A., Smith, V.: Federated learning: challenges, methods, and future directions. IEEE Signal Process. Mag. 37(3), 50–60 (2020)
McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial Intelligence and Statistics, pp. 1273–1282. PMLR (2017)
Miconi, T.: A collective genetic algorithm. In: Proceedings of the 3rd Annual Conference on Genetic and Evolutionary Computation, pp. 876–883 (2001)
Miconi, T.: When evolving populations is better than coevolving individuals: the blind mice problem. In: IJCAI, pp. 647–652. Citeseer (2003)
Mozafari, M., Shiri, M.E., Beigy, H.: A cooperative learning method based on cellular learning automata and its application in optimization problems. J. Comput. Sci. 11, 279–288 (2015). https://doi.org/10.1016/j.jocs.2015.08.002
Narendra, K.S., Thathachar, M.: Learning automata-a survey. IEEE Trans. Syst. Man Cybern. SMC-4(4), 323–334 (1974). https://doi.org/10.1109/TSMC.1974.5408453
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2009)
Panait, L., Luke, S.: Collaborative multi-agent learning: a survey. Department of Computer Science, George Mason University, Technical report (2003)
Panait, L., Luke, S.: Cooperative multi-agent learning: the state of the art. Auton. Agent. Multi-Agent Syst. 11(3), 387–434 (2005)
Sarker, I.H.: Machine learning: algorithms, real-world applications and research directions. SN Comput. Sci. 2(3), 1–21 (2021)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (2011)
Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3), 279–292 (1992)
Welagedara, L., Harischandra, J., Jayawardene, N.: Edge intelligence based collaborative learning system for IoT edge. In: 2021 IEEE 12th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), pp. 0667–0672 (2021). https://doi.org/10.1109/IEMCON53756.2021.9623215
Acknowledgment
This work has been partially supported by the COGITO (A COGnItive dynamic sysTem to allOw buildings to learn and adapt) project, funded by the Italian Government (PON ARS01 00836) and by the CNR project “Industrial transition and resilience of post-Covid19 Societies - Sub-project: Energy Efficient Cognitive Buildings (TIRS-EECB)”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Cicirelli, F., Greco, E., Guerrieri, A., Spezzano, G., Vinci, A. (2023). Collaborative Learning over Cellular Automata. In: De Stefano, C., Fontanella, F., Vanneschi, L. (eds) Artificial Life and Evolutionary Computation. WIVACE 2022. Communications in Computer and Information Science, vol 1780. Springer, Cham. https://doi.org/10.1007/978-3-031-31183-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-31183-3_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-31182-6
Online ISBN: 978-3-031-31183-3
eBook Packages: Computer ScienceComputer Science (R0)