Skip to main content

Ethical Behaviour Aspects of Autonomous Intelligent Cyber-Physical Systems

  • Conference paper
  • First Online:
Service Oriented, Holonic and Multi-agent Manufacturing Systems for Industry of the Future (SOHOMA 2019)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 853))

Abstract

Industry 4.0 fosters the development of more autonomous and intelligent cyber-physical systems that interact with humans in open environments. While the technical aspects are heavily researched, the same does not hold for the accompanying ethical issues that are relevant for the design, development, operation, and maintenance of such systems. In engineering teams and industrialists at large, ethical behavior aspects of autonomous intelligent cyber-physical systems are often seen as an add-on and are rarely appropriately considered during system engineering. The aim of this work is firstly to understand the reluctance of researchers and industrialists and secondly, to justify the need to address ethical considerations in all lifecycle phases of autonomous intelligent cyber-physical systems. A case study in train transportation exemplifies some of the issues discussed, and clearly shows that the development of autonomous intelligent cyber-physical systems without addressing their ethical behavior is incomplete.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. ACATECH: Cyber-physical systems: driving force for innovation in mobility, health, energy and production. Technical report (2011). https://goo.gl/Q6WFQN

  2. Allen, C., Wallach, W., Smit, I.: Why machine ethics? IEEE Intell. Syst. 21(4), 12–17 (2006). https://doi.org/10.1109/mis.2006.83

    Article  Google Scholar 

  3. Anderson, S.L.: Asimov’s “three laws of robotics” and machine metaethics. AI Soc. 22(4), 477–493 (2007). https://doi.org/10.1007/s00146-007-0094-5

    Article  Google Scholar 

  4. Asimov, I.: I, Robot. Bantam Books, New York (1950)

    Google Scholar 

  5. Beyerer, J., Kühnert, C., Niggemann, O. (eds.): Machine Learning for Cyber Physical Systems. Springer, Berlin (2019). https://doi.org/10.1007/978-3-662-58485-9

    Google Scholar 

  6. Biffl, S., Lüder, A., Gerhard, D. (eds.): Multi-Disciplinary Engineering for Cyber-Physical Production Systems. Springer, Berlin (2017). https://doi.org/10.1007/978-3-319-56345-9

    Google Scholar 

  7. Cardin, O.: Classification of cyber-physical production systems applications: proposition of an analysis framework. Comput. Ind. 104, 11–21 (2019). https://doi.org/10.1016/j.compind.2018.10.002

    Article  Google Scholar 

  8. Cardin, O., Derigent, W., Trentesaux, D.: Evolution of holonic control architectures towards industry 4.0: a short overview. IFAC-PapersOnLine 51(11), 1243–1248 (2018). https://doi.org/10.1016/j.ifacol.2018.08.420

    Article  Google Scholar 

  9. Cintuglu, M.H., Mohammed, O.A., Akkaya, K., Uluagac, A.S.: A survey on smart grid cyber-physical system testbeds. IEEE Commun. Surv. Tutorials 19(1), 446–464 (2017). https://doi.org/10.1109/comst.2016.2627399

    Article  Google Scholar 

  10. Colombo, A.W., Karnouskos, S., Bangemann, T.: A system of systems view on collaborative industrial automation. In: 2013 IEEE International Conference on Industrial Technology (ICIT). IEEE (2013). https://doi.org/10.1109/icit.2013.6505980

  11. Colombo, A.W., Karnouskos, S., Kaynak, O., Shi, Y., Yin, S.: Industrial cyberphysical systems: a backbone of the fourth industrial revolution. IEEE Ind. Electron. Mag. 11(1), 6–16 (2017). https://doi.org/10.1109/mie.2017.2648857

    Article  Google Scholar 

  12. Eisenführ, F., Weber, M., Langer, T.: Rational Decision Making. Springer, Berlin (2010)

    Book  Google Scholar 

  13. Ess, C.: Digital Media Ethics, 2. Digital Media and Society, 2nd edn. Polity Press, Cambridge (2014)

    Google Scholar 

  14. Goodall, N.J.: Can you program ethics into a self-driving car? IEEE Spectr. 53(6), 28–58 (2016). https://doi.org/10.1109/MSPEC.2016.7473149

    Article  Google Scholar 

  15. Hooker, B.: Consequentialism. In: The Routledge Companion to Ethics. Routledge (2010). https://doi.org/10.4324/9780203850701.ch37

  16. Karnouskos, S.: Cyber-physical systems in the smartgrid. In: IEEE 9th International Conference on Industrial Informatics (INDIN), Lisbon, Portugal (2011). https://doi.org/10.1109/indin.2011.6034829

  17. Karnouskos, S.: Self-driving car acceptance and the role of ethics. IEEE Trans. Eng. Manag. 1–14 (2018). https://doi.org/10.1109/tem.2018.2877307

  18. Lei, T., Barzilay, R., Jaakkola, T.: Rationalizing neural predictions. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (2016). https://doi.org/10.18653/v1/d16-1011

  19. Leitao, P., Karnouskos, S., Ribeiro, L., Lee, J., Strasser, T., Colombo, A.W.: Smart agents in industrial cyber–physical systems. Proc. IEEE 104(5), 1086–1101 (2016). https://doi.org/10.1109/jproc.2016.2521931

    Article  Google Scholar 

  20. Leitão, P., Karnouskos, S. (eds.): Industrial Agents: Emerging Applications of Software Agents in Industry. Elsevier (2015)

    Google Scholar 

  21. Monostori, L.: Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17, 9–13 (2014). https://doi.org/10.1016/j.procir.2014.03.115

    Article  Google Scholar 

  22. Morahan, M.: Ethics in management. IEEE Eng. Manage. Rev. 43(4), 23–25 (2015). https://doi.org/10.1109/emr.2015.7433683

    Article  Google Scholar 

  23. Murphy, R., Woods, D.D.: Beyond asimov: the three laws of responsible robotics. IEEE Intell. Syst. 24(4), 14–20 (2009). https://doi.org/10.1109/MIS.2009.69

    Article  Google Scholar 

  24. Orseau, L., Armstrong, S.: Safely interruptible agents. In: Proceedings of the Thirty-Second Conference on Uncertainty in Artificial Intelligence, UAI 2016, pp. 557–566. AUAI Press, Arlington (2016)

    Google Scholar 

  25. Pacaux-Lemoine, M.P., Berdal, Q., Enjalbert, S., Trentesaux, D.: Towards human-based industrial cyber-physical systems. In: 2018 IEEE Industrial Cyber-Physical Systems (ICPS), pp. 615–620 (2018). https://doi.org/10.1109/ICPHYS.2018.8390776

  26. Pacaux-Lemoine, M.P., Trentesaux, D.: Ethical risks of human-machine symbiosis in industry 4.0: insights from the human-machine cooperation approach. In: 14th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Human-Machine Systems (IFAC HMS) (2019)

    Google Scholar 

  27. Rault, R., Trentesaux, D.: Artificial intelligence, autonomous systems and robotics: legal innovations. In: Service Orientation in Holonic and Multi-Agent Manufacturing: Proceedings of SOHOMA 2017. Studies in Computational Intelligence, vol. 762, pp. 1–9. Springer, Cham (2018)

    Google Scholar 

  28. Skorupski, J.: The Routledge Companion to Ethics. Routledge (2010). https://doi.org/10.4324/9780203850701

    Book  Google Scholar 

  29. The IEEE global initiative on ethics of autonomous and intelligent systems: ethically aligned design: a vision for prioritizing human well-being with autonomous and intelligent systems. Technical report (2017). https://standards.ieee.org/content/dam/ieee-standards/standards/web/documents/other/ead_v2.pdf

  30. Trappey, A.J.C., Trappey, C.V., Govindarajan, U.H., Sun, J.J., Chuang, A.C.: A review of technology standards and patent portfolios for enabling cyber-physical systems in advanced manufacturing. IEEE Access 4, 7356–7382 (2016). https://doi.org/10.1109/access.2016.2619360

    Article  Google Scholar 

  31. Trentesaux, D., Dahyot, R., Ouedraogo, A., Arenas, D., Lefebvre, S., Schön, W., Lussier, B., Cheritel, H.: The autonomous train. In: 2018 13th Annual Conference on System of Systems Engineering (SoSE). IEEE (2018). https://doi.org/10.1109/sysose.2018.8428771

  32. Trentesaux, D., Millot, P.: A human-centred design to break the myth of the “magic human” in intelligent manufacturing systems. In: Service Orientation in Holonic and Multi-Agent Manufacturing. Studies in Computational Intelligence, vol. 640, pp. 103–113. Springer (2016)

    Google Scholar 

  33. Trentesaux, D., Rault, R.: Designing ethical cyber-physical industrial systems. IFAC-PapersOnLine 50(1), 14934–14939 (2017). https://doi.org/10.1016/j.ifacol.2017.08.2543

    Article  Google Scholar 

  34. Tsiatsis, V., Karnouskos, S., Höller, J., Boyle, D., Mulligan, C.: Internet of Things: Technologies and Applications for a New Age of Intelligence. Academic Press, Elsevier (2018)

    Google Scholar 

  35. WEC: Industrial internet of things: unleashing the potential of connected products and services. Technical report (2015). http://www3.weforum.org/docs/WEFUSA_IndustrialInternet_Report2015.pdf

  36. Winter-Levy, S., Trefethen, J.: Safety first. World Policy J. 33(1), 105–111 (2016). https://doi.org/10.1215/07402775-3545918

    Article  Google Scholar 

  37. Xu, L.D., Xu, E.L., Li, L.: Industry 4.0: state of the art and future trends. Int. J. Prod. Res. 56(8), 2941–2962 (2018). https://doi.org/10.1080/00207543.2018.1444806

    Article  Google Scholar 

Download references

Acknowledgement

Surferlab is a joint research lab with Bombardier and Prosyst, which is partially funded by the European Regional Development Fund (ERDF). The authors wish to thank the European Union and the Nord–Pas-de-Calais in France for their support. This research work is also done in the context of the project EFIA “Ètude de faisabilité de l’intelligence artificielle pour le train autonome” (feasibility study on artificial intelligence for the autonomous train) and “train fret autonome” (autonomous freight train), both funded by the SNCF in collaboration with IRT Railenium research institute. The authors would like to thank the SNCF for its support. Parts of the work presented in this paper are carried out in the context of the HUMANISM No ANR-17-CE10-0009 research program, funded by the French ANR “Agence Nationale de la Recherche”. This paper contains elements discussed during workshops led within the context of the project “Droit des robots et autres avatars de l’humain” (robots and other human avatar rights) of the IDEX “Université et Cité” of Strasbourg University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Damien Trentesaux .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Trentesaux, D., Karnouskos, S. (2020). Ethical Behaviour Aspects of Autonomous Intelligent Cyber-Physical Systems. In: Borangiu, T., Trentesaux, D., Leitão, P., Giret Boggino, A., Botti, V. (eds) Service Oriented, Holonic and Multi-agent Manufacturing Systems for Industry of the Future. SOHOMA 2019. Studies in Computational Intelligence, vol 853. Springer, Cham. https://doi.org/10.1007/978-3-030-27477-1_5

Download citation

Publish with us

Policies and ethics