Abstract
Today humanity is in the midst of the massive expansion of new and fundamental technology, represented by advanced artificial intelligence (AI) systems. The ongoing revolution of these technologies and their profound impact across various sectors, has triggered discussions about the characteristics and values that should guide their use and development in a responsible manner. In this paper, we conduct a systematic literature review with the aim of pointing out existing challenges and required principles in AI-based systems in different industries. We discuss our findings and provide general recommendations to be considered during AI deployment in production. The results have shown many gaps and concerns towards responsible AI and integration of complex AI models in the industry that the research community could address.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aitken, M., Toreini, E., Carmichael, P., Coopamootoo, K., Elliott, K., & van Moorsel, A. (2020). Establishing a social licence for financial technology: Reflections on the role of the private sector in pursuing ethical data practices. Big Data & Society. https://doi.org/10.1177/2053951720908892
Ashrafian, H. (2014). AIonAI: A humanitarian law of artificial intelligence and robotics. Science and Engineering Ethics, 21(1), 29–40. https://doi.org/10.1007/S11948-013-9513-9
Ashrafian, H. (2014). Artificial intelligence and robot responsibilities: Innovating beyond rights. Science and Engineering Ethics, 21(2), 317–326. https://doi.org/10.1007/S11948-014-9541-0
Balmer, R. E., Levin, S. L., & Schmidt, S. (2020). Artificial intelligence applications in telecommunications and other network industries. Telecommunications Policy, 44(6), 101977. https://doi.org/10.1016/J.TELPOL.2020.101977
Banks, J. (2018). The human touch: Practical and ethical implications of putting AI and robotics to work for patients. IEEE Pulse, 9(3), 15–18. https://doi.org/10.1109/MPUL.2018.2814238
Bartoletti, I. (2019). AI in Healthcare: Ethical and privacy challenges. Lecture notes in computer science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11526 LNAI, 7–10. https://doi.org/10.1007/978-3-030-21642-9_2
Bauer, L., Bloom, C., Tan, J., & Ramjohn, J. (2017). Self-driving cars and data collection: Privacy perceptions of networked autonomous vehicles. Thirteenth Symposium on Usable Privacy and Security ($\{$SOUPS$\}$ 2017), 357–375.
Bendel, O. (2017). LADYBIRD: The animal-friendly robot vacuum cleaner. 2017 AAAI Spring Symposium Series. Retrieved September 21, 2021, from https://www.aaai.org/ocs/index.php/SSS/SSS17/paper/view/15277
Bjørgen, E. P., Madsen, S., Bjørknes, T. S., Heimsaeter, F. V, Håvik, R., Linderud, M., Longberg, P.-N., Dennis, L. A., & Slavkovik, M. (2018). Cake, Death, and Trolleys * Dilemmas as benchmarks of ethical decision-making. Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3278721
Bogosian, K. (2017). Implementation of moral uncertainty in intelligent machines. Minds and Machines, 27(4), 591–608. https://doi.org/10.1007/S11023-017-9448-Z
Braun, A., & Garriga, G. (2018). Consumer journey analytics in the context of data privacy and ethics. Digital Marketplaces Unleashed. https://doi.org/10.1007/978-3-662-49275-8_59
Breidbach, C. F., & Maglio, P. (2020). Accountable algorithms? The ethical implications of data-driven business models. Journal of Service Management, 31(2), 163–185. https://doi.org/10.1108/JOSM-03-2019-0073
Campbell, C., Sands, S., Ferraro, C., Tsao, H. Y., & Mavrommatis, A. (2020). From data to action: How marketers can leverage AI. Business Horizons, 63(2), 227–243. https://doi.org/10.1016/J.BUSHOR.2019.12.002
Caner, S., & Bhatti, F. (2020). A conceptual framework on defining businesses strategy for artificial intelligence. Contemporary Management Research, 16(3), 175–206. https://doi.org/10.7903/CMR.19970
Carter, D. (2019). New technologies and new data sources: The business information survey 2019. Business Information Review, 36(3), 95–105. https://doi.org/10.1177/0266382119871848
Cath, C., Wachter, S., Mittelstadt, B., Taddeo, M., & Floridi, L. (2017). Artificial intelligence and the ‘good society’: the US, EU, and UK approach. Science and Engineering Ethics, 24(2), 505–528. https://doi.org/10.1007/S11948-017-9901-7
Cervantes, J.-A., Rodríguez, L.-F., López, S., Ramos, F., & Robles, F. (2015). Autonomous agents and ethical decision-making. Cognitive Computation, 8(2), 278–296. https://doi.org/10.1007/S12559-015-9362-8
Chakraborty, A., Bagavathi, R., & Tomer, U. (2020). A comprehensive decomposition towards the facets of quality in IoT. Proceedings—International Conference on Smart Electronics and Communication, ICOSEC, 2020, 759–764. https://doi.org/10.1109/ICOSEC49089.2020.9215428
Cheng, A. S. K., Ng, P. H. F., Sin, Z. P. T., Lai, S. H. S., & Law, S. W. (2020). Smart work injury management (SWIM) system: Artificial intelligence in work disability management. Journal of Occupational Rehabilitation, 30(3), 354–361. https://doi.org/10.1007/S10926-020-09886-Y
Cysneiros, L. M., & do Prado Leite, J. C. S. (2020). Non-functional requirements orienting the development of socially responsible software. Lecture Notes in Business Information Processing, 387 LNBIP, 335–342. https://doi.org/10.1007/978-3-030-49418-6_23
Dahiyat, E. A. R. (2010). Intelligent agents and liability: is it a doctrinal problem or merely a problem of explanation? Artificial Intelligence and Law, 18(1), 103–121. https://doi.org/10.1007/S10506-010-9086-8
David, W., Pappalepore, P., Stefanova, A., & Sarbu, B. A. (2019). AI-powered lethal autonomous weapon systems in defence transformation. Impact and challenges. Lecture notes in computer science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11995 LNCS, 337–350. https://doi.org/10.1007/978-3-030-43890-6_27
Dignum, V. (2019). Responsible artificial intelligence: How to develop and use AI in a responsible way. Springer Nature.
DodigCrnkovic, G., & Çürüklü, B. (2011). Robots: ethical by design. Ethics and Information Technology, 14(1), 61–71. https://doi.org/10.1007/S10676-011-9278-2
Erdélyi, O. J., & Erdélyi, G. (2020). The AI liability puzzle and a fund-based work-around. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3375627
Etzioni, A., & Etzioni, O. (2017). Incorporating ethics into artificial intelligence. The Journal of Ethics, 21(4), 403–418. https://doi.org/10.1007/S10892-017-9252-2
Faulhaber, A. K., Dittmer, A., Blind, F., Wächter, M. A., Timm, S., Sütfeld, L. R., Stephan, A., Pipa, G., & König, P. (2018). Human decisions in moral dilemmas are largely described by utilitarianism: Virtual car driving study provides guidelines for autonomous driving vehicles. Science and Engineering Ethics, 25(2), 399–418. https://doi.org/10.1007/S11948-018-0020-X
Floridi, L. (2013). The ethics of information. Oxford University Press.
Floridi, L., & Cowls, J. (2019). A unified framework of five principles for AI in society. SSRN Electronic Journal. https://doi.org/10.2139/SSRN.3831321
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., Schafer, B., Valcke, P., & Vayena, E. (2018). AI4people—an ethical framework for a good AI society: Opportunities, risks, principles, and recommendations. Minds and Machines, 28(4), 689–707. https://doi.org/10.1007/s11023-018-9482-5
Ghandour, A., & Woodford, B. J. (2019). Ethical issues in artificial intelligence in UAE. Proceedings—2019 International Arab Conference on Information Technology, ACIT 2019, 262–266. https://doi.org/10.1109/ACIT47987.2019.8990997
Gill, A. S. (2019). Artificial intelligence and international security: The long view. Ethics & International Affairs, 33(2), 169–179. https://doi.org/10.1017/S0892679419000145
Google AI. (2021). Responsible AI practices. Google AI. Retrieved September 21, 2021, from https://ai.google/responsibilities/responsible-ai-practices/
Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H.-C., & Jeste, D. V. (2019). Artificial intelligence for mental health and mental illnesses: An overview. Current Psychiatry Reports, 21(11), 1–18. https://doi.org/10.1007/S11920-019-1094-0
Hauer, T. (2019). Society caught in a labyrinth: of algorithms: Disputes, promises, and limitations of the new order of things. Society, 56(3), 222–230. https://doi.org/10.1007/S12115-019-00358-5
Healey, J. (2020). Principled artificial intelligence: Mapping consensus in ethical and rightsbased approaches to principles for AI. Artificial Intelligence and Financial Services. https://doi.org/10.1007/978-3-030-29761-9_6
AI HLEG. (2019). Ethics guidelines for trustworthy AI. In: European Commission. Retrieved September 21, 2021, from https://digital-strategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai
Hoeschl, M. B., Bueno, T. C. D., & Hoeschl, H. C. (2018). Fourth industrial revolution and the future of engineering: Could robots replace human jobs? How ethical recommendations can help engineers rule on artificial intelligence. Proceedings—2017 7th World Engineering Education Forum, 21–26. https://doi.org/10.1109/WEEF.2017.8466973
Howard, A., & Borenstein, J. (2017). The ugly truth about ourselves and our robot creations: The problem of bias and social inequity. Science and Engineering Ethics, 24(5), 1521–1536. https://doi.org/10.1007/S11948-017-9975-2
Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389–399. https://doi.org/10.1038/s42256-019-0088-2
Juho, V. (2019). Ethics of AI technologies and organizational roles: Who is accountable for the ethical conduct? Conference on Technology Ethics.
Kang, J., Thompson, R. F., Aneja, S., Lehman, C., Trister, A., Zou, J., Obcemea, C., & El Naqa, I. (2021). National cancer institute workshop on artificial intelligence in radiation oncology: Training the next generation. Practical Radiation Oncology, 11(1), 74–83. https://doi.org/10.1016/J.PRRO.2020.06.001
Kitchenham, B., & Charters, S. M. (2007). Guidelines for performing Systematic Literature Reviews in Software Engineering. EBSE. Retrieved September 21, 2021, fromhttps://www.elsevier.com/data/promis_misc/525444systematicreviewsguide.pdf
Kleindienst, D., Nüske, N., Rau, D., & Schmied, F. (2017). Beyond mere compliance—delighting customers by implementing data privacy measures? Wirtschaftsinformatik 2017 Proceedings. Reterived 23 January 2017, from https://aisel.aisnet.org/wi2017/track08/paper/2
Kuleshov, A., Ignatiev, A., Abramova, A., & Marshalko, G. (2020). Addressing AI ethics through codification. Proceedings—2020 International Conference Engineering Technologies and Computer Science, EnT 2020, 24–30. https://doi.org/10.1109/ENT48576.2020.00011
De Las Morenas, J., Da Silva, C. M., Funchal, G. S., Melo, V., Vallim, M., & Leitao, P. (2020). Security experiences in IoT based applications for building and factory automation. Proceedings of the IEEE International Conference on Industrial Technology, 2020-February, 322–327. https://doi.org/10.1109/ICIT45562.2020.9067229
Loftus, T. J., Filiberto, A. C., Balch, J., Ayzengart, A. L., Tighe, P. J., Rashidi, P., Bihorac, A., & Upchurch, G. R. (2020). Intelligent, autonomous machines in surgery. Journal of Surgical Research, 253, 92–99. https://doi.org/10.1016/J.JSS.2020.03.046
Lugano, G. (2017, July 7). Virtual assistants and self-driving cars. Proceedings of 2017 15th International Conference on ITS Telecommunications, ITST 2017. https://doi.org/10.1109/ITST.2017.7972192
Luo, S. (2019). Research on the change of educational management in the era of artificial intelligence. Proceedings—2019 12th International Conference on Intelligent Computation Technology and Automation, ICICTA 2019, 442–445. https://doi.org/10.1109/ICICTA49267.2019.00101
Marri, A. Al, Albloosh, F., Moussa, S., & Elmessiry, H. (2019). Study on the impact of artificial intelligence on government E-service in Dubai. Proceeding of 2019 International Conference on Digitization: Landscaping Artificial Intelligence, ICD 2019, 153–159. https://doi.org/10.1109/ICD47981.2019.9105866
Martin, D. (2016). Who should decide how machines make morally laden decisions? Science and Engineering Ethics 2016 23:4, 23(4), 951–967. https://doi.org/10.1007/S11948-016-9833-7
Mason, R. O. (1986). Four ethical issues of the information age. MIS Quarterly: Management Information Systems, 10(1), 5–12. https://doi.org/10.2307/248873
Maxmen, A. (2018). A moral map for AI cars. Nature, 562(7728), 469–470.
McAleenan, P. (2020). Moral responsibility and action in the use of artificial intelligence in construction. Proceedings of the Institution of Civil Engineers - Management, Procurement and Law. 173(4): 166–174. https://doi.org/10.1680/JMAPL.19.00056
McBride, N. (2016). The ethics of driverless cars. ACM SIGCAS Computers and Society, 45(3), 179–184. https://doi.org/10.1145/2874239.2874265
Mendling, J., Decker, G., Hull, R., Reijers, H., & Weber, I. (2018). How do machine learning, robotic process automation, and blockchains affect the human factor in business process management? Communications of the Association for Information Systems, 43(1), 19. https://doi.org/10.17705/1CAIS.04319
Microsoft AI. (2021). Responsible AI principles. Microsoft AI. https://www.microsoft.com/en-us/ai/responsible-ai?activetab=pivot1%3Aprimaryr6
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data and Society. https://doi.org/10.1177/2053951716679679
Montes, G. A., & Goertzel, B. (2019). Distributed, decentralized, and democratized artificial intelligence. Technological Forecasting and Social Change, 141, 354–358. https://doi.org/10.1016/J.TECHFORE.2018.11.010
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020). From what to how: An initial review of publicly available AI ethics tools, methods and research to translate principles into practices. Science and Engineering Ethics, 26(4), 2141–2168. https://doi.org/10.1007/s11948-019-00165-5
MSCI. (2020). Global industry classification standard. MSCI Inc. Retrieved September 21, 2021, from https://www.msci.com/documents/1296102/11185224/GICS+Methodology+2020.pdf/9caadd09-790d-3d60-455b-2a1ed5d1e48c?t=1578405935658
Munoko, I., Brown-Liburd, H. L., & Vasarhelyi, M. (2020). The ethical implications of using artificial intelligence in auditing. Journal of Business Ethics, 167(2), 209–234. https://doi.org/10.1007/S10551-019-04407-1
Pagallo, U. (2012). On the principle of privacy by design and its limits: Technology, ethics and the rule of law. European Data Protection In Good Health. https://doi.org/10.1007/978-94-007-2903-2_16
Pedersen, T., & Johansen, C. (2019). Behavioural artificial intelligence: An agenda for systematic empirical studies of artificial inference. AI & SOCIETY, 35(3), 519–532. https://doi.org/10.1007/S00146-019-00928-5
Pitman, H., Colling, R., Oien, K., Rajpoot, N., Macklin, P., Snead, D., Sackville, T., & Verrill, C. (2019). Artificial intelligence in digital pathology: A roadmap to routine use in clinical practice. The Journal of Pathology, 249(2), 143–150. https://doi.org/10.1002/PATH.5310
PwC. (2019). A practical guide to responsible artificial intelligence. https://www.pwc.com/gx/en/issues/data-and-analytics/artificial-intelligence/what-is-responsible-ai/responsible-ai-practical-guide.pdf
Rahwan, I. (2017). Society-in-the-loop: Programming the algorithmic social contract. Ethics and Information Technology, 20(1), 5–14. https://doi.org/10.1007/S10676-017-9430-8
Rességuier, A., & Rodrigues, R. (2020). AI ethics should not remain toothless! A Call to Bring Back the Teeth of Ethics. https://doi.org/10.1177/2053951720942541
Riedl, M. O., & Zook, A. (2013). AI for game production. IEEE Conference on Computatonal Intelligence and Games, CIG. https://doi.org/10.1109/CIG.2013.6633663
Roberts, H., Cowls, J., Morley, J., Taddeo, M., Wang, V., & Floridi, L. (2020). The Chinese approach to artificial intelligence: an analysis of policy, ethics, and regulation. AI & SOCIETY, 36(1), 59–77. https://doi.org/10.1007/S00146-020-00992-2
Russell, S., & Norvig, P. (2002). Artificial intelligence: A modern approach. Prentice Hall.
Ryan, M., & Stahl, B. C. (2021). Artificial intelligence ethics guidelines for developers and users: Clarifying their content and normative implications. Journal of Information, Communication and Ethics in Society, 19(1), 61–86. https://doi.org/10.1108/JICES-12-2019-0138
Ten Teije, A., Popow, C., Holmes, J. H., & Sacchi, L. (2017). Artificial Intelligence in Medicine: 16th Conference on Artificial Intelligence in Medicine, AIME 2017, Vienna, Austria, June 21–24, 2017, Proceedings (Vol. 10259). Springer.
Timmers, P. (2019). Ethics of AI and cybersecurity when sovereignty is at stake. Minds and Machines, 29(4), 635–645. https://doi.org/10.1007/S11023-019-09508-4
Tonkens, R. (2009). A challenge for machine ethics. Minds and Machines, 19(3), 421–438. https://doi.org/10.1007/S11023-009-9159-1
Turner, J. (2018). Robot rules: Regulating artificial intelligence. Springer International Publishing. https://doi.org/10.1007/978-3-319-96235-1
Vaio, A. . Di., Boccia, F., Landriani, L., & Palladino, R. (2020). Artificial intelligence in the agri-food system: Rethinking sustainable business models in the COVID-19 scenario. Sustainability, 12(12), 4851. https://doi.org/10.3390/SU12124851
Vakkuri, V., Kemell, K. K., & Abrahamsson, P. (2019b). Ethically aligned design: An empirical evaluation of the resolved-strategy in software and systems development context. Proceedings—45th Euromicro Conference on Software Engineering and Advanced Applications, SEAA 2019, 46–50. https://doi.org/10.1109/SEAA.2019.00015
Vakkuri, V., Kemell, K.-K., & Abrahamsson, P. (2019). AI ethics in industry: a research framework. ArXiv Preprint.https://arXiv.org.1910.12695
Vakkuri, V., Kemell, K. K., Kultanen, J., & Abrahamsson, P. (2020). The current state of industrial practice in artificial intelligence ethics. IEEE Software, 37(4), 50–57. https://doi.org/10.1109/MS.2020.2985621
Vervoort, D., Marvel, F. A., Isakadze, N., Kpodonu, J., & Martin, S. S. (2020). Digital cardiology: Opportunities for disease prevention. Current Cardiovascular Risk Reports, 14(8), 1–7. https://doi.org/10.1007/S12170-020-00644-6
Winfield, A. F., Michael, K., Pitt, J., & Evers, V. (2019). Machine ethics: The design and governance of ethical ai and autonomous systems. Proceedings of the IEEE, 107(3), 509–517. https://doi.org/10.1109/JPROC.2019.2900622
Yang, L., Elisa, N., & Eliot, N. (2019). Privacy and security aspects of E-government in smart cities. Smart Cities Cybersecurity and Privacy. https://doi.org/10.1016/B978-0-12-815032-0.00007-X
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by MA, OK, CK, CK, KM, EM. The first draft of the manuscript was written by MA, OK, CK, CK, KM, EM and all authors commented on previous versions of the manuscript. Ioannis Konstantinidis devised the project, the main conceptual ideas, supervised the findings of this work and contributed to the design and implementation of the research, to the analysis of the results and to the writing of the manuscript. EK, CB, IM and VP contributed to the writing of the manuscript and on addressing the revisions required in the final version. All authors read and approved the final manuscript and provided critical feedback to shape the research, analysis and manuscript.
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
ID | Authors | ID | Authos |
|---|---|---|---|
1 | (Aitken et al., 2020) | 36 | (Kang et al., 2021) |
2 | (Ashrafian, 2014a) | 37 | (Kleindienst et al., 2017) |
3 | (Ashrafian, 2014b) | 38 | (Kuleshov et al., 2020) |
4 | (Balmer et al., 2020) | 39 | (Loftus et al., 2020) |
5 | (Banks, 2018) | 40 | (Lugano, 2017) |
6 | (Bartoletti, 2019) | 41 | (Luo, 2019) |
7 | (Bauer et al., 2017) | 42 | (Marri et al., 2019) |
8 | (Bendel, 2017) | 43 | (Martin, 2016) |
9 | (Bjørgen et al., 2018) | 44 | (Mason, 1986) |
10 | (Bogosian, 2017) | 45 | (Maxmen, 2018) |
11 | (Braun & Garriga, 2018) | 46 | (McAleenan, 2020) |
12 | (Breidbach & Maglio, 2020) | 47 | (McBride, 2016) |
13 | (Campbell et al., 2020) | 48 | (Mendling et al., 2018) |
14 | (Caner & Bhatti, 2020) | 49 | (Mittelstadt et al., 2016) |
15 | (Carter, 2019) | 50 | (Montes & Goertzel, 2019) |
16 | (Cath et al., 2017) | 51 | (Munoko et al., 2020) |
17 | (Cervantes et al., 2015) | 52 | (Pagallo, 2012) |
18 | (Chakraborty et al., 2020) | 53 | (Pedersen & Johansen, 2019) |
19 | (Cheng et al., 2020) | 54 | (Pitman et al., 2019) |
20 | (Cysneiros & do Prado Leite, 2020) | 55 | (Rahwan, 2017) |
21 | (Dahiyat, 2010) | 56 | (Rességuier & Rodrigues, 2020) |
22 | (David et al., 2019) | 57 | (Riedl & Zook, 2013) |
23 | (De Las Morenas et al., 2020) | 58 | (Roberts et al., 2020) |
24 | (Dignum, 2019) | 59 | (Russell & Norvig, 2002) |
25 | (Dodig Crnkovic & Çürüklü, 2011) | 60 | (Ten Teije et al., 2017) |
26 | (Erdélyi & Erdélyi, 2020) | 61 | (Timmers, 2019) |
27 | (Etzioni & Etzioni, 2017) | 62 | (Tonkens, 2009) |
28 | (Faulhaber et al., 2018) | 63 | (Turner, 2018) |
29 | (Ghandour & Woodford, 2019) | 64 | (Vaio et al., 2020) |
30 | (Gill, 2019) | 65 | (Vakkuri et al., 2020) |
31 | (Graham et al., 2019) | 66 | (Vakkuri et al., 2019b) |
32 | (Hauer, 2019) | 67 | (Vervoort et al., 2020) |
33 | (Hoeschl et al., 2018) | 68 | (Winfield et al., 2019) |
34 | (Howard & Borenstein, 2017) | 69 | (Yang et al., 2019) |
35 | (Juho, 2019) |
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Anagnostou, M., Karvounidou, O., Katritzidaki, C. et al. Characteristics and challenges in the industries towards responsible AI: a systematic literature review. Ethics Inf Technol 24, 37 (2022). https://doi.org/10.1007/s10676-022-09634-1
Published:
DOI: https://doi.org/10.1007/s10676-022-09634-1