Skip to main content
SpringerLink
Log in

Ethics-by-design: the next frontier of industrialization

  • Review
  • Published:
AI and Ethics Aims and scope Submit manuscript

Abstract

During the past few years, most companies have launched experiments on how they can use artificial intelligence (AI) to leverage their data. These experiments generally correspond to prototypes solving a specific business case, such as fraud detection in banking or predictive maintenance for industrial equipment. If the estimated return on investment of the prototype is positive, the technical and business teams start thinking about how to industrialize their experiments. Deployment of AI systems comes with a set of specific challenges, such as data governance, model lifecycle management, and collaborators training and onboarding, among others. Overcoming these challenges hedges most performance risks. However, a new set of risks and challenges, related to ethical considerations, is emerging. In this paper, we review in detail all these challenges, share our experience on best practices that help build well-integrated AI systems, and argue in favor of an ethics-by-design approach to prototyping.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Wamba-Taguimdje, S.-L., Fosso Wamba, S., Kala Kamdjoug, J.R., Tchatchouang Wanko, C.E.: Influence of artificial intelligence (AI) on firm performance: the business value of AI-based transformation projects. Bus. Process. Manag. J. 26(7), 1893–1924 (2020)

    Article  Google Scholar 

  2. Gartner: Gartner Says Global Artificial Intelligence Business Value to Reach $1.2 Trillion in 2018. See: https://www.gartner.com/en/newsroom/press-releases/2018-04-25-gartner-says-global-artificial-intelligence-business-value-to-reach-1-point-2-trillion-in-2018 (2018)

  3. Ransbotham, S., Khodabandeh, S., Fehling, R., LaFountain, B., Kiron, D.: Winning With AI. MIT Sloan Management Review and Boston Consulting Group

  4. Rouault, B., Pidault, H.: Du POC à l’industrialisation, Deloitte. See: https://blog.deloitte.fr/point-de-vue-du-poc-a-lindustrialisation-2/ (2016)

  5. Gartner: Glossary of IT Industrialization. See: https://www.gartner.com/en/information-technology/glossary/it-industrialization

  6. Chui, M., Malhotra, S.: AI adoption advances, but foundational barriers remain, McKinsey. See: https://www.mckinsey.com/featured-insights/artificial-intelligence/ai-adoption-advances-but-foundational-barriers-remain (2018)

  7. Van Wyck, J., Rose, J., Ahmad, J., Küpper, D.: Putting value first in digital operations. BCG. See: https://www.bcg.com/fr-fr/publications/2019/putting-value-first-digital-operations (2019)

  8. Costello, K.: Top 3 benefits of AI projects. Gartner. See: https://www.gartner.com/smarterwithgartner/top-3-benefits-of-ai-projects/ (2019)

  9. Quantmetry: Livre blanc Quantmetry, IA en production—Cycle de vie et dérive des modèles (2019)

  10. Thomas, A: Kaggle 2017 survey results. See: https://www.kaggle.com/amberthomas/kaggle-2017-survey-results (2017)

  11. Khatri, V., Brown, C.V.: Designing data governance. Commun. ACM 53(1), 148–152 (2010)

    Article  Google Scholar 

  12. Crawford, K.: The hidden biases in big data. Harvard Bus. Rev. See: https://hbr.org/2013/04/the-hidden-biases-in-big-data (2013)

  13. Aladwani, A. M.: IT project uncertainty, planning and success: an empirical investigation from Kuwait. Inform. Technol. People (2002)

  14. Dvir, D., Raz, T., Shenhar, A.J.: An empirical analysis of the relationship between project planning and project success. Int. J. Project Manage. 21(2), 89–95 (2003)

    Article  Google Scholar 

  15. Veryzer, R., Borja de Mozota, B.: The impact of user-oriented design on new product development: an examination of fundamental relationship. J. Prod. Innov. Manag. 22(2), 2005 (2005)

    Article  Google Scholar 

  16. Evans, E.: Domain driven design: tackling the complexity in the heart of software (2004)

  17. Hamill, P.: Unit test frameworks: tools for high-quality software development (2004)

  18. Roghé, F., Lenhard, E., LaFountain, B., Airaghi, G.: Using agile help fix big data’s big problem. BCG. See: https://www.bcg.com/fr-fr/publications/2018/using-agile-help-fix-big-data-big-problem (2018)

  19. Duranton, S., Erlebach, J., Pauly, M.: Mind the (AI) Gap. BCG Gamma. See: https://image-src.bcg.com/Images/Mind_the(AI)Gap-Focus_tcm9-208965.pdf (2018)

  20. Stumpf, K., Bedratiuk, S., Cirit, O.: Michelangelo PyML: introducing Uber’s platform for rapid python ML model development. Uber. See: https://eng.uber.com/michelangelo-pyml/ (2018)

  21. Khan, N., McCarthy, B., Pradhan, A.: Executive’s guide to developing AI at scale. McKinsey. See: https://www.mckinsey.com/business-functions/mckinsey-analytics/our-insights/executives-guide-to-developing-ai-at-scale

  22. Hoens, T.R., Polikar, R., Chawla, N.V.: Learning from streaming data with concept drift and imbalance: an overview. Prog Artif Intell 1(1), 89–101 (2012)

    Article  Google Scholar 

  23. Sutton, S.G., et al.: How much automation is too much? Keeping the human relevant in knowledge work. J Emerg Technol Account 15(2), 15–25 (2018)

    Article  Google Scholar 

  24. Cavoukian, A.: Privacy by design: the 7 foundational principles. implementation and mapping of fair information practices. Information and Privacy Commissioner of Ontario, Canada.

  25. d'Aquin, M.: Towards an" ethics by design" methodology for AI research projects. In: Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, 54–59 (2018)

  26. Spiekermann, S., Winkler, T.: Value-based engineering for ethics by design (2020). See: https://ssrn.com/abstract=3598911https://doi.org/10.2139/ssrn.3598911

  27. European Commission: Ethics guidelines for trustworthy AI. See: https://ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai (2019)

  28. Pégny, M., Thelisson, E., Ibnouhsein, I.: The right to an explanation: an interpretation and defense. Delphi Interdiscip Rev Emerg Technol 2(4), 161–166 (2020)

    Article  Google Scholar 

  29. Edwards, L., Veale, M.: Enslaving the algorithm: from a “right to an explanation” to a “right to better decisions”?. IEEE Secur. Privacy 16(3) (2018)

  30. Wachter, S., et al.: (2017). Counterfactual explanation without opening the black box: automated decisions and the GDPR. 31. Harvard J Law Technol 842

  31. Ribeiro, M., Singh, S., Guestrin, C.: “Why should I trust you?”: explaining the predictions of any classifier. In: Knowledge Discovery and Data Mining (KDD) (2016)

  32. Lundberg, S., Lee, S.: A unified approach to interpreting model predictions. In: NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing, 4768–4777 (2017)

  33. Belle, V., Papantonis I.: Principles and practice of explainable machine learning (2020)

  34. Solon, B., Hardt, M.: (2017). Fairness in machine learning. NIPS 2017 Tutorial. See: http://mrtz.org/nips17/#/

  35. Northpointe: A Practitioner's guide to COMPAS core. See: https://assets.documentcloud.org/documents/2840784/Practitioner-s-Guide-to-COMPAS-Core.pdf (2015)

  36. Angwin, J., Larson, J., Mattu, S., Kirchner, L.: Machine bias: there’s software used across the country to predict future criminals. And it’s biased against blacks, ProPublica. See: https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing (2016)

  37. Toader, A.: Auditability of AI systems—brake or acceleration to innovation?. See : https://ssrn.com/abstract=3526222 or https://doi.org/10.2139/ssrn.3526222 (2019)

  38. The Institute of Internal Auditors, Inc.: Intelligence artificielle : le futur de l’audit interne, tone at the top, number 85 (2017)

  39. Lum, K., Isaac, W.: To predict and serve? Significance 13(5), 14–19 (2016)

    Article  Google Scholar 

  40. Wakefield, J.: Microsoft chatbot is taught to swear on Twitter. BBC News. See: https://www.bbc.com/news/technology-35890188 (2016)

  41. Aristi Baquero, J., et al: Derisking AI by design: how to build risk management into AI development. McKinsey Analytics (2020)

  42. Montavon, G.: Methods for interpreting and understanding deep neural networks. Digit. Signal Process. 73: 1–15 (2018)

  43. European Central Bank: ECB guide to internal models—consolidated version. See: https://www.bankingsupervision.europa.eu/ecb/pub/pdf/ssm.guidetointernalmodels_consolidated_201910~97fd49fb08.en.pdf (2019)

  44. Haute Autorité de Santé: Évaluer les dispositifs médicaux avec intelligence artificielle. See: https://www.has-sante.fr/jcms/p_3119829/fr/evaluer-les-dispositifs-medicaux-avec-intelligence-artificielle (2020)

Download references

Author information

Authors and Affiliations

  1. Quantmetry, 52, Rue d’Anjou, 75008, Paris, France

    Aurélien Bourgais & Issam Ibnouhsein

Authors
  1. Aurélien Bourgais
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Issam Ibnouhsein
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Issam Ibnouhsein.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bourgais, A., Ibnouhsein, I. Ethics-by-design: the next frontier of industrialization. AI Ethics 2, 317–324 (2022). https://doi.org/10.1007/s43681-021-00057-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s43681-021-00057-0

Keywords

Search

Navigation