Skip to main content

Values in Design Methodologies for AI

  • Conference paper
  • First Online:
Advanced Information Systems Engineering Workshops (CAiSE 2021)

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 423))

Included in the following conference series:

Abstract

Addressing and integrating human values into AI design and development processes in research and practice can be difficult, and a clear methodological approach can clarify issues of both theory and practice. One such approach is Value Sensitive Design (VSD), an established theory for addressing issues of values in a systematic and principled fashion in the design of information technology. However, it is unclear how VSD is translated into current design practices and whether it has been integrated into existing methodologies. In this paper, we investigated whether and to what extent VSD has passed down into design methodologies used in practice. We found that the actual application of VSD in methodologies is limited, but that in the last few years, steps have been taken to bridge the gap between theory and practice.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In contrast to the US and China, the European Union is trying to position itself as the world leader of ‘human centered AI’: https://www.weforum.org/agenda/2021/02/heres-what-you-need-to-know-about-the-new-ai-arms-race/.

References

  1. AI High-Level Expert Group. Ethics guidelines for trustworthy AI. B-1049 Brussels (2019)

    Google Scholar 

  2. Aldewereld, H., Dignum, V., Tan, Y.: Design for values in software development. In: van den Hoven, J., Vermaas, P.E., van de Poel, I. (eds.) Handbook of Ethics, Values, and Technological Design, pp. 831–845. Springer, Dordrecht (2015). https://doi.org/10.1007/978-94-007-6970-0_26

    Chapter  Google Scholar 

  3. Aspen, D.M., Haskins, C., Fet, A.M.: Application of systems engineering to structuring acquisition decisions for marine emission reduction technologies. Syst. Eng. 21(4), 388–397 (2018)

    Article  Google Scholar 

  4. Avison, D.E., Wood-Harper, A.T.: Multiview - an exploration in information systems development. Aust. Comput. J. 18(4), 174–179 (1986)

    Google Scholar 

  5. Camelia, F., Ferris, T.L.J.: Systems thinking in systems engineering. In: INCOSE International Symposium, vol. 26, pp. 1657–1674. Wiley Online Library (2016)

    Google Scholar 

  6. Cawthorne, D., Robbins-van Wynsberghe, A.: From HealthDrone to FrugalDrone: value-sensitive design of a blood sample transportation drone. In: 2019 IEEE International Symposium on Technology and Society (ISTAS), pp. 1–7. IEEE (2019)

    Google Scholar 

  7. Cawthorne, D., Robbins-van Wynsberghe, A.: An ethical framework for the design, development, implementation, and assessment of drones used in public healthcare. Sci, Eng. Ethics 26(5), 2867–2891 (2020). https://doi.org/10.1007/s11948-020-00233-1

    Article  Google Scholar 

  8. Checkland, P.: Systems thinking, systems practice. Wiley Chichester (1971)

    Google Scholar 

  9. Checkland, P.: OR and the systems movement: mappings and conflicts. J. Oper. Res. Soc. 34(8), 661–675 (1983)

    Article  Google Scholar 

  10. Collopy, P.D., Hollingsworth, P.M.: Value-driven design. J. Aircr. 48(3), 749–759 (2011)

    Article  Google Scholar 

  11. de Graaf, R., Van der Linde, G., De Jong, H., Vogt, B.: Value engineering as a specialty for systems engineering: exploring opportunities. INSIGHT 22(1), 41–44 (2019)

    Article  Google Scholar 

  12. Dignum, V.: Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way. Springer Nature, Basingstoke, UK (2019)

    Book  Google Scholar 

  13. Duncan, J.: SSADM in practice: a version 4 text. Macmillan International Higher Education, New York, USA (1995)

    Book  Google Scholar 

  14. Elbanna, A., Newman, M.: The rise and decline of the ethics methodology of systems implementation: lessons for is research. J. Inf. Technol. 28(2), 124–136 (2013)

    Article  Google Scholar 

  15. Forrester, J.W.: World Dynamics. Wright-Allen Press, USA (1971)

    Google Scholar 

  16. Friedman, B.: Value-sensitive design. Interactions 3(6), 16–23 (1996)

    Article  Google Scholar 

  17. Friedman, B., Kahn Jr., P.H.: Human Values, Ethics, and Design. The human-computer interaction handbook, pp. 1177–1201 (2003)

    Google Scholar 

  18. Friedman, B., Hendry, D.G., Borning, A.: A survey of value sensitive design methods. Found. Trends Hum. Comput. Interact. 11(2), 63–125 (2017)

    Article  Google Scholar 

  19. Gazzaneo, L., Padovano, A., Umbrello, S.: Designing smart operator 4.0 for human values: a value sensitive design approach. Proc. Manuf. 42, 219-226 (2020)

    Google Scholar 

  20. Génova, G., González, M.R.: Teaching ethics to engineers: a socratic experience. Sci. Eng. Ethics 22(2), 567–580 (2015). https://doi.org/10.1007/s11948-015-9661-1

    Article  Google Scholar 

  21. Harbers, M., Neerincx, M.A.: Value sensitive design of a virtual assistant for workload harmonization in teams. Cogn. Technol. Work 19(2), 329–343 (2017). https://doi.org/10.1007/s10111-017-0408-4

    Article  Google Scholar 

  22. Haskins, C.: Systems engineering analyzed, synthesized, and applied to sustainable industrial park development (2008)

    Google Scholar 

  23. Huldtgren, A.: Design for values in ICT. In: van den Hoven, J., Vermaas, P.E., van de Poel, I. (eds.) Handbook of Ethics, Values, and Technological Design, pp. 739–767. Springer, Dordrecht (2015). https://doi.org/10.1007/978-94-007-6970-0_35

    Chapter  Google Scholar 

  24. Ienca, M., Wangmo, T., Jotterand, F., Kressig, R.W., Elger, B.: Ethical design of intelligent assistive technologies for dementia: a descriptive review. Sci. Eng. Ethics 24(4), 1035–1055 (2018)

    Article  Google Scholar 

  25. Jackson, M.C.: Social systems theory and practice: the need for a critical approach. Int. J. Gen. Syst. 10(2–3), 135–151 (1985)

    Article  Google Scholar 

  26. Kannan, H., Mesmer, B.L., Bloebaum, C.L.: Incorporation of risk preferences in a value-based systems engineering framework. Syst. Eng. 23(2), 237–257 (2020)

    Article  Google Scholar 

  27. Leijnen, S., Aldewereld, H., van Belkom, R., Bijvank, R., Ossewaarde, R.: An agile framework for trustworthy AI. In: Proceedings of the 1st International Workshop on New Foundations for Human-Centered AI, p. 8 (2020)

    Google Scholar 

  28. Looije, R., Neerincx, M.A., Hindriks, K.V.: Specifying and testing the design rationale of social robots for behavior change in children. Cogn. Syst. Res. 43, 250–265 (2017)

    Article  Google Scholar 

  29. Manders-Huits, N.: What values in design? the challenge of incorporating moral values into design. Sci. Eng. Ethics 17(2), 271–287 (2011)

    Article  Google Scholar 

  30. Mastrofini, M., Cantone, G., Seaman, C., Shull, F., Diep, M., Falessi, D.: Enhancing the system development process performance: a value-based approach. In: INCOSE International Symposium, vol. 22, pp. 401–415. Wiley Online Library (2012)

    Google Scholar 

  31. Morley, J., Floridi, L., Kinsey, L., Elhalal, A.: From what to how. an overview of AI ethics tools, methods and research to translate principles into practices (2019). arXiv preprint arXiv:1905.06876

  32. Mumford, E.: Values, Technology and Work, p. 318. Springer Science & Business Media, Netherlands (2013). https://doi.org/10.1007/978-94-009-8343-4

    Book  Google Scholar 

  33. Neerincx, M.A., Lindenberg, J.: Situated cognitive engineering for complex task environments. Ashgate Publishing Limited, Aldershot (2008)

    Google Scholar 

  34. Neerincx, M.A.: Socio-cognitive engineering of a robotic partner for child’s diabetes self-management. Frontiers Robot. AI 6, 118 (2019)

    Article  Google Scholar 

  35. Slota, S.C., et al.: Good systems, bad data?: interpretations of AI hype and failures. Proc. Assoc. Inf. Sci. Technol. 57(1), e275 (2020)

    Article  Google Scholar 

  36. Spiekermann, S.: Ethical IT innovation: a value-based system design approach. Auerbach Publications, New York (2015)

    Book  Google Scholar 

  37. Taylor, M.J., Moynihan, E.: Analysing IT ethics. Syst. Res. Behav. Sci. Official J. Int. Fed. Syst. Res. 19(1), 49–60 (2002)

    Article  Google Scholar 

  38. The IEEE Global Initiative for Ethical Considerations in AI and Autonomous Systems. Ethically aligned design: A vision for prioritizing wellbeing with AI and autonomous systems. (Version 1) (2016)

    Google Scholar 

  39. Thew, S., Sutcliffe, A.: Value-based requirements engineering: method and experience. Requirements Eng. 23(4), 443–464 (2018)

    Article  Google Scholar 

  40. Thew, S.L.: Value based requirements engineering. The University of Manchester, UK (2014)

    Google Scholar 

  41. Ulrich, W.: Critical Heuristics of Social Planning: A New Approach to Practical Philosophy. Wiley, Hoboken, USA (1983)

    Google Scholar 

  42. Umbrello, S.: Beneficial artificial intelligence coordination by means of a value sensitive design approach. Big Data Cogn. Comput. 3(1), 5 (2019)

    Article  Google Scholar 

  43. Poel, I.: Translating values into design requirements. In: Michelfelder, D.P., McCarthy, N., Goldberg, D.E. (eds.) Philosophy and Engineering: Reflections on Practice, Principles and Process. PET, vol. 15, pp. 253–266. Springer, Dordrecht (2013). https://doi.org/10.1007/978-94-007-7762-0_20

    Chapter  Google Scholar 

  44. Van den Hoven, J., Vermaas, P.E.: Handbook of Ethics, Values, and Technological Design, p. 871. Springer, Netherlands (2015)

    Book  Google Scholar 

  45. Winkler, T., Spiekermann, S.: Twenty years of value sensitive design: a review of methodological practices in VSD projects. Ethics Inf. Technol. 23, 17–21 (2018). https://doi.org/10.1007/s10676-018-9476-2

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huib Aldewereld .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Aldewereld, H., Mioch, T. (2021). Values in Design Methodologies for AI. In: Polyvyanyy, A., Rinderle-Ma, S. (eds) Advanced Information Systems Engineering Workshops. CAiSE 2021. Lecture Notes in Business Information Processing, vol 423. Springer, Cham. https://doi.org/10.1007/978-3-030-79022-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-79022-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-79021-9

  • Online ISBN: 978-3-030-79022-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics