Skip to main content

Advertisement

Log in

Using Dreyfus’ legacy to understand justice in algorithm-based processes

  • Original Article
  • Published:
AI & SOCIETY Aims and scope Submit manuscript

Abstract

As AI is linked to more and more aspects of our lives, the need for algorithms that can take decisions that are not only accurate but also fair becomes apparent. It can be seen both in discussions of future trends such as autonomous vehicles or the issue of superintelligence, as well as actual implementations of machine learning used to decide whether a person should be admitted in certain university or will be able to return a credit. In this paper, we will use Dreyfus’ account on ethical expertise to show that, to give an AI some ability to make ethical judgements, a pure symbolic, conceptual approach is not enough. We also need the ability to make sense of the surroundings to reframe and define situations in a dynamic way, using multiple perspectives in a pre-reflective way.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Angwin J, Larson J, Mattu S, Kirchner L (2016) Machine bias. ProPublica May 23, 2016. https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing

  • Appiah A (2008) Experiments in ethics. Harvard University Press, Cambridge

    Google Scholar 

  • Arkin RC, Ulam P (2009) An ethical adaptor: Behavioral modification derived from moral emotions. In: Computational Intelligence in Robotics and Automation (CIRA), 2009 IEEE International Symposium on (pp. 381–387). IEEE

  • Ayer AJ (1937) Language, truth and logic. Dover, New York

    Google Scholar 

  • Berry-Jester AM et al (2015) The new science of sentencing: should prison sentences be based on crimes that haven’t been committed yet?, The Marshall Project (Aug. 4, 2015)

  • Bonnefon JF, Shariff A, Rahwan I (2016) The social dilemma of autonomous vehicles. Sci 352(6293):1573–1576

    Article  Google Scholar 

  • Bostrom N (2014) Superintelligence: paths, dangers, strategies. OUP Oxford, Oxford

    Google Scholar 

  • Bostrom N, Yudkowsky E (2014) The ethics of artificial intelligence. The Cambridge handbook of artificial intelligence, pp 316–334

  • Buolamwini J (2016) “How I’m fighting bias in algorithms.” TED Talks. https://www.ted.com/talks/joy_buolamwini_how_i_m_ fighting_bias_in_algorithms

  • Chrisley R (1995) Taking embodiment seriously: non-conceptual content and robotics. In: Ford K, Glymour C, Hayes P (eds) Android Epistemology. AAAI/MIT Press, Cambridge, pp 141–166

    Google Scholar 

  • Cowley C (2005) A New rejection of moral expertise. Med Healthcare Philos 8:273–279

    Article  Google Scholar 

  • Datta A, Tschantz MC (2015) Automated experiments on ad privacy settings. Proc Priv Enhanc Technol 1:92–112

    Article  Google Scholar 

  • Davis E (2015) Ethical guidelines for a superintelligence. Artif Intell 220:121–124

    Article  Google Scholar 

  • DeSouza N (2013) Pre-reflective ethical know-how. Ethic Theory Moral Prac 16:279–294

    Article  Google Scholar 

  • Dreyfus HL, Dreyfus SE (1986) Mind over machine. Free Press, New York

    Google Scholar 

  • Dreyfus HL, Dreyfus SE (1990) What is moral maturity? A phenomenological account of the development of ethical expertise. In: Universalism vs. communitarianism, pp 237–264

  • Dreyfus HL, Dreyfus SE (1991) Towards a phenomenology of ethical expertise. Hum Stud 14:229–250

    Article  Google Scholar 

  • Dreyfus HL, Dreyfus SE (2004) The ethical implications of the five-stage-skill-acquisition model. Bull Sci Technol Soc 24:251–264

    Article  Google Scholar 

  • Foot P (1967) The problem of abortion and the doctrine of double effect. Oxford Review 5:5–15

  • Freeman K (2016) Algorithmic injustice: how the Wisconsin’s supreme court failed to protect due process rights in state V. Loomis. N C J Law Technol 18:75–106

    Google Scholar 

  • Gibbard A (1991) Wise choices, apt feelings. Harvard University, Cambridge

    Google Scholar 

  • Goodall NJ (2014) Machine ethics and automated vehicles. Road vehicle automation. Springer International Publishing, Berlin, pp 93–102

    Book  Google Scholar 

  • Hevelke A, Nida-Rümelin J (2015) Responsibility for crashes of autonomous vehicles: an ethical analysis. Sci Eng Ethics 21(3):619–630

    Article  Google Scholar 

  • Hurley M, Adebayo J (2016) Credit scoring in the era of big data. Yale J Law Technol 18(1):151

    Google Scholar 

  • Introna L, Wood D (2002) Picturing algorithmic surveillance: the politics of facial recognition systems. Surveill Soc 2:177–198

    Article  Google Scholar 

  • Koerth-Baker M (2016) The calculus of criminal risk: the justice system has come to rely heavily on quantitative assessments of criminal risk. How well they work is a complicated question. UNDARK

  • Lin P (2016) Why ethics matters for autonomous cars. In: Maurer M, Gerdes JC, Lenz B, Winner H (eds) Autonomous driving. Springer, Berlin

    Google Scholar 

  • Lyon D (2015) Surveillance as social sorting: privacy, risk and automated discrimination. Routledge, New York

    Google Scholar 

  • Muehlhauser L, Helm L (2012) The singularity and machine ethics. In: Singularity Hypotheses. Springer, Berlin Heidelberg, pp 101–126

    Chapter  Google Scholar 

  • Newman N (2014) The costs of lost privacy: consumer harm and rising economic inequality in the age of Google (September 24, 2013). William Mitchell Law Rev 40(2):12

    Google Scholar 

  • O’Neil C (2016) Weapons of math destruction. Allen Lane, London, pp 84–87

    MATH  Google Scholar 

  • Pinker S (2008) The moral instinct. The New York times magazine, p 12

  • Reuters (2016) New Zealand passport robot tells applicant of Asian descent to open eyes. Technology News

  • Scofield GR (1993) Ethics consultation: the least dangerous profession? Camb Q Healthc Ethics 2:417–426

    Article  Google Scholar 

  • Sethi N, Mehta N, Srivastava M (2013) Algorithms in our daily life Livemint. http://www.livemint.com/Specials/34LMe9rhl7u4fVJPKPtJEN/Algorithms-in-our-daily-life.html. Accessed 27 Aug 2013

  • Skeem J, Eno Louden J (2007) Assessment of evidence on the quality of the Correctional Offender Management Profiling for Alternative Sanctions (COMPAS). Unpublished report prepared for the California Department of Corrections and Rehabilitation. https://webfiles.uci.edu/skeem/Downloads.html

  • Skirpan M, Yeh T (2017) Designing a Moral Compass for the Future of Computer Vision using Speculative Analysis. In: Computer Vision and Pattern Recognition Workshops (CVPRW), 2017 IEEE Conference on (pp 1368–1377). IEEE

  • Thomson JJ (1976) Killing, letting die, and the trolley problem. 59 The Monist 59:204–217

    Article  Google Scholar 

  • Vallverdú J (2011) The Eastern construction of the artificial mind. Enrahonar Quad Filos 47:171–185

    Article  Google Scholar 

  • Varelius J (2007) Is ethical expertise possible? Med Healthcare Philos. https://doi.org/10.1007/s11019-007-9089-8 (Online First)

    Google Scholar 

  • Wood D, Konvitz E, Ball K (2003) The constant state of emergency: surveillance after 9/11. In: Ball K, Webster F (eds) The intensification of surveillance: crime, terror and warfare in the information era. Pluto Press, London

    Google Scholar 

  • Zureik E (2004) Governance, security and technology: the case of biometrics’. Stud Polit Econ 73:113–137

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Casacuberta.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Casacuberta, D., Guersenzvaig, A. Using Dreyfus’ legacy to understand justice in algorithm-based processes. AI & Soc 34, 313–319 (2019). https://doi.org/10.1007/s00146-018-0803-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00146-018-0803-2

Keywords

Navigation