skip to main content
research-article
Free access

Toward Practices for Human-Centered Machine Learning

Published: 22 February 2023 Publication History

Abstract

Designing for the social, cultural, and ethical implications of ML are just as important as its technical advances.

References

[1]
Ackerman, M. The intellectual challenge of CSCW: The gap between social requirements and technical feasibility. Human-Computer Interaction 15, 2 (2020), 179--203
[2]
Agre, A. Computation and Human Experience. Cambridge University Press, 1997.
[3]
Agre, P., Bowker, G., Gasser, L., Star, L., and Turner, B. Toward a critical technical practice: Lessons learned in trying to reform AI. Bridging the Great Divide: Social Science, Technical Systems, and Cooperative Work, 1997, 131--157; http://polaris.gseis.ucla.edu/pagre/
[4]
Amershi, S. et al. Guidelines for human-AI interaction. In Proceedings of the 2019 Conf. Human Factors in Computing Systems, 13
[5]
Baumer, E.P.S., and Brubaker, J.R. Post-userism, 2017, 6291--6303
[6]
Baumer, E.P.S. and Silberman, M.S. When the implication is not to design (technology), 2011, 2271
[7]
Blodgett, S.L., Barocas, S., Daumé, H. and Wallach, H. Language (Technology) is power: A critical survey of "bias" in NLP. ACL. 2020; http://arxiv.org/abs/2005.14050
[8]
Buolamwini, J. and Gebru, T. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of 2018 Machine Learning Research
[9]
Cai, C.J. et al. Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the 2019 Conf. on Human Factors in Computing Systems, 1--14
[10]
Caruana, R. and Niculescu-Mizil, A. An empirical comparison of supervised learning algorithms. In Proceedings of the ACM 2006 Intern. Conf. Series 148, 161--168
[11]
Chancellor, S. Baumer, E.P.S., and De Choudhury, M. Who is the "human" in human-centered machine learning: The case of predicting mental health from social media. PACM-HCI 3, Nov. 2019.
[12]
Chancellor, S., Birnbaum, M.L., Caine, E.D., Silenzio, V.M.B. and De Choudhury, M. A taxonomy of ethical tensions in inferring mental health states from social media. In Proceedings of FAT* 2019, 79--88
[13]
Chancellor, S. and De Choudhury, M. 2020. Methods in predictive techniques for mental health status on social media: a critical review. npj Digital Medicine 3, 1 (2020), 43
[14]
Chancellor, S., Lin, Z., Goodman, E.L., Zerwas, S. and De Choudhury, M. Quantifying and predicting mental illness severity in online pro-eating disorder communities. In Proceedings of 2016 CSCW, 1169--1182
[15]
Collins, P.H. Intersectionality as Critical Social Theory. Duke University Press, 2019.
[16]
Costanza-Chock, S. Design justice: Towards an intersectional feminist framework for design theory and practice. In Proceedings of the Design Research Society 2018
[17]
Dacrema, M.F., Cremonesi, P., and Jannach, D. Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In Proceedings of the 13th ACM Conf. Recommender Systems, 2019, 101--109
[18]
Dourish. P. Where the Action Is: The Foundations of Embodied Interaction. MIT Press, 2001
[19]
Elliot, D.S. Lies, Damn Lies and Arrest Statistics, 1995.
[20]
Fiebrink, R. and Gillies, M. Introduction to the special issue on human-centered machine learning. TiiS, 2018
[21]
Gasson, S. Human-centered vs. user-centered approaches to information system design. J. Info. Technology Theory and Application 5, 2 (2003), 29--46.
[22]
Gillies, M. et al. Human-centered machine learning introduction and background, 2016, 3558--3565
[23]
Goodpaster, K.E. Business Ethics and Stakeholder Analysis. Cambridge University Press, 2016; http://www.jstor.org/stable/3857592
[24]
Grudin, J. AI and HCI: Two fields divided by a common focus. AI Magazine 30, 4 (2009)
[25]
Hedberg, E., Mumfor, B. The design of computer systems: Man's vision of man as an integral part of the system design process. In Proceedings of the 1975 IFIP Conf. Human Choice and Computers, 31--59
[26]
Inkpen, K., Veale, M., Chancellor, S., De Choudhury, M. and P.S. Baumer, E.P.S. Where is the human? Bridging the gap between AI and HCI. In Proceedings of the 2019 Conf. Human Factors in Computing Systems, 1--9
[27]
Jackson, S.J. Rethinking repair. Media Technologies, 2014, 221--240
[28]
Kling, R. and Star, S.L. Human centered systems in the perspective of organizational and social informatics. ACM SIGCAS Computers and Society 28, 1 (1997), 22--29
[29]
Kuhn, T.S. Scientific paradigms. Sociology of Science. B. Barnes (ed.). Penguin Books, Middlesex, England, U.K., 1972.
[30]
Lipton, Z.C. and Steinhardt, J. Troubling trends in machine learning scholarship, 2018, 1--15
[31]
Maguire, M. Methods to support human-centred design. Intern. J. Human Computer Studies 55, 4 (2001); 587--634
[32]
Mitchell, T.M. Machine Learning. McGraw-Hill Higher Education, 1997.
[33]
Mittelstadt, B. Principles alone cannot guarantee ethical AI. Nature Machine Intelligence 1, 11 (2019), 501--507
[34]
Morozov. E. To Save Everything, Click Here: The Folly of Technological Solutionism. Public Affairs, 2013.
[35]
Nushi, B., Kamar, E., and Horvitz, E. Towards accountable AI: Hybrid human-machine analyses for characterizing system failure. Hcomp, 2018, 126--135; http://arxiv.org/abs/1809.07424
[36]
Passi, S. and Barocas, S. Problem formulation and fairness. arXiv, 2019, 39--48
[37]
Ramazanoglu, C. and Holland, J. From truth / reality to knowledge / power: Taking a feminist standpoint. Feminist Methodology, 2015, 60--80.
[38]
Ramos, G. et al. Emerging perspectives in human-centered machine learning. In Proceedings of the 2019 Conference on Human Factors in Computing Systems, 1--8
[39]
Ribeiro, M.T., Singh, S. and Guestrin, C. 'Why should I trust you?' In Proceedings of the 22nd ACM SIGKDD Intern. Conf. Knowledge Discovery and Data Mining 2016, 1135--1144
[40]
Ribes, D., Hoffman, A.S., Slota, S.C., and Bowker, G.C. The logic of domains. Social Studies of Science 49, 3 (2019), 281--309
[41]
Scheuerman, M.K., Paul, J.M., and Brubaker, J.R. How computers see gender: An evaluation of gender classification in commercial facial analysis and image labeling services. In Proceedings of the 2019 ACM on Human-Computer Interaction 3, CSCW
[42]
Schiff, D., Rakova, B., Ayesh, A., Fanti, A. and Lennon, M. Principles to practices for responsible AI: Closing the gap, 2020; http://arxiv.org/abs/2006.04707
[43]
Selbst, A.D., boyd, d., Friedler, S.A., Venkatasubramanian, S. and Vertesi, J. Fairness and abstraction in sociotechnical systems. In Proceedings of 2019 FAT*, 59--68
[44]
Shneiderman, B. Human-centered artificial intelligence: Reliable, safe and tustworthy. Intern. J. Human-Computer Interaction 36, 6 (2020), 495--504
[45]
Suchman, L. Human-Machine Reconfigurations: Plans and Situated Actions, 2nd Edition. Cambridge University Press, 2006.
[46]
Winograd, T. and Flores, F. On understanding computers and cognition: A new foundation for design. A response to the reviews. Artificial Intelligence 31, 2 (1987), 250--261
[47]
Vaughan, J.W. and Wallach, H. A Human-Centered Agenda for Intelligible Machine Learning.
[48]
Zhu, H., Yu, B., Halfaker, A., and Terveen, L. Value-sensitive algorithm design: Method, case study, and lessons. In Proceedings of the ACM 2018 Human-Computer Interaction 2, CSCW

Cited By

View all
  • (2025)Sentiment Analysis of #Meanspo Tweets: Humans vs. Automatic ClassificationsProceedings of the ACM on Human-Computer Interaction10.1145/37012079:1(1-26)Online publication date: 10-Jan-2025
  • (2024)A Strategic Roadmap for Mitigating Generative Artificial Intelligence HallucinationsCureus Journal of Computer Science10.7759/s44389-024-00364-7Online publication date: 20-Sep-2024
  • (2024)A Strategic Roadmap for Mitigating Generative Artificial Intelligence HallucinationsCureus Journals10.7759/8Online publication date: 20-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Communications of the ACM
Communications of the ACM  Volume 66, Issue 3
March 2023
87 pages
ISSN:0001-0782
EISSN:1557-7317
DOI:10.1145/3585257
  • Editor:
  • James Larus
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 February 2023
Published in CACM Volume 66, Issue 3

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Popular
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,680
  • Downloads (Last 6 weeks)241
Reflects downloads up to 18 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Sentiment Analysis of #Meanspo Tweets: Humans vs. Automatic ClassificationsProceedings of the ACM on Human-Computer Interaction10.1145/37012079:1(1-26)Online publication date: 10-Jan-2025
  • (2024)A Strategic Roadmap for Mitigating Generative Artificial Intelligence HallucinationsCureus Journal of Computer Science10.7759/s44389-024-00364-7Online publication date: 20-Sep-2024
  • (2024)A Strategic Roadmap for Mitigating Generative Artificial Intelligence HallucinationsCureus Journals10.7759/8Online publication date: 20-Sep-2024
  • (2024)Blameless and Optimal Control under Prioritized Safety Constraints2024 American Control Conference (ACC)10.23919/ACC60939.2024.10644404(2311-2317)Online publication date: 10-Jul-2024
  • (2024)Unpacking Human-AI interactions: From Interaction Primitives to a Design SpaceACM Transactions on Interactive Intelligent Systems10.1145/366452214:3(1-51)Online publication date: 2-Aug-2024
  • (2024)The IDEA of Us: An Identity-Aware Architecture for Autonomous SystemsACM Transactions on Software Engineering and Methodology10.1145/365443933:6(1-38)Online publication date: 28-Jun-2024
  • (2024)Co-Designing Resilient Socio-Technical Software SystemsProceedings of the 1st International Workshop on Designing Software10.1145/3643660.3643948(60-63)Online publication date: 15-Apr-2024
  • (2024)AI Failure Cards: Understanding and Supporting Grassroots Efforts to Mitigate AI Failures in Homeless ServicesProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658935(713-732)Online publication date: 3-Jun-2024
  • (2024)Examining the Unique Online Risk Experiences and Mental Health Outcomes of LGBTQ+ versus Heterosexual YouthProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642509(1-21)Online publication date: 11-May-2024
  • (2024)Shortchanged: Uncovering and Analyzing Intimate Partner Financial Abuse in Consumer ComplaintsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642033(1-20)Online publication date: 11-May-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media