skip to main content
10.1145/3458026.3462161acmconferencesArticle/Chapter ViewAbstractPublication PagescprConference Proceedingsconference-collections
research-article

Emancipatory Data Science: A Liberatory Framework for Mitigating Data Harms and Fostering Social Transformation

Published:29 June 2021Publication History

ABSTRACT

The cross-cutting and interdisciplinary nature of data work has created an opportunity to engage more students from diverse backgrounds in data science and has expanded pathways for entry for future data professionals. However, without greater representation of Black, Indigenous, and other marginalized people of color in data science, we risk reinforcing existing systems of differentiated power that oppress as opposed to empower these groups. In this paper, the term emancipatory data science is coined to highlight the unique contributions of individuals who use their expertise to mitigate data harms for minoritized, and marginalized populations and to suggest a way forward for the data science workforce and research community given our increasingly algorithmic society.

References

  1. Duranton, J., Erlenbach, J., Brégé, C., Danziger, J, Gallego, A, & Pauly, M. (2020). What's Keeping Women out of Data Science? Boston Consulting Group. (https://www.bcg.com/publications/2020/what-keeps-women-out-data-science.aspxGoogle ScholarGoogle Scholar
  2. Harnham Report. 2019. "USA Diversity in Data and Analytics: A review of diversity within the data and analytics industry in 2019," (https://www.harnham.com/us/2019-usa-diversity-in-data-analyticsreport; Accessed: September 12, 2019)Google ScholarGoogle Scholar
  3. Ho, A., Nguyen, A., Pafford, J. L., & Slater, R. (2019). A Data Science Approach to Defining a Data Scientist. SMU Data Science Review, 2(3), 4.Google ScholarGoogle Scholar
  4. General Assembly. 2017. "The Study of Data Science Lags in Gender and Racial Representation," The Index, September 25, 2017 (https://theindex.generalassemb.ly/data-science-education-lags-behind-indiversity-ff59ffa718ec; Accessed: September 12, 2019)Google ScholarGoogle Scholar
  5. U.S. Census Bureau (2018). Current Population Survey. Available at https://www.census.gov/en.htmlGoogle ScholarGoogle Scholar
  6. Alsan, M., Garrick, O., & Graziani, G. (2019). Does diversity matter for health? Experimental evidence from Oakland. American Economic Review, 109(12), 4071--4111.Google ScholarGoogle ScholarCross RefCross Ref
  7. Gershenson, S., Hart, C. M., Hyman, J., Lindsay, C., & Papageorge, N. W. (2018). The long-run impacts of same-race teachers (No. w25254). National Bureau of Economic Research.Google ScholarGoogle ScholarCross RefCross Ref
  8. Steenbarger, B. (2020). Why Diversity Matters In The World Of Finance. Forbes. https://www.forbes.com/sites/brettsteenbarger/2020/06/15/why-diversity-matters-in-the-world-of-finance/'sh=1ba5671c7913#215041397913Google ScholarGoogle Scholar
  9. Marshall B., and Geier S., 2019 "Targeted Curricular Innovations in Data Science," Proceedings of the IEEE Frontiers in Education Conference.Google ScholarGoogle Scholar
  10. Merton, R. K. (1949). The role of applied social science in the formation of policy: a research memorandum. Philosophy of Science, 16(3), 161--181.Google ScholarGoogle ScholarCross RefCross Ref
  11. Rieley, M. "Big data adds up to opportunities in math careers," Beyond the Numbers: Employment & Unemployment, vol. 7, no. 8 (U.S. Bureau of Labor Statistics, June 2018), https://www.bls.gov/opub/btn/volume-7/big-data-adds-up.htmGoogle ScholarGoogle Scholar
  12. Brahm, C., Sheth, A., Sinha, V., Dai, J. (2019). Advanced Analytics Talent Will Double. It's Still Not Enough. Bain & Company.Google ScholarGoogle Scholar
  13. Miller, S., & Hughes, D. (2017). The quant crunch: How the demand for data science skills is disrupting the job market. Burning Glass Technologies.Google ScholarGoogle Scholar
  14. Chui, M., Bughin, J., Hazan, E., Ramaswamy, S., Allas, T., Dahlström, P., Henke, N., Trench, M. 2017. "Artificial Intelligence the Next Digital Frontier?," McKinsey and Company Global Institute, (47).Google ScholarGoogle Scholar
  15. National Academies of Sciences, Engineering, and Medicine. 2018. "Envisioning the Data Science Discipline: The Undergraduate Perspective," Washington, DC: The National Academies Press. (doi:10.17226/24886).Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Naughton, J. (2021). "Why Silicon Valley's most astute critics are all women". The Guardian. https://www.theguardian.com/commentisfree/2021/apr/03/why-silicon-valley-most-astute-critics-women-tech-gender; Accessed: April 5th, 2021.Google ScholarGoogle Scholar
  17. Oberski, D. L. (2020). Human Data Science. Patterns, 1(4), 100069.Google ScholarGoogle ScholarCross RefCross Ref
  18. Dhar, V. (2013). Data science and prediction. Communications of the ACM, 56(12), 64--73. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Redden, J., Brand, J., & Terzieva, V. 2020. Data Harm Record Data Harm Record. https://datajusticelab.org/data-harm-record/\Google ScholarGoogle Scholar
  20. Buolamwini, J., & Gebru, T. (2018, January). Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency (pp. 77--91).Google ScholarGoogle Scholar
  21. Garvie, C., Bedoya, A. M., & Frankle, J. (2019). The perpetual line-up. Unregulated police face recognition in America. Georgetown Law Center on Privacy & Technology.Google ScholarGoogle Scholar
  22. Fortunato, S., Flammini, A., Menczer, F., & Vespignani, A. (2006). Topical interests and the mitigation of search engine bias. Proceedings of the national academy of sciences, 103(34), 12684--12689.Google ScholarGoogle ScholarCross RefCross Ref
  23. Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. NYU Press.Google ScholarGoogle ScholarCross RefCross Ref
  24. O'neil, C. (2016). Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Dressel, J., & Farid, H. (2018). The accuracy, fairness, and limits of predicting recidivism. Science advances, 4(1), eaao5580.Google ScholarGoogle Scholar
  26. Flores, A. W., Bechtel, K., & Lowenkamp, C. T. (2016). False positives, false negatives, and false analyses: A rejoinder to machine bias: There's software used across the country to predict future criminals. and it's biased against blacks. Fed. Probation, 80, 38Google ScholarGoogle Scholar
  27. Angwin, J., Larson, J., Mattu, S., & Kirchner, L. (2019). Machine bias: There's software used across the country to predict future criminals and it's biased against blacks. 2016. URL https://www. propublica. org/article/machine-bias-risk-assessments-in-criminal-sentencing.Google ScholarGoogle Scholar
  28. Wright, E. O. (2010). Envisioning real utopias (Vol. 98). London: Verso. p. 7.Google ScholarGoogle Scholar
  29. Young, A., Zhu, Y., & Venkatesh, V. (2021). Emancipation Research in Information Systems: Integrating Agency, Dialogue, Inclusion, and Rationality Research. In Proceedings of the 54th Hawaii International Conference on System Sciences (p. 6359).Google ScholarGoogle ScholarCross RefCross Ref
  30. Adam, A. (2000). Gender, emancipation and critical information systems. ECIS 2001 Proceedings, 25.Google ScholarGoogle Scholar
  31. Cushman, M., & McLean, R. (2008). Exclusion, inclusion and changing the face of information systems research. Information Technology & People.Google ScholarGoogle Scholar
  32. Córdoba, J. R. (2007). Developing inclusion and critical reflection in information systems planning. Organization, 14(6), 909--927.Google ScholarGoogle ScholarCross RefCross Ref
  33. Schultze, U., & Leidner, D. E. (2002). Studying knowledge management in information systems research: discourses and theoretical assumptions. MIS quarterly, 213--242. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Bell, D. A. (1995). Who's afraid of critical race theory. University of Illinois Law Review, 1995(4), 893--910.Google ScholarGoogle Scholar
  35. Crenshaw, K., Gotanda, N., Peller, G., & Thomas, K. (1995). Critical race theory. The Key Writings that formed the Movement. New York.Google ScholarGoogle Scholar
  36. Crenshaw, K. W. (1988). Race, reform, and retrenchment: Transformation and legitimation in antidiscrimination law. Harvard Law Review, 1331--1387.Google ScholarGoogle Scholar
  37. Wells, R. S., & Stage, F. K. (2015). Past, present, and future of critical quantitative research in higher education. New Directions for Institutional Research, 2014(163), 103--112.Google ScholarGoogle ScholarCross RefCross Ref
  38. Parker, L., & Lynn, M. (2002). What's race got to do with it? Critical race theory's conflicts with and connections to qualitative research methodology and epistemology. Qualitative inquiry, 8(1), 7--22.Google ScholarGoogle Scholar
  39. Galton, S. F. (1892). Hereditary genius: An inquiry into laws and consequences. MacMillan.Google ScholarGoogle Scholar
  40. Pearson K. (1901) cited by: Paul, D.B., & Moore, J. In: The Oxford Handbook of the History of Eugenics. P. Levine & A. Bashford (Eds). Oxford: Oxford University Press. 2010Google ScholarGoogle Scholar
  41. Fisher, R. A. (1914). Some hopes of a eugenist. The Eugenics Review, 5(4), 309.Google ScholarGoogle Scholar
  42. Ladson-Billings, G., & Tate, W. F. (2006). Toward a critical race theory of education. Critical race theory in education: All God's children got a song, 11, 30.Google ScholarGoogle Scholar
  43. González Canché, M. S., & Rios-Aguilar, C. (2015). Critical social network analysis in community colleges: Peer effects and credit attainment. New Directions for Institutional Research, 2014(163), 75--91.Google ScholarGoogle ScholarCross RefCross Ref
  44. Gillborn, D., Warmington, P., & Demack, S. (2018). QuantCrit: education, policy,"Big Data'and principles for a critical race theory of statistics. Race Ethnicity and Education, 21(2), 158--179.Google ScholarGoogle ScholarCross RefCross Ref
  45. Gillborn, D. (2005). Education policy as an act of white supremacy: Whiteness, critical race theory and education reform. Journal of Education Policy, 20(4), 485--505.Google ScholarGoogle ScholarCross RefCross Ref
  46. King, K. L., Houston, I. S., & Middleton, R. A. (2001). An explanation for school failure: Moving beyond black inferiority and alienation as a policy-making agenda. British Journal of Educational Studies, 49(4), 428--445.Google ScholarGoogle ScholarCross RefCross Ref
  47. Zuberi, T., & Bonilla-Silva, E. (Eds.). (2008). White logic, white methods: Racism and methodology. Rowman & Littlefield Publishers.Google ScholarGoogle Scholar
  48. Ben-David, A. (2020). Counter-archiving Facebook. European Journal of Communication, 35(3), 249--264.Google ScholarGoogle Scholar
  49. Stoler, A. L. (2002). Colonial archives and the arts of governance: on the content in the form. In Refiguring the archive (pp. 83--102). Springer, Dordrecht.Google ScholarGoogle ScholarCross RefCross Ref
  50. Motha, S., & Van Rijswijk, H. (2016). Introduction: A counter-archival sense.Google ScholarGoogle ScholarCross RefCross Ref
  51. Solórzano, D. G., & Yosso, T. J. (2002). Critical race methodology: Counter-storytelling as an analytical framework for education research. Qualitative inquiry, 8(1), 23--44.Google ScholarGoogle Scholar
  52. Milner IV, H. R., & Howard, T. C. (2013). Counter-narrative as method: Race, policy and research for teacher education. Race Ethnicity and Education, 16(4), 536--561.Google ScholarGoogle ScholarCross RefCross Ref
  53. Stoler, A. L. (2018). On archiving as dissensus. Comparative Studies of South Asia, Africa and the Middle East, 38(1), 43--56.Google ScholarGoogle ScholarCross RefCross Ref
  54. Wells, I.B. (1895). A red record. Tabulated statistics and alleged causes of lynchings in the United States, 1892--1893--1894. Respectfully submitted to the nineteenth century civilization in "the land of the free and the home of the brave."Google ScholarGoogle Scholar
  55. Alexander, M. (2020). The new Jim Crow: Mass incarceration in the age of colorblindness. The New Press.Google ScholarGoogle Scholar
  56. Equal Justice Initiative. (2015). Lynching in America: Confronting the Legacy of Racial Terror. Montgomery. http://www. eji. org/files/EJI Lynching in America SUMMARY. pdf.Google ScholarGoogle Scholar
  57. Wells, I.B. & Royster, J. J. (2016). Southern horrors and other writings: The anti-lynching campaign of Ida B. Wells, 1892--1900. Macmillan Higher Education.Google ScholarGoogle Scholar
  58. Benjamin, R. (n.d.). Ida B. Wells Just Data Lab https://www.thejustdatalab.com/Google ScholarGoogle Scholar
  59. Zuboff, Shoshana. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. Profile Books, 2019. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Dean, J [@JeffDean]. 2020, June 7. The Gender Shades project by @jovialjoy, @timnitGebru, @rajiinio et al. examined many of these commercial APIs and identified harmful gender & race biases. Many of these APIs have now been discontinued because of their potential for harm. Twitter. https://twitter.com/JeffDean/status/1280535427150082048Google ScholarGoogle Scholar
  61. Dean, J [@JeffDean]. 2020, December 4. I understand the concern over Timnit's resignation from Google. She's done a great deal to move the field forward with her research. I wanted to share the email I sent to Google Research and some thoughts on our research process. Twitter. https://twitter.com/search?q=Jeff%20dean%20timnit&src=typed_queryGoogle ScholarGoogle Scholar
  62. Bender, E. M., Gebru, T., McMillan-Major, A., & Mitchell, M. (2021, March). On the Dangers of Stochastic Parrots: Can Language Models Be Too Big???. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (pp. 610--623). Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Noble, S. (2020, June 28). AI Ethics Book Chat -- June 2020: Meet Author Dr. Safiya Noble "Algorithms of Oppression. https://lighthouse3.com/our-blog/june-2020-meet-author-dr-safiya-noble/Google ScholarGoogle Scholar
  64. Noble, S. [@safiyanoble]. (2018, February 2). Shameless plug: If everyone bought one right now for themselves, and one for a friend, this book could have a chance at improving the internet for women and people marginalized by tech... Twitter. https://twitter.com/safiyanoble/status/959621339110719488Google ScholarGoogle Scholar
  65. Metcalf, J., & Crawford, K. (2016). Where are human subjects in big data research? The emerging ethics divide. Big Data & Society, 3(1), 2053951716650211.Google ScholarGoogle ScholarCross RefCross Ref
  66. Connolly, R. (2020). Why computing belongs within the social sciences. Communications of the ACM, 63(8), 54--59. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Jackson, L. F., Kuhlman, C., Jackson, F. L., & Fox, K. (2019). Including Vulnerable Populations in the Assessment of Data From Vulnerable Populations. Frontiers in Big Data, 2, 19.Google ScholarGoogle ScholarCross RefCross Ref
  68. Gangadharan, S. P., Eubanks, V., & Barocas, S. (2014). Data and discrimination: Collected essays. Open Technology.Google ScholarGoogle Scholar
  69. D'Ignazio, C., & Klein, L. F. (2020). Data feminism. MIT Press.Google ScholarGoogle ScholarCross RefCross Ref
  70. Galston, W. A. (2020). Is Seeing Still Believing? The Deepfake Challenge to Truth in Politics. Brookings. January, 8.Google ScholarGoogle Scholar
  71. Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447--453.Google ScholarGoogle Scholar
  72. Benjamin, R. (2019). Assessing risk, automating racism. Science, 366(6464), 421--422.Google ScholarGoogle ScholarCross RefCross Ref
  73. Munn, N. (2018). This predictive policing company compares its software to "Broken Windows' policing. Vice. Available at: https://www. vice. com/en_us/article/d3k5pv/predpol-predictive-policing-broken-windows-theory-chicago-lucy-parsons (Accessed 15 May 2019).Google ScholarGoogle Scholar
  74. Kitchin, R., Cardullo, P., & Di Feliciantonio, C. (2019). Citizenship, justice, and the right to the smart city. In The right to the smart city. Emerald Publishing Limited.Google ScholarGoogle ScholarCross RefCross Ref
  75. Van Zoonen, L. (2016). Privacy concerns in smart cities. Government Information Quarterly, 33(3), 472--480.Google ScholarGoogle Scholar
  76. Harcourt, B. E., & Ludwig, J. (2006). Broken windows: New evidence from New York City and a five-city social experiment. U. Chi. L. Rev., 73, 271.Google ScholarGoogle Scholar
  77. Hao, K. (2019). AI is sending people to jail-and getting it wrong. Technology Review, 21.Google ScholarGoogle Scholar
  78. Gillis, T. B., & Spiess, J. L. (2019). Big data and discrimination. The University of Chicago Law Review, 86(2), 459--488.Google ScholarGoogle Scholar
  79. Crawford, K. (2016). Artificial intelligence's white guy problem. The New York Times, 25(06).Google ScholarGoogle Scholar
  80. Garvie, C., & Frankle, J. (2016). Facial-recognition software might have a racial bias problem. The Atlantic, 7.Google ScholarGoogle Scholar
  81. Chesney, R., & Citron, D. (2019). Deepfakes and the new disinformation war: The coming age of post-truth geopolitics. Foreign Aff., 98, 147.Google ScholarGoogle Scholar
  82. Noble, S. U. (2013). Google search: Hyper-visibility as a means of rendering black women and girls invisible. InVisible Culture, (19).Google ScholarGoogle Scholar
  83. Smith, H. (2020). Algorithmic bias: should students pay the price?. AI & society, 35(4), 1077--1078.Google ScholarGoogle Scholar
  84. Adams, R., & McIntyre, N. (2020). England A-level downgrades hit pupils from disadvantaged areas hardest. The Guardian. https://www. theguardian. com/education/2020/aug/13/england-a-level-downgrades-hit-pupils-from-disadvantaged-areas-hardest#. Accessed, 17.Google ScholarGoogle Scholar
  85. Monroe-White, T., Marshall, B. & Contreras-Palacios, H. (2021, February). "Waking up to Marginalization: Public Value Failures in Artificial Intelligence and Data Science." In Proceedings of the 2021 AAAI Workshop on Diversity in Artificial Intelligence.Google ScholarGoogle Scholar
  86. Monroe-White, T., & Marshall, B. (2019, December). "Data Science Intelligence: Mitigating Public Value Failures Using PAIR Principles" Proceedings of the 2019 Pre-ICIS SIGDSA Symposium. 4. https://aisel.aisnet.org/sigdsa2019/4Google ScholarGoogle Scholar
  87. Bozeman, B. (2002). Public-value failure: When efficient markets may not do. Public administration review, 62(2), 145--161.Google ScholarGoogle Scholar
  88. Berman, F., Rutenbar, R., Hailpern, B., Christensen, H., Davidson, S., Estrin, D., Franklin, M., Martonosi, M., Raghavan, P., Stodden, S., and Szalay, A. S. 2018. "Realizing the Potential of Data Science," Communications of the ACM, (61:4), pp. 67--72 (doi: 10.1145/3188721). Google ScholarGoogle ScholarDigital LibraryDigital Library
  89. Benjamin, R. (2019). Race after technology: Abolitionist tools for the new Jim Code. Cambridge, Polity.Google ScholarGoogle Scholar
  90. Zuberi, T., & Bonilla-Silva, E. (Eds.). (2008). White logic, white methods: Racism and methodology. Rowman & Littlefield Publishers.Google ScholarGoogle Scholar
  91. Krishnan, L., Ogunwole, S. M., & Cooper, L. A. (2020). Historical Insights on Coronavirus Disease 2019 (COVID-19), the 1918 Influenza Pandemic, and Racial Disparities: Illuminating a Path Forward. Annals of Internal Medicine.Google ScholarGoogle ScholarCross RefCross Ref
  92. Castillo-Montoya, M., Abreu, J., & Abad, A. (2019). Racially liberatory pedagogy: a Black Lives Matter approach to education. International Journal of Qualitative Studies in Education, 32(9), 1125--1145.Google ScholarGoogle ScholarCross RefCross Ref
  93. Johnson, A., & Elliott, S. (2020). Culturally Relevant Pedagogy: A Model To Guide Cultural Transformation in STEM Departments. Journal of microbiology & biology education, 21(1), 21.1.35. https://doi.org/10.1128/jmbe.v21i1.2097Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Emancipatory Data Science: A Liberatory Framework for Mitigating Data Harms and Fostering Social Transformation

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          SIGMIS-CPR'21: Proceedings of the 2021 on Computers and People Research Conference
          June 2021
          104 pages
          ISBN:9781450384063
          DOI:10.1145/3458026

          Copyright © 2021 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 29 June 2021

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate300of480submissions,63%

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader