Skip to main content

Evaluation of a Virtual Reality Simulation Tool for Studying Bias in Police-Civilian Interactions

  • Conference paper
  • First Online:
Augmented Cognition (HCII 2021)

Abstract

Racial inequities in police use of force has led scholars and policy makers to pursue ways to explain and reduce this gap. Many point to implicit bias in policing as a key driver in this disparity. However, there is limited evidence linking implicit cognitions and differences in behaviors. We argue that difficulties associated with recreating life-like situations with adequate experimental control in research settings designed to measure discriminatory behaviors obscure the relationship between implicit bias and behavior in policing. To address this, we rely on virtual reality to create experimental settings that better mimic officers’ experiences in the field. We evaluate the effectiveness of such a VR system in recognizing officers’ speech and correctly categorizing them. We find modest accuracy in both speech recognition and affective coding. However, the system has a significant and positive association with human generated codes for all but the most egregious cases of incorrect speech recognition. In quantifying and assessing the system’s effectiveness, we demonstrate VR’s potential in studying bias in policing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Nosek, B.A., Greenwald, A.G., Banaji, M.R.: The implicit association test at age 7: a methodological and conceptual review. In: Bargh, J.A. (ed.) Automatic Processes in Social Thinking and Behavior, pp. 265–292. Psychology Press (2007)

    Google Scholar 

  2. Kester, J.D.: A revolution in social psychology. APS Observer 14 (2001). http://www.psychologicalscience.org/observer/0701/family.html

  3. Egloff, B., Schmukle, S.C.: Predictive validity of an implicit association test for assessing anxiety. J. Pers. Soc. Psychol. 83(6), 1441–1455 (2002)

    Article  Google Scholar 

  4. Greenwald, A.G., Banaji, M.R., Nosek, B.A.: Statistically small effects of the Implicit Association Test can have societally large effects. J. Pers. Soc. Psychol. 108, 553–561 (2015)

    Article  Google Scholar 

  5. Singal, J.: Psychology’s favorite tool for measuring racism isn’t up to the job. The Cut (2017). https://www.thecut.com/2017/01/psychologys-racism-measuring-tool-isnt-up-to-thejob.html

  6. List, J.A.: Field experiments: a bridge between lab and naturally occurring data. B.E. J. Econ. Anal. Policy 5, 1–47 (2007)

    Google Scholar 

  7. President’s Task Force on 21st Century Policing: Final Report of the President’s Task Force on 21st Century Policing. Office of Community Oriented Policing Services, Washington, DC (2015)

    Google Scholar 

  8. Feagin, J.R.: Racist America: Roots, Current Realities, and Future Reparations, 2nd edn. Taylor & Francis Group, New York (2010)

    Book  Google Scholar 

  9. Davenport, C., Soule, S.A., Armstrong, D.A.: Protesting while black? The differential policing of American activism, 1960 to 1990. Am. Sociol. Rev. 76(1), 152–178 (2011)

    Article  Google Scholar 

  10. Ray, R.: “If only he didn’t wear the hoodie…” selective perception and stereotype maintenance. In: McClure, S., Harris, C. (eds.) Getting Real about Race: Hoodies, Mascots, Model Minorities, and Other Conversations, pp. 81–93. Sage, Los Angeles (2015)

    Google Scholar 

  11. Ray, R., Marsh, K., Powelson, C.: Can cameras stop the killings? Racial differences in perceptions of the effectiveness of body-worn cameras in police encounters. Sociol. Forum 32, 1032–1050 (2017)

    Article  Google Scholar 

  12. Oliver, M.B.: African American men as “criminal and dangerous”: implications of media portrayals of crime on the “criminalization” of African American men. J. Afr. Am. Stud. 7(2), 3–18 (2003)

    Article  Google Scholar 

  13. Eberhardt, J.L., Goff, P.A., Purdie, V.J., Davies, P.G.: Seeing black: race, crime, and visual processing. J. Pers. Soc. Psychol. 87(6), 876–893 (2004)

    Article  Google Scholar 

  14. Correll, J., Urland, G.R., Ito, T.A.: Event-related potentials and the decision to shoot: the role of threat perception and cognitive control. J. Exp. Soc. Psychol. 42, 120–128 (2006)

    Article  Google Scholar 

  15. Trawalter, S., Todd, A.R., Baird, A.A., Richeson, J.A.: Attending to threat: race-based patterns of selective attention. J. Exp. Soc. Psychol. 44, 1322–1327 (2008)

    Article  Google Scholar 

  16. McConnaughy, C.M., White, I.K.: Racial politics complicated: the work of gendered race cues in American politics. In: New Research on Gender in Political Psychology Conference (2011)

    Google Scholar 

  17. Krieger, N., Kiang, M.V., Chen, J.T., Waterman, P.D.: Trends in US deaths due to legal intervention among black and white men, age 15–34 years, by county income level: 1960–2010. Harvard Public Heal Rev. 3, 1–5 (2015)

    Google Scholar 

  18. Gilbert, K., Ray, R.: Why police kill black males with impunity: applying critical race and public health theory to address determinants of policing behaviors and the justifiable homicides of black men. J. Urban Health 93(1), 122–140 (2016)

    Article  Google Scholar 

  19. Brown, K.R.: The Color of Crime: Racial Hoaxes, White Fear, Black Protectionism, Police Harassment, and Other Macroaggressions, 2nd edn. New York University Press, New York (2008)

    Google Scholar 

  20. Gabrielson, R., Jones, R.G., Sagara, E.: Deadly force in black and white: a ProPublica analysis of killings by police shows outsize risk for young black males. ProPublica: Journalism in the Public Interest (2015)

    Google Scholar 

  21. Entman, R.M., Rojecki, A.: The Black Image in the White Mind: Media and Race in America. University of Chicago Press, Chicago (2000)

    Google Scholar 

  22. Krupanski, M., Park, A.R., Melodia, L.: Racial disparity in NYPD stops-and-frisks: the center for constitutional rights preliminary report on UF-250 data obtained for 2005 through June 2008 (2009). http://ccrjustice.org/sites/default/files/assets/Report-CCR-NYPD-Stop-andFrisk_3.pdf

  23. Repetto, C., Serino, S., Macedonia, M., Riva, G.: Virtual reality as an embodied tool to enhance episodic memory in elderly. Front. Psychol. 7, 1839 (2016)

    Article  Google Scholar 

  24. Barsalou, L.W.: Grounded cognition. Annu. Rev. Psychol. 59, 617–645 (2008)

    Article  Google Scholar 

  25. Shapiro, L.: Embodied Cognition. Routledge (2010). ISBN 978-0415773423

    Google Scholar 

  26. James, L.: The stability of implicit racial bias in police officers. Police Q. 21, 30–52 (2017). https://doi.org/10.1177/1098611117732974

    Article  Google Scholar 

  27. Voigt, R., et al.: Language from police body camera footage shows racial disparities in officer respect. Proc. Natl. Acad. Sci. 114, 6521–6526 (2017)

    Article  Google Scholar 

  28. Pennebaker, J.W., Booth, R.J., Boyd, R.L., Francis, M.E.: Linguistic inquiry and word count: LIWC 2015. Pennebaker Conglomerates, Austin (2015). www.LIWC.net

  29. Sklansky, D.A.: Not your father’s police department: making sense of the new demographics of law enforcement. J. Crim. Law Criminol. 96, 1209–1244 (2005)

    Google Scholar 

  30. Henry, P.J., Sears, D.O.: The symbolic racism 2000 scale. Polit. Psychol. 23(2), 253–283 (2002)

    Article  Google Scholar 

  31. Greenwald, A.G., Andrew Poehlman, T., Uhlmann, E.L., Banaji, M.R.: Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity. J. Pers. Soc. Psychol. 97, 17–41 (2009)

    Article  Google Scholar 

  32. Nelson, L.K., Burk, D., Knudsen, M., McCall, L.: The future of coding: a comparison of hand-coding and three types of computer-assisted text analysis methods. Sociol. Methods Res. 50(1), 202–237 (2021)

    Article  MathSciNet  Google Scholar 

  33. Arumugam, D., Karamcheti, S., Gopalan, N., Wong, L.L., Tellex, S.: Accurately and efficiently interpreting human-robot instructions of varying granularities. arXiv preprint arXiv:1704.06616 (2017)

  34. Morris, A.C., Maier, V., Green, P.: From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition. In: Eighth International Conference on Spoken Language Processing (2004)

    Google Scholar 

  35. Vaessen, N.: JiWER: similarity measures for automatic speech recognition evaluation (2021). https://pypi.org/project/jiwer/

  36. Peer, E., Brandimarte, L., Samat, S., Acquisti, A.: Beyond the Turk: alternative platforms for crowdsourcing behavioral research. J. Exp. Soc. Psychol. 70, 153–163 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

We thank David Johnson and Robert Koulish for contributions to the early design of the project. We also thank Clayton Buck, Racheli Cohen, Ellie Pokress, Nick Provenzano, Michael Ros, Wanda Segura Acevedo, and Olivia Sharon for excellent research assistance. This research was approved by the University of Maryland Institutional Review Board protocol no. 1363074.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Long Doan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Doan, L. et al. (2021). Evaluation of a Virtual Reality Simulation Tool for Studying Bias in Police-Civilian Interactions. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2021. Lecture Notes in Computer Science(), vol 12776. Springer, Cham. https://doi.org/10.1007/978-3-030-78114-9_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78114-9_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78113-2

  • Online ISBN: 978-3-030-78114-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics