Wenqi Zheng
Douglas Zytko
ABSTRACT
Sexual risk detection AI has been touted as a scalable solution for computer-mediated sexual violence. Data donation is a user-centered approach to producing ecologically valid datasets for sexual risk detection AI: voluntarily providing personal data that is representative of risk. However, the act of donating intimate sexual experience data can itself be traumatizing. We propose Ube: a trauma-informed sexual experience data donation app for online daters that is developed jointly with sexual violence experts and care practitioners. Cognitive walkthroughs of Ube with these experts elucidated several design approaches to mitigate retraumatization during data donation, including a conversational agent and mental health checks.
- Christine E. Agaibi and John P. Wilson. 2005. Trauma, PTSD, and Resilience: A Review of the Literature. Trauma, Violence, & Abuse 6, 3 (Jul 2005), 195–216. https://doi.org/10.1177/1524838005277438Google Scholar
Cross Ref
- National Crime Agency. 2016. Emerging new threat in online dating: Initial trends in internet dating-initiated serious sexual assaults.Google Scholar
- Shiza Ali, Afsaneh Razi, Seunghyun Kim, Ashwaq Alsoubai, Joshua Gracie, Munmun De Choudhury, Pamela J. Wisniewski, and Gianluca Stringhini. 2022. Understanding the Digital Lives of Youth: Analyzing Media Shared within Safe Versus Unsafe Private Conversations on Instagram. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 148, 14 pages. https://doi.org/10.1145/3491102.3501969Google ScholarDigital Library
- Ashwaq Alsoubai, Xavier V. Caddle, Ryan Doherty, Alexandra Taylor Koehler, Estefania Sanchez, Munmun De Choudhury, and Pamela J. Wisniewski. 2022. MOSafely, Is That Sus? A Youth-Centric Online Risk Assessment Dashboard. In Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing (Virtual Event, Taiwan) (CSCW’22 Companion). Association for Computing Machinery, New York, NY, USA, 197–200. https://doi.org/10.1145/3500868.3559710Google ScholarDigital Library
- Philip Anderson, Zheming Zuo, Longzhi Yang, and Yanpeng Qu. 2019. An Intelligent Online Grooming Detection System Using AI Technologies. In 2019 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). 1–6. https://doi.org/10.1109/FUZZ-IEEE.2019.8858973Google ScholarDigital Library
- Karla Badillo-Urquiola, Zachary Shea, Zainab Agha, Irina Lediaeva, and Pamela Wisniewski. 2021. Conducting Risky Research with Teens: Co-Designing for the Ethical Treatment and Protection of Adolescents. Proc. ACM Hum.-Comput. Interact. 4, CSCW3, Article 231 (jan 2021), 46 pages. https://doi.org/10.1145/3432930Google ScholarDigital Library
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (Apr 2006), 77–101. https://doi.org/10.1191/1478088706qp063oaGoogle ScholarCross Ref
- Rebecca Campbell, Rachael Goodman-Williams, and McKenzie Javorka. 2019. A Trauma-Informed Approach to Sexual Violence Research Ethics and Open Science. Journal of Interpersonal Violence 34, 23-24 (2019), 4765–4793. https://doi.org/10.1177/0886260519871530 arXiv:https://doi.org/10.1177/0886260519871530PMID: 31514606.Google ScholarCross Ref
- Robey B. Champine, Jason M. Lang, Ashley M. Nelson, Rochelle F. Hanson, and Jacob K. Tebes. 2019. Systems Measures of a Trauma-Informed Approach: A Systematic Review. American Journal of Community Psychology 64, 3–4 (2019), 418–437. https://doi.org/10.1002/ajcp.12388Google ScholarCross Ref
- Janet X. Chen, Allison McDonald, Yixin Zou, Emily Tseng, Kevin A Roundy, Acar Tamersoy, Florian Schaub, Thomas Ristenpart, and Nicola Dell. 2022. Trauma-Informed Computing: Towards Safer Technology Experiences For All. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 544, 20 pages. https://doi.org/10.1145/3491102.3517475Google ScholarDigital Library
- Eric Filice, Kavishka D. Abeywickrama, Diana C. Parry, and Corey W. Johnson. 2022. Sexual violence and abuse in online dating: A scoping review. Aggression and Violent Behavior 67 (Nov 2022), 101781. https://doi.org/10.1016/j.avb.2022.101781Google ScholarCross Ref
- Alejandra Gomez Ortega, Jacky Bourgeois, and Gerd Kortuem. 2022. Reconstructing Intimate Contexts through Data Donation: A Case Study in Menstrual Tracking Technologies. In Nordic Human-Computer Interaction Conference (Aarhus, Denmark) (NordiCHI ’22). Association for Computing Machinery, New York, NY, USA, Article 8, 12 pages. https://doi.org/10.1145/3546155.3546646Google ScholarDigital Library
- Eva Heim, Thanos Karatzias, and Andreas Maercker. 2022. Cultural concepts of distress and complex PTSD: Future directions for research and treatment. Clinical Psychology Review 93 (Apr 2022), 102143. https://doi.org/10.1016/j.cpr.2022.102143Google ScholarCross Ref
- Nicola Henry, Asher Flynn, and Anastasia Powell. 2020. Technology-Facilitated Domestic and Sexual Violence: A Review. Violence Against Women 26, 15–16 (Dec 2020), 1828–1854. https://doi.org/10.1177/1077801219875821Google ScholarCross Ref
- Larke N Huang, Rebecca Flatow, Tenly Biggs, Sara Afayee, Kelley Smith, Thomas Clark, and Mary Blake. 2014. SAMHSA’s Concept of Truama and Guidance for a Trauma-Informed Approach. (2014).Google Scholar
- Younes Karimi, Anna Squicciarini, and Shomir Wilson. 2022. Automated Detection of Doxing on Twitter. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 276 (nov 2022), 24 pages. https://doi.org/10.1145/3555167Google ScholarDigital Library
- David Leimstädtner, Peter Sörries, and Claudia Müller-Birn. 2022. Unfolding Values through Systematic Guidance: Conducting a Value-Centered Participatory Workshop for a Patient-Oriented Data Donation. In Proceedings of Mensch Und Computer 2022 (Darmstadt, Germany) (MuC ’22). Association for Computing Machinery, New York, NY, USA, 477–482. https://doi.org/10.1145/3543758.3547560Google ScholarDigital Library
- Laura J. Long. 2022. Hope and PTSD. Current Opinion in Psychology 48 (Dec 2022), 101472. https://doi.org/10.1016/j.copsyc.2022.101472Google ScholarCross Ref
- Donna Maguire and James Taylor. 2019. A Systematic Review on Implementing Education and Training on Trauma-Informed Care to Nurses in Forensic Mental Health Settings. Journal of Forensic Nursing 15, 4 (Oct 2019), 242–249. https://doi.org/10.1097/JFN.0000000000000262Google ScholarCross Ref
- Afsaneh Razi, Ashwaq Alsoubai, Seunghyun Kim, Shiza Ali, Gianluca Stringhini, Munmun De Choudhury, and Pamela J. Wisniewski. 2023. Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of Youth. Proc. ACM Hum.-Comput. Interact. 7, CSCW1, Article 89 (apr 2023), 29 pages. https://doi.org/10.1145/3579522Google ScholarDigital Library
- Afsaneh Razi, Ashwaq Alsoubai, Seunghyun Kim, Nurun Naher, Shiza Ali, Gianluca Stringhini, Munmun De Choudhury, and Pamela J. Wisniewski. 2022. Instagram Data Donation: A Case Study on Collecting Ecologically Valid Social Media Data for the Purpose of Adolescent Online Risk Detection. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 39, 9 pages. https://doi.org/10.1145/3491101.3503569Google ScholarDigital Library
- Afsaneh Razi, Seunghyun Kim, Ashwaq Alsoubai, Gianluca Stringhini, Thamar Solorio, Munmun De Choudhury, and Pamela J. Wisniewski. 2021. A Human-Centered Systematic Literature Review of the Computational Approaches for Online Sexual Risk Detection. Proc. ACM Hum.-Comput. Interact. 5, CSCW2, Article 465 (oct 2021), 38 pages. https://doi.org/10.1145/3479609Google ScholarDigital Library
- Elizabeth Reeves. 2015. A Synthesis of the Literature on Trauma-Informed Care. Issues in Mental Health Nursing 36, 9 (Sep 2015), 698–709. https://doi.org/10.3109/01612840.2015.1025319Google ScholarCross Ref
- Mary Beth Rosson and John M Carroll. 2009. Scenario-based design. In Human-computer interaction. CRC Press, 161–180.Google Scholar
- Carol F Scott, Gabriela Marcu, Riana Elyse Anderson, Mark W Newman, and Sarita Schoenebeck. 2023. Trauma-Informed Social Media: Towards Solutions for Reducing and Healing Online Harm. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 341, 20 pages. https://doi.org/10.1145/3544548.3581512Google ScholarDigital Library
- Rick Spencer. 2000. The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, The Hague The Netherlands, 353–359. https://doi.org/10.1145/332040.332456Google ScholarDigital Library
- Muhammad Uzair Tariq, Afsaneh Razi, Karla Badillo-Urquiola, and Pamela Wisniewski. 2019. A Review of the Gaps and Opportunities of Nudity and Skin Detection Algorithmic Research for the Purpose of Combating Adolescent Sexting Behaviors. In Human-Computer Interaction. Design Practice in Contemporary Societies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 90–108.Google Scholar
- Douglas Zytko, Nicholas Furlo, Bailey Carlin, and Matthew Archer. 2021. Computer-Mediated Consent to Sex: The Context of Tinder. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 189 (apr 2021), 26 pages. https://doi.org/10.1145/3449288Google ScholarDigital Library
Index Terms
- Towards Trauma-Informed Data Donation of Sexual Experience in Online Dating to Improve Sexual Risk Detection AI
Recommendations
Repurposing AI in Dating Apps to Augment Women’s Strategies for Assessing Risk of Harm
CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social ComputingIn this paper we present emerging findings from an interview study with women in North America about how AI could be designed to prevent online dating-facilitated violence by augmenting their strategies for risk awareness. The study is motivated by ...
Online Dating as Context to Design Sexual Consent Technology with Women and LGBTQ+ Stakeholders
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsThis paper uses online dating as a context to explore futures for sexual consent technology: systems that mediate how partners exchange consent in order to prevent nonconsensual sex. Motivated by evidence that sexual consent is already mediated by ...
Online sexual activities
Involvement in online sexual activities (OSAs) is ubiquitous, especially in males, and can under certain circumstances become problematic. The risk factors associated with problematic OSAs remain, however, poorly explored. The current study aimed to ...
Comments