Jennifer Nwogu
Angela E.B. Stewart
ABSTRACT
The intersection of language and identity refers to the ways in which language use reflects and shapes one's sense of self and group membership. It is important to design voice-based technologies that represent and support diverse types of identities to increase accessibility. Due to constraints in the data and algorithms used to train and improve artificial intelligence (AI) systems like social robots or voice assistants, they are often unable to represent certain dialects of English and other languages. This could result in data bias, identity exclusion, and communication barriers that can impact the user's outcomes when using such dialects. Technology companies are discussing how to close this gap by improving training data; however, some researchers believe that the intersection of identity and technology calls for effective collaborative design methodologies that involve intended users. This work-in-progress paper presents preliminary findings on a participatory design method, comic-boarding, that can accomplish the above goal. Using comic-boarding, our intention is to create a space for critical reflection on language and identity in human-human and human-agent dialogue for children from marginalized communities.
- Bannon, Liam, Jeffrey Bardzell, and Susanne Bødker. "Introduction: Reimagining participatory design—Emerging voices." ACM Transactions on Computer-Human Interaction (TOCHI) 25.1 (2018): 1-8. Google Scholar
Digital Library
- Beelen, Thomas, "Designing Conversational Robots with Children during the Pandemic." arXiv preprint arXiv:2205.11300 (2022). Google Scholar
- Beirl, Diana, Y. Rogers, and Nicola Yuill. "Using voice assistant skills in family life." Computer-Supported Collaborative Learning Conference, CSCL. Vol. 1. International Society of the Learning Sciences, Inc., 2019. Google Scholar
- Benner, Dennis, "What do you mean? a review on recovery strategies to overcome conversational breakdowns of conversational agents." International Conference on Information Systems (ICIS). 2021. Google Scholar
- Blodgett, Su Lin, and Brendan O'Connor. "Racial disparity in natural language processing: A case study of social media african-american english." arXiv preprint arXiv:1707.00061 (2017). Google Scholar
- Harrington, Christina N., "“It's Kind of Like Code-Switching”: Black Older Adults’ Experiences with a Voice Assistant for Health Information Seeking." CHI Conference on Human Factors in Computing Systems. 2022. Google ScholarDigital Library
- D. Harwell, B. Mayes, M. Walls, S. Hashemi, The accent gap. The Washington Post, 19 July 2018. https://www.washingtonpost.com/graphics/2018/business/alexa-does-not-understand-your-accent/. Accessed 3 March 2023. Google Scholar
- Hussain, Sofia. "Empowering marginalized children in developing countries through participatory design processes." CoDesign 6.2 (2010): 99-117. Google ScholarCross Ref
- Iversen, Ole Sejer, Rachel Charlotte Smith, and Christian Dindler. "Child as protagonist: Expanding the role of children in participatory design." Proceedings of the 2017 conference on interaction design and children. 2017. Google Scholar
- Kitashov, Fedor, Elizaveta Svitanko, and Debojyoti Dutta. "Foreign English accent adjustment by learning phonetic patterns." arXiv preprint arXiv:1807.03625 (2018). Google Scholar
- Knapp, Melanie Hines. "African American Vernacular English (AAVE) In The Classroom: The Attitudes And Ideologies Of Urban Educators Toward AAVE." (2015). Google Scholar
- Koenecke, Allison, "Racial disparities in automated speech recognition." Proceedings of the National Academy of Sciences 117.14 (2020): 7684- 7689. Google ScholarCross Ref
- Koch, Lisa M., Alan M. Gross, and Russell Kolts. "Attitudes toward Black English and code switching." Journal of Black psychology 27.1 (2001): 29- 42. Google ScholarCross Ref
- Lambeens, Tom, and Kris Pint. "12 The Interaction of Image and Text in Modern Comics." Texts, Transmissions, Receptions. Brill, 2015. 240-257. Google Scholar
- Li, Yinmiao, "“I Want to Be Unique From Other Robots”: Positioning Girls as Co-creators of Social Robots in Culturally-Responsive Computing Education." Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 2023. Google ScholarDigital Library
- Moraveji, Neema, "comic-boarding: using comics as proxies for participatory design with children." Proceedings of the SIGCHI conference on Human factors in computing systems. 2007. Google Scholar
- Om, Chimi. Designing interactive technologies to enhance nature engagement for children in urban Bhutan. Diss. Queensland University of Technology, 2022. Google Scholar
- Powell, Denise, "The telling board: an interactive storyboarding tool for children." Proceedings of the 17th ACM conference on interaction design and children. 2018. Google Scholar
- Read, Janet C., Daniel Fitton, and Matthew Horton. "Theatre, playdoh and comic strips: designing organic user interfaces with young adolescent and teenage participants." Interacting with Computers 25.2 (2013): 183-198. Google ScholarCross Ref
- Read, Janet C., Daniel Fitton, and Matthew Horton. "Giving ideas an equal chance: inclusion and representation in participatory design with children." Proceedings of the 2014 conference on Interaction design and children. 2014. Google Scholar
- Rose, Emma J., and Elin A. Björling. "Designing for engagement: using participatory design to develop a social robot to measure teen stress." Proceedings of the 35th ACM International Conference on the Design of Communication. 2017. Google ScholarDigital Library
- Saad-Sulonen, Joanna, "Unfolding participation over time: temporal lenses in participatory design." CoDesign 14.1 (2018): 4-16. Google ScholarCross Ref
- Terzopoulos, George, and Maya Satratzemi. "Voice assistants and smart speakers in everyday life and in education." Informatics in Education 19.3 (2020): 473-490. Google ScholarCross Ref
- Walsh, Greg, "Layered elaboration: a new technique for co-design with children." Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2010. Google Scholar
Index Terms
- Comic-boarding with Children: Understanding the use of Language in Human-Human and Human-Agent Dialogue
Recommendations
Training a Dialogue Act Tagger for human-human and human-computer travel dialogues
SIGDIAL '02: Proceedings of the 3rd SIGdial workshop on Discourse and dialogue - Volume 2While dialogue acts provide a useful schema for characterizing dialogue behaviors in human-computer and human-human dialogues, their utility is limited by the huge effort involved in hand-labelling dialogues with a dialogue act labelling scheme. In this ...
Route instructions in map-based human-human and human-computer dialogue: A comparative analysis
When conveying information about spatial situations and goals, speakers adapt flexibly to their addressee in order to reach the communicative goal efficiently and effortlessly. Our aim is to equip a dialogue system with the abilities required for such a ...
Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interactionIn this paper, we describe a project that explores a novel experimental setup towards building a spoken, multi-modally rich, and human-like multiparty tutoring robot. A human-robot interaction setup is designed, and a human-human dialogue corpus is ...
Comments