UnMute Toolkit: Speech Interactions Designed With Minoritised Language Speakers
Authors: 
Thomas Reitmaier, 
Electra Wallington, Ondrej Klejch, Dani Kalarikalayil Raju, Nina Markl, 
Emily Esther Nielsen, 
Gavin Bailey, 
Jennifer Pearson, 
Matt Jones, Peter Bell, 
Simon RobinsonAuthors Info & Claims
Thomas Reitmaier, Electra Wallington, Ondrej Klejch, Dani Kalarikalayil Raju, Nina Markl, Emily Esther Nielsen, Gavin Bailey, Jennifer Pearson, Matt Jones, Peter Bell, Simon RobinsonAuthors Info & ClaimsArticle No.: 56, Pages 1 - 6
Abstract
In this paper and interactive exhibit we demonstrate a portfolio of systems and approaches that progressively vary on the theme of co-creating and situating spoken-language technologies to suit the needs, functions, and ways of speaking of diverse, resource-constrained, and under-heard language communities in South Africa and India. These systems demonstrate the benefits of human-centred machine learning methodologies and showcase how language technologies and conversational systems can broaden digital participation of minoritised language communities.
References
[1]
Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyoti, Sunayana Sitaram, and Vivek Seshadri. 2020. Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 2819–2826.
[2]
E. Barnard, M. H. Davel, C. Van Heerden, Febe De Wet, and J. Badenhorst. 2014. The NCHLT Speech Corpus of the South African Languages. In 4th International Workshop on Spoken Language Technologies for Under-Resourced Languages. St Petersburg, Russia.
[3]
Steven Bird and Dean Yibarbuk. 2024. Centering the Speech Community. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), Yvette Graham and Matthew Purver (Eds.). Association for Computational Linguistics, St. Julian’s, Malta, 826–839.
[4]
J. J. Roy Burman. 2010. Ethnography of a Denotified Tribe: The Laman Banjara. Mittal Publications.
[5]
Kate Crawford. 2021. Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence. Yale University Press, New Haven.
[6]
Indra de Lanerolle, Marion Walton, and Alette Schoon. 2017. Izolo: Mobile Diaries of the Less Connected. The Institute of Development Studies, Brighton.
[7]
Ana Deumert. 2010. Imbodela Zamakhumsha – Reflections on Standardization and Destandardization. 29, 3-4 (Nov. 2010), 243–264. https://doi.org/10.1515/mult.2010.012
[8]
Devanuj and Anirudha Joshi. 2013. Technology Adoption by ’Emergent’ Users: The User-usage Model. In Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction(APCHI ’13). ACM, New York, NY, USA, 28–38. https://doi.org/10.1145/2525194.2525209
[9]
Rosalie Finlayson, Karen Calteaux, and Carol Myers-Scotton. 1998. Orderly Mixing and Accommodation in South African Codeswitching. Journal of Sociolinguistics 2, 3 (1998), 395–420. https://doi.org/10.1111/1467-9481.00052
[10]
Thomas Reitmaier, Electra Wallington, Dani Kalarikalayil Raju, Ondrej Klejch, Jennifer Pearson, Matt Jones, Peter Bell, and Simon Robinson. 2022. Opportunities and Challenges of Automatic Speech Recognition Systems for Low-Resource Language Speakers. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3491102.3517639
[11]
Thomas Reitmaier, Electra Wallington, Ondřej Klejch, Nina Markl, Lea-Marie Lam-Yee-Mui, Jennifer Pearson, Matt Jones, Peter Bell, and Simon Robinson. 2023. Situating Automatic Speech Recognition Development within Communities of Under-heard Language Speakers. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3491102.3517639
[12]
William Seymour, Xiao Zhan, Mark Cote, and Jose Such. 2023. Who Are CUIs Really For? Representation and Accessibility in the Conversational User Interface Literature. In Proceedings of the 5th International Conference on Conversational User Interfaces(CUI ’23). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3571884.3603760
[13]
Aditya Vashistha, Pooja Sethi, and Richard Anderson. 2017. Respeak: A Voice-based, Crowd-powered Speech Transcription System. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1855–1866.
[14]
Marion Walton. 2014. Pavement Internet: Mobile Media Economies and Ecologies for Young People in South Africa. In The Routledge Companion to Mobile Media, G. Goggin and Larissa Hjorth (Eds.). Routledge, London, UK.
Index Terms
- UnMute Toolkit: Speech Interactions Designed With Minoritised Language Speakers
Recommendations
Opportunities and Challenges of Automatic Speech Recognition Systems for Low-Resource Language Speakers
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsAutomatic Speech Recognition (ASR) researchers are turning their attention towards supporting low-resource languages, such as isiXhosa or Marathi, with only limited training resources. We report and reflect on collaborative research across ASR & HCI to ...
Cultivating Spoken Language Technologies for Unwritten Languages
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing SystemsWe report on community-centered, collaborative research that weaves together HCI, natural language processing, linguistic, and design insights to develop spoken language technologies for unwritten languages. Across three visits to a Banjara farming ...
Speech-Input Speech-Output Communication for Dysarthric Speakers Using HMM-Based Speech Recognition and Adaptive Synthesis System
Dysarthria is a motor speech disorder that causes inability to control and coordinate one or more articulators. This makes it difficult for a dysarthric speaker to utter certain speech sound units, thereby producing poorly articulated, slurred, and ...
Comments
Information & Contributors
Information
Published In
July 2024
616 pages
ISBN:9798400705113
DOI:10.1145/3640794
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 July 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Funding Sources
- Engineering and Physical Sciences Research Council
- Responsible AI
Conference
CUI '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 34 of 100 submissions, 34%
Upcoming Conference
CUI '25
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 70Total Downloads
- Downloads (Last 12 months)70
- Downloads (Last 6 weeks)21
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format