skip to main content
10.1145/2817721.2817723acmconferencesArticle/Chapter ViewAbstractPublication PagesissConference Proceedingsconference-collections
research-article

TalkingTiles: Supporting Personalization and Customization in an AAC App for Individuals with Aphasia

Published: 15 November 2015 Publication History

Abstract

The development of `Post-PC' interactive surfaces, such as smartphones and tablets, and specialized support software informed by HCI research has created new opportunities for Augmentative and Alternative Communication (AAC) technologies. However, it is unclear to what degree these opportunities have been realized in practice. We conducted a field study to explore the use of one such application, TalkingTiles, by individuals with aphasia. Following a training session and one week of use, we conducted interviews with participants, their partners, and their caregivers at a local support facility. We found that TalkingTiles can be effective in supporting communication when used in concert with other communication methods, and when time can be invested in customizing the app. We discuss our findings, and implications for design with respect to customizability, simplicity, and the limitations of interactive surfaces in supporting communication.

References

[1]
Abdullah Al Mahmud. 2014. Considerations for Designing Technology with and for Persons with Aphasia. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI '14). ACM, New York, NY, USA, 535--538.
[2]
Abdullah Al Mahmud and Jean-Bernard Martens. 2013. Amail: Design and evaluation of an accessible email tool for persons with aphasia. Interacting with Computers 25, 5 (2013), 351--374.
[3]
Meghan Allen, Joanna McGrenere, and Barbara Purves. 2008. The Field Evaluation of a Mobile Digital Image Communication Application Designed for People with Aphasia. ACM Trans. Access. Comput. 1, 1, Article 5 (May 2008), 26 pages.
[4]
David Frank Benson and Alfredo Ardila. 1996. Aphasia: A clinical perspective. Oxford University Press.
[5]
Jordan L. Boyd-Graber, Sonya S. Nikolova, Karyn A. Moffatt, Kenrick C. Kin, Joshua Y. Lee, Lester W. Mackey, Marilyn M. Tremaine, and Maria M. Klawe. 2006. Participatory Design with Proxies: Developing a desktop-PDA System to Support People with Aphasia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 151--160.
[6]
Tira Cohene, Ron Baecker, and Elsa Marziali. 2005. Designing Interactive Life Story Multimedia for a Family Affected by Alzheimer's Disease: A Case Study. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1300--1303.
[7]
Elke Daemen, Pavan Dadlani, Jia Du, Ying Li, Pinar Erik-Paker, Jean-Bernard Martens, and Boris De Ruyter. 2007. Designing a Free Style, Indirect, and Interactive Storytelling Application for People with Aphasia. In Proceedings of the 11th IFIP TC 13 International Conference on Human-computer Interaction (INTERACT'07). Springer-Verlag, Berlin, Heidelberg, 221--234. http: //dl.acm.org/citation.cfm?id=1776994.1777022
[8]
Laura Flynn, Ashlyn Cumberland, and Jane Marshall. 2009. Public knowledge about aphasia: A survey with comparative data. Aphasiology 23, 3 (2009), 393--401.
[9]
Audrey L Holland. 1998. Why can't clinicians talk to aphasic adults? Comments on supported conversation for adults with aphasia: Methods and resources for training conversational partners. Aphasiology 12, 9 (1998), 844--847.
[10]
Aura Kagan. 1998. Supported conversation for adults with aphasia: Methods and resources for training conversation partners. Aphasiology 12, 9 (1998), 816--830.
[11]
Shaun K. Kane, Barbara Linam-Church, Kyle Althoff, and Denise McCall. 2012. What We Talk About: Designing a Context-aware Communication Tool for People with Aphasia. In Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '12). ACM, New York, NY, USA, 49--56.
[12]
Tom Koppenol, Abdullah Al Mahmud, and Jean-Bernard Martens. 2010. When words fall short: helping people with aphasia to express. In Computers Helping People with Special Needs. Springer, 45--48.
[13]
Rajinder Koul, Melinda Corwin, and Summer Hayes. 2005. Production of graphic symbol sentences by individuals with aphasia: Efficacy of a computer-based augmentative and alternative communication intervention. Brain and language 92, 1 (2005), 58--77.
[14]
Stephen Lindsay, Katie Brittain, Daniel Jackson, Cassim Ladha, Karim Ladha, and Patrick Olivier. 2012. Empathy, Participatory Design and People with Dementia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 521--530.
[15]
Felice L Loverso, Marilyn Selinger, and Thomas E Prescott. 1979. Application of verbing strategies to aphasia treatment. (1979).
[16]
JG Lyon, D Cariski, L Keisler, J Rosenbek, R Levine, J Kumpula, C Ryff, S Coyne, and M Blanc. 1997. Communication partners: Enhancing participation in life and communication for adults with aphasia in natural settings. Aphasiology 11, 7 (1997), 693--708.
[17]
Xiaojuan Ma, Jordan Boyd-Graber, Sonya Nikolova, and Perry R. Cook. 2009. Speaking Through Pictures: Images vs. Icons. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '09). ACM, New York, NY, USA, 163--170.
[18]
Abdullah Al Mahmud, Yvonne Limpens, and Jean-Bernard Martens. 2013. Expressing Through Digital Photographs: An Assistive Tool for Persons with Aphasia. Univers. Access Inf. Soc. 12, 3 (Aug. 2013), 309--326.
[19]
Skye E McDonald, Chris Code, and Leanne Togher. 2000. Communication disorders following traumatic brain injury. Psychology press.
[20]
Hannah Miller, Heather Buhr, Chris Johnson, and Jerry Hoepner. 2013. AphasiaWeb: A Social Network for Individuals with Aphasia. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). ACM, New York, NY, USA, Article 4, 8 pages.
[21]
Palle Møller Pedersen, Kirsten Vinter, and Tom Skyhøj Olsen. 2004. Aphasia after stroke: type, severity and prognosis. The Copenhagen aphasia study. Cerebrovascular Diseases 17 (2004), 35--43.
[22]
Hildred Schuell, James J Jenkins, and Edward Jimenez-Pabon. 1964. Aphasia in adults. Harper & Row.
[23]
Nina Simmons-Mackie, Chris Code, Elizabeth Armstrong, Lillian Stiegler, and Roberta J Elman. 2002. What is aphasia? Results of an international survey. Aphasiology 16, 8 (2002), 837--848.
[24]
Richard D Steele, Michael Weinrich, Robert T Wertz, Maria K Kleczewska, and Gloria S Carlson. 1989. Computer-based visual communication in aphasia. Neuropsychologia 27, 4 (1989), 409--426.
[25]
Iosif Moiseevich Tonkonogii. 1986. Vascular aphasia. The MIT Press.
[26]
Maarten Woudstra, Abdullah Al Mahmud, and Jean-Bernard Martens. 2011. A Snapshot Diary to Support Conversational Storytelling for Persons with Aphasia. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '11). ACM, New York, NY, USA, 641--646.
[27]
Mike Wu, Jeremy Birnholtz, Brian Richards, Ronald Baecker, and Mike Massimi. 2008. Collaborating to Remember: A Distributed Cognition Account of Families Coping with Memory Impairments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 825--834.

Cited By

View all
  • (2022)Ability-Based Methods for Personalized Keyboard GenerationMultimodal Technologies and Interaction10.3390/mti60800676:8(67)Online publication date: 3-Aug-2022
  • (2021)Exploring A Reporting Tool to Empower Individuals with Intellectual and Developmental Disabilities to Self-Report AbuseProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445150(1-13)Online publication date: 6-May-2021
  • (2020)Who Are You Asking?: Qualitative Methods for Involving AAC Users as Primary Research ParticipantsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376883(1-13)Online publication date: 21-Apr-2020
  • Show More Cited By

Index Terms

  1. TalkingTiles: Supporting Personalization and Customization in an AAC App for Individuals with Aphasia

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces
    November 2015
    522 pages
    ISBN:9781450338998
    DOI:10.1145/2817721
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 November 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. aphasia
    2. augmentative and alternative communication

    Qualifiers

    • Research-article

    Funding Sources

    • NSERC

    Conference

    ITS '15
    Sponsor:
    ITS '15: Interactive Tabletops and Surfaces
    November 15 - 18, 2015
    Madeira, Portugal

    Acceptance Rates

    ITS '15 Paper Acceptance Rate 29 of 122 submissions, 24%;
    Overall Acceptance Rate 119 of 418 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)47
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Ability-Based Methods for Personalized Keyboard GenerationMultimodal Technologies and Interaction10.3390/mti60800676:8(67)Online publication date: 3-Aug-2022
    • (2021)Exploring A Reporting Tool to Empower Individuals with Intellectual and Developmental Disabilities to Self-Report AbuseProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445150(1-13)Online publication date: 6-May-2021
    • (2020)Who Are You Asking?: Qualitative Methods for Involving AAC Users as Primary Research ParticipantsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376883(1-13)Online publication date: 21-Apr-2020
    • (2020)Understanding AAC Usage and Needs through a Web Survey with Device Users and Families2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)10.1109/EMBC44109.2020.9176035(3864-3868)Online publication date: Jul-2020
    • (2020)End-user adaptable technologies for rehabilitation: a systematic literature reviewUniversal Access in the Information Society10.1007/s10209-020-00720-zOnline publication date: 6-Jun-2020
    • (2019)Supporting the Dialog of People With Intellectual Disabilities Through Augmentative and Alternative CommunicationIEEE Revista Iberoamericana de Tecnologias del Aprendizaje10.1109/RITA.2019.290971514:1(3-10)Online publication date: Feb-2019
    • (2016)Toward a Conversation Partner Agent for People with Aphasia: Assisting Word RetrievalIntelligent Decision Technologies 201610.1007/978-3-319-39630-9_17(203-213)Online publication date: 1-Jun-2016

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media