skip to main content
10.1145/3526114.3558702acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
poster

Early Usability Evaluation of a Relational Agent for the COVID-19 Pandemic

Authors Info & Claims
Published:28 October 2022Publication History

ABSTRACT

Relational agents (RAs) have shown effectiveness in various health interventions with and without healthcare professionals (HCPs) and hospital facilities. RAs have not been widely researched in COVID-19 context, although they can give health interventions during the pandemic. Addressing this gap, this work presents an early usability evaluation of a prototypical RA, which is iteratively designed and developed in collaboration with infected patients (n=21) and two groups of HCPs (n=19, n=16) to aid COVID-19 patients at various stages about four main tasks: testing guidance, support during self-isolation, handling emergency situations, and promoting post-infection mental well-being. The prototype obtained an average score of 58.82 on the system usability scale (SUS) after being evaluated by 98 people. This result implies that the suggested design still needs to be improved for greater usability and adoption.

References

  1. Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction 24, 6(2008), 574–594.Google ScholarGoogle Scholar
  2. Onil Bhattacharyya, Kathryn Mossman, Lovisa Gustafsson, and Eric C Schneider. 2019. Using Human-Centered Design to Build a Digital Health Advisor for Patients With Complex Needs: Persona and Prototype Development. Journal of Medical Internet Research 21, 5 (09 May 2019), e10318. https://doi.org/10.2196/10318Google ScholarGoogle ScholarCross RefCross Ref
  3. Timothy Bickmore and Justine Cassell. 2001. Relational agents: a model and implementation of building user trust. In Proceedings of the SIGCHI conference on Human factors in computing systems. 396–403.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. CDC. 2020. Coronavirus Disease 2019 (COVID-19). https://www.cdc.gov/coronavirus/2019-ncov/communication/guidance.html (accessed May 07, 2022).Google ScholarGoogle Scholar
  5. Beenish Moalla Chaudhry and Ashraful Islam. 2022. A Relational Agent for the COVID-19 Patients: Design, Approach, and Implications. JMIR Human Factors (2022). (Under Review).Google ScholarGoogle Scholar
  6. Ashraful Islam and Beenish Moalla Chaudhry. 2021. Identifying User Personas for Engagement with a COVID-19 Health Service Delivery Relational Agent. In Proceedings of the 9th International Conference on Human-Agent Interaction. 364–366.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Lean L Kramer, Silke Ter Stal, Bob C Mulder, Emely de Vet, and Lex van Velsen. 2020. Developing Embodied Conversational Agents for Coaching People in a Healthy Lifestyle: Scoping Review. Journal of Medical Internet Research 22, 2 (2020), e14058. https://doi.org/10.2196/14058Google ScholarGoogle ScholarCross RefCross Ref
  8. Kate Loveys, Mark Sagar, Isabella Pickering, Elizabeth Broadbent, 2021. A Digital Human for Delivering a Remote Loneliness and Stress Intervention to At-Risk Younger and Older Adults During the COVID-19 Pandemic: Randomized Pilot Trial. JMIR mental health 8, 11 (2021), e31586.Google ScholarGoogle ScholarCross RefCross Ref
  9. Marie A Sillice, Patricia J Morokoff, Ginette Ferszt, Timothy Bickmore, Beth C Bock, Ryan Lantini, and Wayne F Velicer. 2018. Using Relational Agents to Promote Exercise and Sun Protection: Assessment of Participants’ Experiences With Two Interventions. J Med Internet Res 20, 2 (07 Feb 2018), e48. https://doi.org/10.2196/jmir.7640Google ScholarGoogle ScholarCross RefCross Ref
  10. Silke ter Stal, Lean Leonie Kramer, Monique Tabak, Harm op den Akker, and Hermie Hermens. 2020. Design features of embodied conversational agents in eHealth: a literature review. International Journal of Human-Computer Studies 138 (2020), 102409.Google ScholarGoogle ScholarCross RefCross Ref
  11. Nikoletta Ventoura, Kosmas Palios, Yannis Vasilakis, Georgios Paraskevopoulos, Nassos Katsamanis, and Vassilis Katsouros. 2021. Theano: A Greek-speaking conversational agent for COVID-19. In Proceedings of the 1st Workshop on NLP for Positive Impact. 36–46.Google ScholarGoogle ScholarCross RefCross Ref
  12. Charles Welch, Allison Lahnala, Veronica Perez-Rosas, Siqi Shen, Sarah Seraj, Larry An, Kenneth Resnicow, James Pennebaker, and Rada Mihalcea. 2020. Expressive Interviewing: A Conversational System for Coping with COVID-19. (Dec. 2020). https://doi.org/10.18653/v1/2020.nlpcovid19-2.6Google ScholarGoogle Scholar

Index Terms

  1. Early Usability Evaluation of a Relational Agent for the COVID-19 Pandemic

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UIST '22 Adjunct: Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
      October 2022
      413 pages
      ISBN:9781450393218
      DOI:10.1145/3526114

      Copyright © 2022 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 28 October 2022

      Check for updates

      Qualifiers

      • poster
      • Research
      • Refereed limited

      Acceptance Rates

      Overall Acceptance Rate842of3,967submissions,21%

      Upcoming Conference

      UIST '24
    • Article Metrics

      • Downloads (Last 12 months)44
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format