skip to main content
10.1145/3596671.3598574acmotherconferencesArticle/Chapter ViewAbstractPublication PageschiworkConference Proceedingsconference-collections
research-article
Open access

Preparing Future Designers for Human-AI Collaboration in Persona Creation

Published: 20 September 2023 Publication History

Abstract

This paper presents findings from an exploratory study investigating the use of AI text-generation tools to support novice designers in persona creation. We conducted a workshop with 22 undergraduate students enrolled in an introductory human-computer interaction course, who were instructed to use GPT-3 in the creation of personas. These novice designers were able to use GPT-3 to iterate to produce satisfactory personas, particularly when providing detailed prompts. Our findings suggest that personas created with GPT-3 assistance were mostly comparable to those created manually but rated lower on some evaluation dimensions. The study also reveals merits and concerns of using GPT-3 for persona creation. Based on our findings, we propose recommendations for novice designers on how to use text-generative AIs to create personas effectively and responsibly.

References

[1]
Chadia Abras, Diane Maloney-Krichmar, Jenny Preece, 2004. User-centered design. Bainbridge, W. Encyclopedia of Human-Computer Interaction. Thousand Oaks: Sage Publications 37, 4 (2004), 445–456.
[2]
Michael J Ahn and Yu-Che Chen. 2022. Digital transformation toward AI-augmented public administration: The perception of government employees and the willingness to use AI in government. Government Information Quarterly 39, 2 (2022), 101664.
[3]
Nancy S Anderson. 1988. User centered system design: new perspectives on human-computer interaction.
[4]
Virginia Braun and Victoria Clarke. 2012. Thematic analysis.American Psychological Association.
[5]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX design innovation: Challenges for working with machine learning as a design material. In Proceedings of the 2017 chi conference on human factors in computing systems. 278–288.
[6]
Mingming Fan, Xianyou Yang, TszTung Yu, Q. Vera Liao, and Jian Zhao. 2022. Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization. Proc. ACM Hum.-Comput. Interact. 6, CSCW1, Article 96 (apr 2022), 32 pages. https://doi.org/10.1145/3512943
[7]
Carlos Flavián, Alfredo Pérez-Rueda, Daniel Belanche, and Luis V Casaló. 2022. Intention to use analytical artificial intelligence (AI) in services–the effect of technology readiness and awareness. Journal of Service Management 33, 2 (2022), 293–320.
[8]
Forrester. 2023. Generative AI, like Chatgpt, won’t destroy creativity - it’ll save it.https://www.forbes.com/sites/forrester/2023/01/19/generative-ai-like-chatgpt-wont-destroy-creativityitll-save-it/?sh=366cc9926dba
[9]
Spence Green, Jeffrey Heer, and Christopher D Manning. 2015. Natural language translation at the intersection of AI and HCI. Commun. ACM 58, 9 (2015), 46–53.
[10]
Maren Haag and Nicola Marsden. 2019. Exploring personas as a method to foster empathy in student IT design teams. International journal of technology and design education 29 (2019), 565–582.
[11]
Perttu Hämäläinen, Mikke Tavast, and Anton Kunnari. 2023. Evaluating Large Language Models in Generating Synthetic HCI Research Data: A Case Study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 433, 19 pages. https://doi.org/10.1145/3544548.3580688
[12]
Stevie Inkpen, Koriand Chancellor, Munmun De Choudhury, Michael Veale, and Eric P. S. Baumer. 2019. Where is the Human? Bridging the Gap Between AI and HCI. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3290607.3299002
[13]
M Cameron Jones, Ingbert R Floyd, and Michael B Twidale. 2008. Teaching design with personas. (2008).
[14]
Soon-gyo Jung, Joni Salminen, Haewoon Kwak, Jisun An, and Bernard J Jansen. 2018. Automatic Persona Generation (APG) A Rationale and Demonstration. In Proceedings of the 2018 conference on human information interaction & retrieval. 321–324.
[15]
Aniket Kittur, Ed H Chi, and Bongwon Suh. 2008. Crowdsourcing user studies with Mechanical Turk. In Proceedings of the SIGCHI conference on human factors in computing systems. 453–456.
[16]
Nicola Marsden and Monika Pröbster. 2019. Personas and identity: Looking at multiple identities to inform the construction of personas. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.
[17]
Nicola Marsden, Monika Pröbster, Mirza Ehsanul Haque, and Julia Hermann. 2017. Cognitive styles and personas: designing for users who are different from me. In Proceedings of the 29th Australian Conference on Computer-Human Interaction. 452–456.
[18]
Tara Matthews, Tejinder Judge, and Steve Whittaker. 2012. How do designers and user experience professionals actually perceive and use personas?. In Proceedings of the SIGCHI conference on human factors in computing systems. 1219–1228.
[19]
Lene Nielsen. 2002. From User to Character: An Investigation into User-Descriptions in Scenarios. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (London, England) (DIS ’02). Association for Computing Machinery, New York, NY, USA, 99–104. https://doi.org/10.1145/778712.778729
[20]
James E Nieters, Subbarao Ivaturi, and Iftikhar Ahmed. 2007. Making personas memorable. In CHI’07 extended abstracts on Human factors in computing systems. 1817–1824.
[21]
John Pruitt and Jonathan Grudin. 2003. Personas: Practice and Theory. In Proceedings of the 2003 Conference on Designing for User Experiences (San Francisco, California) (DUX ’03). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/997078.997089
[22]
Joni Salminen, Joao M Santos, Haewoon Kwak, Jisun An, Soon-gyo Jung, and Bernard J Jansen. 2020. Persona perception scale: development and exploratory validation of an instrument for evaluating individuals’ perceptions of personas. International Journal of Human-Computer Studies 141 (2020), 102437.
[23]
Ben Shneiderman. 2020. Human-centered artificial intelligence: Reliable, safe & trustworthy. International Journal of Human–Computer Interaction 36, 6 (2020), 495–504.
[24]
H. Holden Thorp. 2023. ChatGPT is fun, but not an author. Science 379 (2023), 313 – 313.
[25]
Dakuo Wang, Elizabeth Churchill, Pattie Maes, Xiangmin Fan, Ben Shneiderman, Yuanchun Shi, and Qianying Wang. 2020. From Human-Human Collaboration to Human-AI Collaboration: Designing AI Systems That Can Work Together with People. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3334480.3381069
[26]
Dakuo Wang, Justin D Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019. Human-AI collaboration in data science: Exploring data scientists’ perceptions of automated AI. Proceedings of the ACM on human-computer interaction 3, CSCW (2019), 1–24.
[27]
David James Woo. 2022. Secondary School Student-AI Creative Writing: Strategies from Text Generator Interactions. arXiv preprint arXiv:2207.01484 (2022).

Cited By

View all
  • (2024)Using AI tools for generating proto-personasUsing AI tools for generating proto-personasAvances en Interacción Humano-Computadora10.47756/aihc.y9i1.1429:1(26-34)Online publication date: 30-Nov-2024
  • (2024)Exploring the Use of Custom GPTs in Higher Education Strategic Planning: A Preliminary Field ReportSSRN Electronic Journal10.2139/ssrn.4793697Online publication date: 2024
  • (2024)Experiences and challenges of a redesign process with the support of an AI assistant on an educational platformProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702046(1-12)Online publication date: 7-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
CHIWORK '23: Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work
June 2023
164 pages
ISBN:9798400708077
DOI:10.1145/3596671
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. education
  2. human-AI collaboration
  3. large language models
  4. natural-language generation
  5. novice designers
  6. personas

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

CHIWORK 2023

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,434
  • Downloads (Last 6 weeks)176
Reflects downloads up to 10 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Using AI tools for generating proto-personasUsing AI tools for generating proto-personasAvances en Interacción Humano-Computadora10.47756/aihc.y9i1.1429:1(26-34)Online publication date: 30-Nov-2024
  • (2024)Exploring the Use of Custom GPTs in Higher Education Strategic Planning: A Preliminary Field ReportSSRN Electronic Journal10.2139/ssrn.4793697Online publication date: 2024
  • (2024)Experiences and challenges of a redesign process with the support of an AI assistant on an educational platformProceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems10.1145/3702038.3702046(1-12)Online publication date: 7-Oct-2024
  • (2024)Is a Sunny Day Bright and Cheerful or Hot and Uncomfortable? Young Children's Exploration of ChatGPTProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685397(1-15)Online publication date: 13-Oct-2024
  • (2024)Temporal Aspects of Human-AI Collaborations for WorkProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663397(1-7)Online publication date: 25-Jun-2024
  • (2024)A Vision for Operationalising Diversity and Inclusion in AIProceedings of the 2nd International Workshop on Responsible AI Engineering10.1145/3643691.3648587(36-45)Online publication date: 16-Apr-2024
  • (2024)Vector Personas: How UX Researchers Can Use AI to Bring New Dimension to Traditional Persona DevelopmentProceedings of the 42nd ACM International Conference on Design of Communication10.1145/3641237.3691663(151-157)Online publication date: 20-Oct-2024
  • (2024)Auto-Generated Personas: Enhancing User-centered Design Practices among University StudentsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651043(1-7)Online publication date: 11-May-2024
  • (2024)Generating personas using LLMs and assessing their viabilityExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650860(1-7)Online publication date: 11-May-2024
  • (2024)AI-Augmented Brainwriting: Investigating the use of LLMs in group ideationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642414(1-17)Online publication date: 11-May-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media