skip to main content
10.1145/3527927.3532808acmconferencesArticle/Chapter ViewAbstractPublication Pagesc-n-cConference Proceedingsconference-collections
research-article

Cognitive Strategy Prompts: Creativity Triggers for Human Centered AI Opportunity Detection

Published: 20 June 2022 Publication History

Abstract

Creative problem solving and innovation powered by Artificial Intelligence (AI) requires detection of user needs that can be reframed into data science problems. We propose a framework of 10 creativity triggers for creative human centered AI opportunity detection, based on research and categorization of information retrieval tasks and cognitive task analysis. The method aims to facilitate a dialog between data scientists and underrepresented groups such as non-technical domain experts.
Impact on problem discovery and idea generation was evaluated in co-creation workshops. Results show that the method significantly increases ideas’ scores on the appropriateness to a specific problem and their AI relevancy. Participants experienced the prompts as a helpful mental framework about AI methods and felt encouraged to decompose user stories into more detailed cognitive tasks that help data scientists relate ideas to high level data science methods.

Supplementary Material

Workshops, idea generation, evaluation and results (Schleith_CogStrat4HCAI_Supplementary_Materials.pdf)

References

[1]
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for Human-AI Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300233
[2]
Hrvoje Belani, Marin Vukovic, and Zeljka Car. 2019. Requirements Engineering Challenges in Building AI-Based Complex Systems. 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW) (2019), 252–255.
[3]
Margaret A. Boden. 1998. Creativity and artificial intelligence. Artificial Intelligence 103, 1 (1998), 347–356. https://doi.org/10.1016/S0004-3702(98)00055-1 Artificial Intelligence 40 years later.
[4]
Longbing Cao, George Yuan, Tim Leung, and Wei Zhang. 2020. Special Issue on AI and FinTech: The Challenge Ahead. IEEE Intelligent Systems 35, 2 (2020), 3–6. https://doi.org/10.1109/MIS.2020.2983494
[5]
S. K. Card. 1981. The Model Human Processor: A Model for Making Engineering Calculations of Human Performance. Vol. 25. 301–305 pages. https://doi.org/10.1177/107118138102500180
[6]
S. K. Card. 1981. The Model Human Processor: A Model for Making Engineering Calculations of Human Performance. Proceedings of the Human Factors Society Annual Meeting 25, 1 (Oct. 1981), 301–305. https://doi.org/10.1177/107118138102500180
[7]
British Design Council. 2004. What is the framework for innovation? Design Council’s Evolved Double Diamond.(2004). Accessed: 2021-10-11.
[8]
Robert Dale. 2019. Law and Word Order: NLP in Legal Tech. Natural Language Engineering 25, 1 (2019), 211–217. https://doi.org/10.1017/S1351324918000475
[9]
Peter Dalsgaard. 2017. “Instruments of Inquiry: Understanding the Nature and Role of Design Tools. International Journal of Design 11 (01 2017).
[10]
RealtimeBoard Inc. dba Miro. 2022. Miro. http://miro.com Accessed: 2022-01-10.
[11]
IBM Design. 2022. IBM Design for AI. https://www.ibm.com/design/ai/ Accessed: 2021-10-11.
[12]
Graham Dove, Kim Halskov, Jodi Forlizzi, and John Zimmerman. 2017. UX Design Innovation: Challenges for Working with Machine Learning as a Design Material. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 278–288. https://doi.org/10.1145/3025453.3025739
[13]
David Ellis. 1989. A behavioural model for information retrieval system design. Journal of Information Science 15, 4-5 (1989), 237–247. https://doi.org/10.1177/016555158901500406
[14]
Raya Fidel, Annelise Mark Pejtersen, Bryan Cleal, and Harry Bruce. 2004. A Multidimensional Approach to the Study of Human-Information Interaction: A Case Study of Collaborative Information Retrieval. Journal of the American Society for Information Science and Technology 55, 11 (Sep 2004), 939–953. https://doi.org/10.1002/asi.20041
[15]
Marco Gillies, Rebecca Fiebrink, Atau Tanaka, Jérémie Garcia, Frédéric Bevilacqua, Alexis Heloir, Fabrizio Nunnari, Wendy Mackay, Saleema Amershi, Bongshin Lee, Nicolas d’Alessandro, Joëlle Tilmanne, Todd Kulesza, and Baptiste Caramiaux. 2016. Human-Centred Machine Learning. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3558–3565. https://doi.org/10.1145/2851581.2856492
[16]
Victor Girotto, Erin Walker, and Winslow Burleson. 2019. CrowdMuse: Supporting Crowd Idea Generation through User Modeling and Adaptation. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 95–106. https://doi.org/10.1145/3325480.3325497
[17]
William JJ Gordon. 1961. Synectics: The development of creative capacity.Harper.
[18]
JoAnn T Hackos and Janice Redish. 1998. User and task analysis for interface design. Vol. 1. Wiley New York.
[19]
Scott Isaksen and Donald Treffinger. 2004. Celebrating 50 Years of Reflective Practice: Versions of Creative Problem Solving. The Journal of Creative Behavior 38 (06 2004). https://doi.org/10.1002/j.2162-6057.2004.tb01234.x
[20]
ISO 9241-11:2020 2020. Ergonomics of human-system interaction — Part 110. Standard. International Organization for Standardization, Geneva, CH.
[21]
Xiaoneng Jin, Mark Evans, Hua Dong, and Anqi Yao. 2021. Design Heuristics for Artificial Intelligence: Inspirational Design Stimuli for Supporting UX Designers in Generating AI-Powered Ideas. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 219, 8 pages. https://doi.org/10.1145/3411763.3451727
[22]
Jake Knapp, John Zeratsky, and Braden Kowitz. 2016. Sprint: how to solve big problems and test new ideas in just five days (first simon & schuster hardcover edition ed.). Simon & Schuster, New York.
[23]
Carol Collier Kuhlthau. 1991. Inside the search process: Information seeking from the user’s perspective. Journal of the American Society for Information Science 42 (1991), 361–371.
[24]
Peter Kun, Ingrid Mulder, Amalia de Götzen, and Gerd Kortuem. 2019. Creative Data Work in the Design Process. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 346–358. https://doi.org/10.1145/3325480.3325500
[25]
Dan Lockton, Devika Singh, Saloni Sabnis, Michelle Chou, Sarah Foley, and Alejandro Pantoja. 2019. New Metaphors: A Workshop Method for Generating Ideas and Reframing Problems in Design and Beyond. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 319–332. https://doi.org/10.1145/3325480.3326570
[26]
Duri Long, Mikhail Jacob, and Brian Magerko. 2019. Designing Co-Creative AI for Public Spaces. In Proceedings of the 2019 on Creativity and Cognition (San Diego, CA, USA) (C&C ’19). Association for Computing Machinery, New York, NY, USA, 271–284. https://doi.org/10.1145/3325480.3325504
[27]
Duri Long, Aadarsh Padiyath, Anthony Teachey, and Brian Magerko. 2021. The Role of Collaboration, Creativity, and Embodiment in AI Learning Experiences. In Creativity and Cognition (Virtual Event, Italy) (C&C ’21). Association for Computing Machinery, New York, NY, USA, Article 28, 10 pages. https://doi.org/10.1145/3450741.3465264
[28]
Garm Lucassen, Maxim Keuken, Fabiano Dalpiaz, Sjaak Brinkkemper, Gijs Sloof, and Johan Schlingmann. 2018. Jobs-to-be-Done Oriented Requirements Engineering: A Method for Defining Job Stories. 227–243. https://doi.org/10.1007/978-3-319-77243-1_14
[29]
N. Maiden, S. Jones, I. K. Karlsen, R. Neill, K. Zachos, and A. Milne. 2010. Requirements Engineering as Creative Problem Solving: A Research Agenda for Idea Finding, In Requirements Engineering Conference (RE), 2010 18th IEEE International. RE, 57 – 66. https://doi.org/10.1109/RE.2010.16
[30]
Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (April 2006), 41–46. https://doi.org/10.1145/1121949.1121979
[31]
Michael D. Mumford, Michele I. Mobley, Roni Reiter‐Palmon, Charles E. Uhlman, and Lesli M. Doares. 1991. Process analytic models of creative capacities. Creativity Research Journal 4, 2 (1991), 91–122. https://doi.org/10.1080/10400419109534380
[32]
Lars Müller. 2017. Solving the wrong problem: When technology is making us blind. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. ACM, Maui Hawaii, 1012–1015. https://doi.org/10.1145/3123024.3124396
[33]
Donald A Norman. 1986. User centered system design: New perspectives on human-computer interaction. CRC Press.
[34]
Vicki L. O’Day and Robin Jeffries. 1993. Orienteering in an information landscape: How information seekers get from here to there. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI ’93. ACM Press, Amsterdam, The Netherlands, 438–445. https://doi.org/10.1145/169059.169365
[35]
J. Patton and P. Economy. 2014. User Story Mapping: Discover the Whole Story, Build the Right Product. O’Reilly Media.
[36]
Stuart J Russel Peter Norvig. 2020. Artificial Intelligence: A Modern Approach. Prentice Hall Upper Saddle River, NJ, USA:.
[37]
PricewaterhouseCoopers. 2021. No longer science fiction, AI and robotics are transforming healthcare. Accessed: 2021-10-11.
[38]
Heli Rantavuo. 2019. Designing for intelligence: User-centred design in the age of algorithms. In Proceedings of the 5th International ACM In-Cooperation HCI and UX Conference on - CHIuXiD’19. ACM Press, Jakarta, Surabaya, Bali, Indonesia, 182–187. https://doi.org/10.1145/3328243.3328268
[39]
Google People + AI Research. 2021. People + AI Guidebook. https://pair.withgoogle.com/guidebook Accessed: 2021-10-11.
[40]
Graeme Ritchie. 2001. Assessing creativity. In Proceedings of the AISB’01 Symposium on Artificial Intelligence and Creativity in Arts and Science. 3–11.
[41]
Téo Sanchez, Baptiste Caramiaux, Jules Françoise, Frédéric Bevilacqua, and Wendy Mackay. 2021. How do People Train a Machine? Strategies and (Mis)Understandings. In CSCW 2021 - The 24th ACM Conference on Computer-Supported Cooperative Work and Social Computing. Virtual, United States. https://doi.org/10.1145/3449236
[42]
C. Schlosser, S. Jones, and N. Maiden. 2008. Using a Creativity Workshop to Generate Requirements for an Event Database Application. Lecture Notes in Computer Science: Requirements Engineering: Foundation for Software Quality 5025 (2008), 109 – 122. https://doi.org/10.1007/978-3-540-69062-7_10
[43]
Albrecht Schmidt. 2020. Interactive Human Centered Artificial Intelligence: A Definition and Research Challenges. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3399715.3400873
[44]
Olivier Serrat. 2017. The SCAMPER Technique. Springer Singapore, Singapore, 311–314. https://doi.org/10.1007/978-981-10-0983-9_33
[45]
Ben Shneiderman. 2007. Creativity Support Tools: Accelerating Discovery and Innovation. Commun. ACM 50, 12 (Dec. 2007), 20–32. https://doi.org/10.1145/1323688.1323689
[46]
Ben Shneiderman. 2020. Human-Centered Artificial Intelligence: Three Fresh Ideas.
[47]
Ben Shneiderman. 2022. Human-Centered AI. Oxford University Press.
[48]
Donna Spencer. 2010. A practical guide to information architecture. 1 (2010).
[49]
Kelly Stackowiak. 2020. Design thinking in software and AI projects: Proving ideas through rapid prototyping. In Design thinking in software and AI projects: proving ideas through rapid prototyping.
[50]
Robert J Sternberg. 1999. Handbook of Creativity. Cambridge University Press.
[51]
Katja Tschimmel. 2012. Design Thinking as an effective Toolkit for Innovation. In ISPIM Conference Proceedings. The International Society for Professional Innovation Management (ISPIM), 1.
[52]
Kim J. Vicente. 1995. Task Analysis, Cognitive Task Analysis, Cognitive Work Analysis: What’s the Difference?Proceedings of the Human Factors and Ergonomics Society Annual Meeting 39, 9 (Oct. 1995), 534–537. https://doi.org/10.1177/154193129503900921
[53]
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. 2020. Re-examining whether, why, and how human-AI interaction is uniquely difficult to design. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Cited By

View all
  • (2024)How Example-Based Authoring of Motion Graphics Impacts Creative Expression: Differences in Perceptions of Professional and Casual Motion DesignersProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656197(347-357)Online publication date: 23-Jun-2024
  • (2024)Reflective Practices and Self-Regulated Learning in Designing with Generative Artificial Intelligence: An Ordered Network AnalysisJournal of Science Education and Technology10.1007/s10956-024-10175-zOnline publication date: 1-Nov-2024
  • (2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
C&C '22: Proceedings of the 14th Conference on Creativity and Cognition
June 2022
710 pages
ISBN:9781450393270
DOI:10.1145/3527927
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AI opportunity detection
  2. cognitive task analysis
  3. design thinking

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

C&C '22
Sponsor:
C&C '22: Creativity and Cognition
June 20 - 23, 2022
Venice, Italy

Acceptance Rates

Overall Acceptance Rate 108 of 371 submissions, 29%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)201
  • Downloads (Last 6 weeks)26
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)How Example-Based Authoring of Motion Graphics Impacts Creative Expression: Differences in Perceptions of Professional and Casual Motion DesignersProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3656197(347-357)Online publication date: 23-Jun-2024
  • (2024)Reflective Practices and Self-Regulated Learning in Designing with Generative Artificial Intelligence: An Ordered Network AnalysisJournal of Science Education and Technology10.1007/s10956-024-10175-zOnline publication date: 1-Nov-2024
  • (2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
  • (2022)Triple Diamond Design ProcessHCI International 2022 - Late Breaking Papers. Design, User Experience and Interaction10.1007/978-3-031-17615-9_9(136-146)Online publication date: 26-Jun-2022

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media