skip to main content
10.1145/3332167.3356878acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Designing Interactive Intelligent Systems for Human Learning, Creativity, and Sensemaking

Published:14 October 2019Publication History

ABSTRACT

The focus of intelligent systems is on "making things easy'' through automation. However, for many cognitive tasks---such as learning, creativity, or sensemaking---there is such a thing as too easy or too automated. Current human-AI design principles, as well as general usability guidelines, prioritize automation, and efficient task execution over human effort. However, this type of advice may not be suitable for designing systems that need to balance automation with other cognitive goals. In these cases, designers lack the necessary tools that will allow them to consider the trade-offs between automation, AI assistance, and human-effort. My dissertation looks at using models from cognitive psychology to inform the design of intelligent systems. The first system, Florum, looks at automation after human-effort as a strategy to facilitate learning from science text. The second system, TakeToons, explores automation as a complementary strategy to human-effort to support creative animation tasks. A third set, SmartCues and Affinity Lens use AI as a last-mile optimization strategy for human sensemaking tasks. Based on these systems, I am looking to develop a design framework that (1) classifies threats across different levels of design including automation, user interface, expectations from AI, and cognition and (2) offers ways to validate design decisions.

References

  1. Adobe. 2018. Character Animator CC. (2018).Google ScholarGoogle Scholar
  2. Margaret A Boden. 2009. Computer models of creativity. AI Magazine 30, 3 (2009), 23--23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Stuart K Card. 2018. The psychology of human-computer interaction. Crc Press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Michelene TH Chi, Nicholas Leeuw, Mei-Hung Chiu, and Christian LaVancher. 1994. Eliciting self-explanations improves understanding. Cognitive science 18, 3 (1994), 439--477.Google ScholarGoogle Scholar
  5. Alex Endert, M Shahriar Hossain, Naren Ramakrishnan, Chris North, Patrick Fiaux, and Christopher Andrews. 2014. The human is the loop: new directions for visual analytics. Journal of intelligent information systems 43, 3 (2014), 411--435.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Jawaid A Ghani and others. 1995. Flow in human computer interactions: Test of a model. Human factors in information systems: Emerging theoretical bases (1995), 291--311.Google ScholarGoogle Scholar
  7. Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 159--166.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Walter Kintsch and CBEMAFRS Walter Kintsch. 1998. Comprehension: A paradigm for cognition. Cambridge university press.Google ScholarGoogle Scholar
  9. Jakob Nielsen. 1994. Usability engineering. Elsevier.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Steven Pinker. 1990. A theory of graph comprehension. Artificial intelligence and the future of testing (1990), 73--126.Google ScholarGoogle Scholar
  11. Peter Pirolli and Stuart Card. 2005. The sensemaking process and leverage points for analyst technology as identified through cognitive task analysis. In Proceedings of international conference on intelligence analysis, Vol. 5. McLean, VA, USA, 2--4.Google ScholarGoogle Scholar
  12. Hariharan Subramonyam and Eytan Adar. 2018. SmartCues: A Multitouch Query Approach for Details-on-Demand through Dynamically Computed Overlays. IEEE transactions on visualization and computer graphics 25, 1 (2018), 597--607.Google ScholarGoogle Scholar
  13. Hariharan Subramonyam, Steven M Drucker, and Eytan Adar. 2019. Affinity Lens: Data-Assisted Affinity Diagramming with Augmented Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 398.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Hariharan Subramonyam, Wilmot Li, Eytan Adar, and Mira Dontcheva. 2018. TakeToons: Script-driven Performance Animation. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 663--674.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Peggy Van Meter and Joanna Garner. 2005. The promise and practice of learner-generated drawing: Literature review and synthesis. Educational Psychology Review 17, 4 (2005), 285--325.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Designing Interactive Intelligent Systems for Human Learning, Creativity, and Sensemaking

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          UIST '19 Adjunct: Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology
          October 2019
          192 pages
          ISBN:9781450368179
          DOI:10.1145/3332167

          Copyright © 2019 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 14 October 2019

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate842of3,967submissions,21%

          Upcoming Conference

          UIST '24
        • Article Metrics

          • Downloads (Last 12 months)54
          • Downloads (Last 6 weeks)1

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader