skip to main content
10.1145/3640544.3645248acmconferencesArticle/Chapter ViewAbstractPublication PagesiuiConference Proceedingsconference-collections
extended-abstract

Bridging Domain Expertise and AI through Data Understanding

Published:05 April 2024Publication History

ABSTRACT

With the ongoing digitalization of complex systems, for example in manufacturing, domain experts’ detailed understanding of datasets is pivotal to effectively training machine learning (ML) models. This understanding obtained through their deep domain knowledge, enables domain experts to collaborate with method experts to identify deficiencies in datasets, such as biases or anomalies, and curate them. Such curated datasets build the foundation for training effective ML models, which are able to inform subsequent decision-making processes. However, understanding the increasingly large and complex datasets and systems they represent is challenging. Therefore, this doctoral thesis investigates methods to support domain experts in building a solid data understanding for complex datasets. Specifically, the thesis focuses on three key areas: conceptualizing data understanding, augmenting domain knowledge through VIS4ML systems to curate datasets, and providing contextual information for AI-assisted decision-making. Initial findings indicate that VIS4ML systems effectively support domain experts in understanding and contextualizing datasets, enabling them to curate datasets collaboratively. This understanding, particularly when enriched through contextual information, shows promise in enhancing AI-assisted decision-making.

References

  1. Yongsu Ahn, Yu-Ru Lin, Panpan Xu, and Zeng Dai. 2023. ESCAPE: Countering Systematic Errors from Machine’s Blind Spots via Interactive Visual Analysis. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Adriana Alvarado Garcia, Marisol Wong-Villacres, Milagros Miceli, Benjamín Hernández, and Christopher A Le Dantec. 2023. Mobilizing Social Media Data: Reflections of a Researcher Mediating between Data and Organization. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 866, 19 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Christian Haertel, Matthias Pohl, Abdulrahman Nahhas, Daniel Staegemann, and Klaus Turowski. 2022. Toward a lifecycle for data science: a literature review of data science process models. PACIS 2022 Proceedings (2022).Google ScholarGoogle Scholar
  4. Patrick Hemmer, Monika Westphal, Max Schemmer, Sebastian Vetter, Michael Vössing, and Gerhard Satzger. 2023. Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfaction. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 453–463.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Joshua Holstein, Max Schemmer, Johannes Jakubik, Michael Vössing, and Gerhard Satzger. 2023. Sanitizing data for analysis: Designing systems for data understanding. Electronic Markets 33, 1 (2023), 52.Google ScholarGoogle ScholarCross RefCross Ref
  6. Joshua Holstein, Philipp Spitzer, Marieke Hoell, Michael Vössing, and Niklas Kühl. 2024. Understanding Data Understanding: A framework to navigate the Intricacies of Data Analytics. In Working Paper.Google ScholarGoogle Scholar
  7. Petra Isenberg, Niklas Elmqvist, Jean Scholtz, Daniel Cernea, Kwan-Liu Ma, and Hans Hagen. 2011. Collaborative visualization: Definition, challenges, and research agenda. Information Visualization 10, 4 (2011), 310–326.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Johannes Jakubik, Michael Vössing, Niklas Kühl, Jannis Walk, and Gerhard Satzger. 2023. Data-Centric Artificial Intelligence. arxiv:2212.11854Google ScholarGoogle Scholar
  9. Dongyu Liu, Sarah Alnegheimish, Alexandra Zytek, and Kalyan Veeramachaneni. 2022. MTV: Visual Analytics for Detecting, Investigating, and Annotating Anomalies in Multivariate Time Series. Proc. ACM Hum.-Comput. Interact. 6, CSCW1, Article 103 (apr 2022), 30 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Thomas Ludwig, Christoph Kotthaus, and Volkmar Pipek. 2015. Should I Try Turning It Off and On Again?: Outlining HCI Challenges for Cyber-Physical Production Systems. International Journal of Information Systems for Crisis Response and Management (IJISCRAM) 7, 3 (2015), 55–68.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Marc Pinski, Martin Adam, and Alexander Benlian. 2023. AI Knowledge: Improving AI Delegation through Human Enablement. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Max Schemmer, Joshua Holstein, Niklas Bauer, Niklas Kühl, and Gerhard Satzger. 2023. Towards Meaningful Anomaly Detection: The Effect of Counterfactual Explanations on the Investigation of Anomalies in Multivariate Time Series. arXiv preprint arXiv:2302.03302 (2023).Google ScholarGoogle Scholar
  13. Max Schemmer, Niklas Kuehl, Carina Benz, Andrea Bartos, and Gerhard Satzger. 2023. Appropriate reliance on AI advice: Conceptualization and the effect of explanations. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 410–422.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Christoph Schröer, Felix Kruse, and Jorge Marx Gómez. 2021. A Systematic Literature Review on Applying CRISP-DM Process Model. Procedia Computer Science 181 (2021).Google ScholarGoogle Scholar
  15. Philipp Spitzer, Joshua Holstein, Patrick Hemmer, Michael Vössing, Niklas Kühl, Dominik Martin, and Gerhard Satzger. 2024. On the Effect of Contextual Information on Human Delegation Behavior in Human-AI collaboration. arxiv:2401.04729 [cs.HC]Google ScholarGoogle Scholar
  16. Philipp Spitzer, Joshua Holstein, Michael Vössing, and Niklas Kühl. 2023. On the Perception of Difficulty: Differences between Humans and AI. arXiv preprint arXiv:2304.09803 (2023).Google ScholarGoogle Scholar
  17. Hariharan Subramonyam and Jessica Hullman. 2023. Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Research. IEEE Transactions on Visualization and Computer Graphics (2023).Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Junpeng Wang, Shixia Liu, and Wei Zhang. 2023. Visual Analytics For Machine Learning: A Data Perspective Survey. (7 2023). https://arxiv.org/abs/2307.07712v1Google ScholarGoogle Scholar

Index Terms

  1. Bridging Domain Expertise and AI through Data Understanding

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        IUI '24 Companion: Companion Proceedings of the 29th International Conference on Intelligent User Interfaces
        March 2024
        182 pages
        ISBN:9798400705090
        DOI:10.1145/3640544

        Copyright © 2024 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 5 April 2024

        Check for updates

        Qualifiers

        • extended-abstract
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate746of2,811submissions,27%
      • Article Metrics

        • Downloads (Last 12 months)35
        • Downloads (Last 6 weeks)35

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format