abstract

Effects of Influence on User Trust in Predictive Decision Making

Authors:

Kun Yu,

Yang WangAuthors Info & Claims

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: LBW2812, Pages 1 - 6

https://doi.org/10.1145/3290607.3312962

Published: 02 May 2019 Publication History

Get Access

Abstract

This paper introduces fact-checking into Machine Learning (ML) explanation by referring training data points as facts to users to boost user trust. We aim to investigate what influence of training data points, and how they affect user trust in order to enhance ML explanation and boost user trust. We tackle this question by allowing users check the training data points that have the higher influence and the lower influence on the prediction. A user study found that the presentation of influences significantly increases the user trust in predictions, but only for training data points with higher influence values under the high model performance condition, where users can justify their actions with more similar facts.

References

[1]

Or Biran and Kathleen McKeown. 2017. Human-centric Justification of Machine Learning Predictions. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI'17). 1461--1467.

Digital Library

Google Scholar

[2]

Pang Wei Koh and Percy Liang. 2017. Understanding Black-box Predictions via Influence Functions. In Proceedings of the 34th International Conference on Machine Learning, ICML 2017. Sydney, NSW, Australia, 1885--1894.

Digital Library

Google Scholar

[3]

Travis Kriplean, Caitlin Bonnar, Alan Borning, Bo Kinney, and Brian Gill. 2014. Integrating On-demand Fact-checking with Public Dialogue. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). 1188--1199.

Digital Library

Google Scholar

[4]

Panagiotis Symeonidis, Alexandros Nanopoulos, and Yannis Manolopoulos. 2009. MoviExplain: A Recommender System with Explanations. In Proceedings of the Third ACM Conference on Recommender Systems. 317--320.

Digital Library

Google Scholar

[5]

L. Richard Ye and Paul E. Johnson. 1995. The Impact of Explanation Facilities on User Acceptance of Expert Systems Advice. MIS Quarterly 19, 2 (June 1995), 157--172.

Digital Library

Google Scholar

[6]

Jianlong Zhou and Fang Chen. 2018. DecisionMind: revealing human cognition states in data analytics-driven decision making with a multimodal interface. Journal of Multimodal User Interfaces 12, 2 (2018), 67--76.

Crossref

Google Scholar

[7]

Jianlong Zhou and Fang Chen (Eds.). 2018. Human and Machine Learning: Visible, Explainable, Trustworthy and Transparent. Springer, Cham.

Digital Library

Google Scholar

[8]

Jianlong Zhou, M. Asif Khawaja, Zhidong Li, Jinjun Sun, Yang Wang, and Fang Chen. 2016. Making Machine Learning Useable by Revealing Internal States Update -- A Transparent Approach. International Journal of Computational Science and Engineering 13, 4 (2016), 378--389.

Digital Library

Google Scholar

[9]

Jianlong Zhou, Zelin Li, Weiming Zhi, Bin Liang, Daniel Moses, and Laughlin Dawes. 2017. Using Convolutional Neural Networks and Transfer Learning for Bone Age Classification. In 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA 2017). 1--6.

Google Scholar

[10]

Jianlong Zhou, Jinjun Sun, Yang Wang, and Fang Chen. 2017. Wrapping Practical Problems into a Machine Learning Framework: Using Water Pipe Failure Prediction As a Case Study. International Journal of Intelligent Systems Technologies and Applications 16, 3 (2017), 191--207.

Digital Library

Google Scholar

Cited By

View all

Ferguson SAoyagui PRizvi RKim YKuzminykh A(2024)The Explanation That Hits Home: The Characteristics of Verbal Explanations That Affect Human Perception in Subjective Decision-MakingProceedings of the ACM on Human-Computer Interaction10.1145/36870568:CSCW2(1-37)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687056
Elhamdadi HStefkovics ABeyer JMoerth EPfister HBearfield CNobre C(2024)Vistrust: a Multidimensional Framework and Empirical Study of Trust in Data VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332657930:1(348-358)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3326579
Perlmutter MGifford RKrening S(2024)Impact of Example-Based XAI for Neural Networks on Trust, Understanding, and PerformanceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103277(103277)Online publication date: Apr-2024
https://doi.org/10.1016/j.ijhcs.2024.103277
Show More Cited By

Index Terms

Effects of Influence on User Trust in Predictive Decision Making
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Examining Mobile Banking User Trust: A Tripartite Perspective

Building users' trust is crucial to alleviating their perceived risk and facilitating their usage of mobile banking. Drawing on a tripartite perspective of transference-based, personality-based and self-perception-based determinants, this research ...
Re-examining the influence of trust on online repeat purchase intention: The moderating role of habit and its antecedents

Customer loyalty or repeat purchasing is critical for the survival and success of any store. By focusing on online stores, this study investigates the moderating role of habit on the relationship between trust and repeat purchase intention. Prior ...
The Role of Satisfaction as a Moderation of the Influence of Trust on Consumer Loyalty
ICIEB '18: Proceedings of the 2018 1st International Conference on Internet and e-Business

This research was conducted to find out the role of satisfaction as moderation of influence of trust to loyalty at MatahariMall.com. Sampling technique that used in this research is non probability sampling technique and data analysis using moderated ...

Comments

Information & Contributors

Information

Published In

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

3673 pages

ISBN:9781450359719

DOI:10.1145/3290607

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

AOARD

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
584
Total Downloads

Downloads (Last 12 months)52
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ferguson SAoyagui PRizvi RKim YKuzminykh A(2024)The Explanation That Hits Home: The Characteristics of Verbal Explanations That Affect Human Perception in Subjective Decision-MakingProceedings of the ACM on Human-Computer Interaction10.1145/36870568:CSCW2(1-37)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3687056
Elhamdadi HStefkovics ABeyer JMoerth EPfister HBearfield CNobre C(2024)Vistrust: a Multidimensional Framework and Empirical Study of Trust in Data VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332657930:1(348-358)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3326579
Perlmutter MGifford RKrening S(2024)Impact of Example-Based XAI for Neural Networks on Trust, Understanding, and PerformanceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103277(103277)Online publication date: Apr-2024
https://doi.org/10.1016/j.ijhcs.2024.103277
Hammoudeh ZLowd D(2024)Training data influence analysis and estimation: a surveyMachine Learning10.1007/s10994-023-06495-7113:5(2351-2403)Online publication date: 29-Mar-2024
https://doi.org/10.1007/s10994-023-06495-7
Cau FHauptmann HSpano LTintarev N(2023)Effects of AI and Logic-Style Explanations on Users’ Decisions Under Different Levels of UncertaintyACM Transactions on Interactive Intelligent Systems10.1145/358832013:4(1-42)Online publication date: 16-Mar-2023
https://dl.acm.org/doi/10.1145/3588320
Zhou JZheng BChen F(2023)Effects of Uncertainty and Knowledge Graph on Perception of FairnessCompanion Proceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581754.3584157(151-154)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581754.3584157
Kadir MMohamed Selim ABarz MSonntag D(2023)A User Interface for Explaining Machine Learning Model ExplanationsCompanion Proceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581754.3584131(59-63)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581754.3584131
Cau FHauptmann HSpano LTintarev N(2023)Supporting High-Uncertainty Decisions through AI and Logic-Style ExplanationsProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584080(251-263)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584080
Pandey SMcKinley OCrouser ROttley A(2023)Do You Trust What You See? Toward A Multidimensional Measure of Trust in Visualization2023 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS54172.2023.00014(26-30)Online publication date: 21-Oct-2023
https://doi.org/10.1109/VIS54172.2023.00014
Papenmeier AKern DEnglebienne GSeifert C(2022)It’s Complicated: The Relationship between User Trust, Model Accuracy and Explanations in AIACM Transactions on Computer-Human Interaction10.1145/349501329:4(1-33)Online publication date: 31-Mar-2022
https://dl.acm.org/doi/10.1145/3495013
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Examining Mobile Banking User Trust: A Tripartite Perspective

Re-examining the influence of trust on online repeat purchase intention: The moderating role of habit and its antecedents

The Role of Satisfaction as a Moderation of the Influence of Trust on Consumer Loyalty

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations