skip to main content
10.1145/3389189.3393740acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
research-article

Increasing user trust in a fetching robot using explainable AI in a traded control paradigm

Published:30 June 2020Publication History

ABSTRACT

Recently, there has been an increase use of collaborative robots in manufacturing, healthcare, military, and personal use scenarios. Such robots operate under shared or traded control paradigms with their human operators or users. Therefore, it is important to understand how to address and improve issues of trust between the humans and collaborative robots. In this paper, we investigate the impact of robotic agent transparency to their subjective trust level by a human operator. Several experiments were conceived with the help of a fetching mobile robot under traded control, and data such as subjective trust level was collected during experimentation. Results indicate that trust is easier to lose than it is to gain. Furthermore, results also indicate that agent transparency's effect on operator trust is more significant in tasks of increasing complexity.

Skip Supplemental Material Section

Supplemental Material

a9-cassady.mp4

mp4

18 MB

References

  1. "Executive Summary World Robotics 2019 Industrial Robots." [Online]. Available: https://ifr.org/downloads/press2018/Executive%20Summary%20WR%202019%20Industrial%20Robots.pdfGoogle ScholarGoogle Scholar
  2. J. E. Colgate, W. Wannasuphoprasit, and M. A. Peshkin, "Cobots: robots for collaboration with human operators," in Proceedings of the 1996 ASME International Mechanical Engineering Congress and Exposition, Atlanta, GA, USA, Dec 1 1996, pp. 433--439.Google ScholarGoogle Scholar
  3. R. Bloss, "Collaborative robots are rapidly providing major improvements in productivity, safety, programing ease, portability and cost while addressing many new applications," Industrial Robot, vol. 43, no. 5, pp. 463--468, 15 August 2016 Google ScholarGoogle ScholarCross RefCross Ref
  4. D. Kortenkamp, R. P. Bonasso, D. Ryan, and D. Schreckenghost, "Traded Control with Autonomous Robots as Mixed Initiative Interaction," in "AAAI Technical Report SS-97-04," NASA Johnson Space Center, Houston, TX, 1997.Google ScholarGoogle Scholar
  5. A. Settimi et al., "A Modular Approach for Remote Operation of Humanoid Robots in Search and Rescue Scenarios," Modelling and Simulation for Autonomous Systems, no. MESAS 2014, pp. 192--205, 2014 Google ScholarGoogle ScholarCross RefCross Ref
  6. O. Alkkiomaki, V. Kyrki, H. Kalviainen, Y. Liu, and H. Handroos, "Smooth Transition from Motion to Force Control in Robotic Manipulation Using Vision," presented at the 9th International Conference on Control, Automation, Robotics and Vision, Singapore, Singapore, 5--8 Dec., 2006.Google ScholarGoogle Scholar
  7. R. Parasuraman and V. Riley, "Humans and Automation: Use, Misuse, Disuse, Abuse," Human Factors, vol. 39, no. 2, pp. 230--253, 1997 Google ScholarGoogle Scholar
  8. M. T. Dzindolet, S. A. Peterson, R. A. Pomranky, L. G. Pierce, and H. P. Beck, "The role of trust in automation reliance," Int. J. Hum.-Comput. Stud., vol. 58, no. 6, pp. 697--718, 2003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. Y. C. Chen, M. J. Barnes, A. R. Selkowitz, and K. Stowers, "Effects of Agent Transparency on human-autonomy teaming effectiveness," presented at the IEEE International Conference on Systems, Man, and Cybernetic, Budapest, Hungary, October 9--12, 2016.Google ScholarGoogle Scholar
  10. K. F. Oduor and E. N. Wiebe, "The Effects of Automated Decision Algorithm Modality and Transparency on Reported Trust and Task Performance," Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 52, no. 4, pp. 302--306, 2008 Google ScholarGoogle ScholarCross RefCross Ref
  11. M. R. Endsley, "Toward a Theory of Situation Awareness in Dynamic Systems," Human Factors, vol. 37, no. 1, pp. 32--64, 1995 Google ScholarGoogle Scholar
  12. M. R. Endsley, "Situation Awareness Misconceptions and Misunderstandings," Journal of Cognitive Engineering and Decision Making, vol. 9, no. 1, pp. 4--32, 2015 Google ScholarGoogle ScholarCross RefCross Ref
  13. S.-H. Lee, "An analysis on the changes of logistics industry using internet of things," Journal of Advanced Information Technology and Convergence, vol. 9, 1, pp. 57--66, July 2019 Google ScholarGoogle ScholarCross RefCross Ref
  14. E. Janebäck and M. Kristiansson, "Friendly robot delivery: Designing an autonomous delivery droid for collaborative consumption," Department of Industrial and Materials Science, Chalmers University of Technology, 2019. [Online]. Available: https://hdl.handle.net/20.500.12380/257174Google ScholarGoogle Scholar
  15. M. W. Ulmer and S. Streng, "Same-Day delivery with pickup stations and autonomous vehicles," Computers & Operations Research, vol. 108, pp. 1--19, August 2019 Google ScholarGoogle ScholarCross RefCross Ref
  16. F. D. Laramee, Game Design Perspectives. Rockland, MA, United States: Charles River Media, Inc., 2002, p. 400.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. D. J. Bruemmer, D. A. Few, R. L. Boring, J. L. Marble, M. C. Walton, and C. W. Nielsen, "Shared understanding for collaborative control," IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, vol. 35, no. 4, pp. 494--504, July 2005 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Increasing user trust in a fetching robot using explainable AI in a traded control paradigm

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      PETRA '20: Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments
      June 2020
      574 pages
      ISBN:9781450377737
      DOI:10.1145/3389189

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 30 June 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader