Skip to main content
SpringerLink
Log in

Applying Human Cognition to Assured Autonomy

  • Conference paper
  • First Online:
HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 13095))

Included in the following conference series:

Abstract

The scaled deployment of semi- and fully autonomous systems undeniably depends on assured autonomy. This reality, however, has become far more complex than expected because it necessarily demands an integrated tripartite solution not yet achieved: consensus-based standards and compliance across industry, scientific innovation within artificial intelligence R&D of explainability, and robust end-user education. In this is paper I present my human-centered approach to the design, development, and deployment of autonomous systems and break down how human factors such as cognitive and behavioral insights into how we think, feel, act, plan, make decisions, and problem-solve are foundational to assuring autonomy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Leslie, D.: Understanding bias in facial recognition technologies: an explainer. The Alan Turing Institute (2020). https://doi.org/10.5281/zenodo

  2. Wu, E., Wu, K., Daneshjou, R., Ouyang, D., Ho, D.E., Zou, J.: How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals. Nat. Med. 27(4), 582–584 (2021)

    Article  Google Scholar 

  3. Lee, P.: Learning from Tay’s introduction. Microsoft – Official Microsoft Blog, 25 March 2016. https://blogs.microsoft.com/blog/2016/03/25/learning-tays-introduction/

  4. Tesla Deaths: https://www.tesladeaths.com/. Accessed 24 June 2021

  5. Jillson, E.: Aiming for truth, fairness, and equity in your company’s use of AI. Federal Trade Commission – Business Blog, 19 April 2021. https://www.ftc.gov/news-events/blogs/business-blog/2021/04/aiming-truth-fairness-equity-your-companys-use-ai

  6. Proposal for a regulation of the European Parliament and of the Council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain union legislative acts. European Commission, April 2021. https://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1623335154975&uri=CELEX%3A52021PC0206

  7. Ethics and governance of artificial intelligence for health: WHO guidance. Geneva: World Health Organization, June 2021. Licence: CC BY-NC-SA 3.0 IGO. https://www.who.int/publications/i/item/9789240029200?utm_source=newsletter&utm_medium=email&utm_campaign=newsletter_axioswhatsnext&stream=science

  8. The Association for Unmanned Vehicle Systems International (AUVSI) Industry News Webpage. https://www.auvsi.org/news. Accessed 24 June 2021

  9. Trust in tech is wavering and companies must act. Edelman Research, April 2019. https://www.edelman.com/research/2019-trust-tech-wavering-companies-must-act

  10. Rainie, L., Anderson, J., Vogels, E.A.: Experts doubt ethical AI design will be broadly adopted as the norm within the next decade. Pew Research Center, June 2021. https://www.pewresearch.org/internet/2021/06/16/experts-doubt-ethical-ai-design-will-be-broadly-adopted-as-the-norm-within-the-next-decade/

  11. 2021 Edelman Trust Barometer. Edelman Research, January 2021. https://www.edelman.com/trust/2021-trust-barometer

  12. Erikson, E.: Childhood and Society. Norton & Company Inc, New York (1950)

    Google Scholar 

  13. Rousseau, D.M., Sitkin, S.B., Burt, R.S., Camerer, C.: Not so different after all: a cross-discipline view of trust. Acad. Manag. Rev. 23(3), 393–404 (1998)

    Article  Google Scholar 

  14. López-González, M.: Regaining sight of humanity on the roadway to automation. In: IS&T International Symposium on Electronic Imaging: Autonomous Vehicles and Machines, IS&T. Springfield, Virginia (2020). https://doi.org/10.2352/ISSN.2470-1173.2020.16.AVM-088.

  15. National Highway Traffic Safety Administration (NHTSA): NHTSA orders crash reporting for vehicles equipped with advanced driver assistance systems and automated driving systems. NHTSA Press Release, 29 June 2021. https://www.nhtsa.gov/press-releases/nhtsa-orders-crash-reporting-vehicles-equipped-advanced-driver-assistance-systems

  16. EASA and Daedalean: Concepts of design assurance for neural networks (CoDANN) II, May 2021. https://daedalean.ai/tpost/kg4j07xlx1-daedalean-and-easa-conclude-second-proje

  17. General Data Protection Regulation (GDPR). https://gdpr.eu/tag/gdpr/. Accessed 13 July 2021

  18. Waldrop, M.M.: Autonomous vehicles: no drivers required. Nat. News 518(7537), 21–22 (2015)

    Article  Google Scholar 

  19. Miller, R.: Closing the curtains on safety theater, Medium, 18 April 2019. https://medium.com/pronto-ai/closing-the-curtains-on-safety-theater-f442b70645a4

  20. Boudette, N.E.: Despite high hopes, self-driving cars are ‘way in the future’. The New York Times, 17 July 2019. https://www.nytimes.com/2019/07/17/business/self-driving-autonomous-cars.html

  21. Taub, E.A.: How jaywalking could jam up the era of self-driving cars. The New York Times, 1 August 2019. https://www.nytimes.com/2019/08/01/business/self-driving-cars-jaywalking.html

  22. Edmonds, E.: AAA warns pedestrian detection systems don’t work when needed most, AAA NewsRoom, 3 October 2019. https://newsroom.aaa.com/2019/10/aaa-warns-pedestrian-detection-systems-dont-work-when-needed-most/

  23. Young, S.: The moral algorithm: how to set the moral compass for autonomous vehicles. Report produced by Gowling WLG (UK), LLC, December 2016

    Google Scholar 

  24. López-González, M.: Theoretically automated conversations: collaborative artistic creativity for autonomous machines. In: IS&T International Symposium on Electronic Imaging: Human Vision and Electronic Imaging, IS&T. Springfield, Virginia (2018). https://doi.org/10.2352/ISSN.2470-1173.2018.14.HVEI-531

  25. López-González, M.: Today is to see and know: an argument and proposal for integrating human cognitive intelligence into autonomous vehicle perception. In: IS&T International Symposium on Electronic Imaging: Autonomous Vehicles and Machines, IS&T. Springfield, Virginia (2019). https://doi.org/10.2352/ISSN.2470-1173.2019.15.AVM-054

  26. Naughton, N.: GM moves to deploy driverless car fleet in 2019, The Detroit News, 12 January 2018. https://www.detroitnews.com/story/business/autos/general-motors/2018/01/12/gm-driverless-car-fleet-cruise-av/109381232/

  27. Walker, J.: The self-driving car timeline – predictions from the top 11 global automakers, Emerj, 21 December 2018. https://emerj.com/ai-adoption-timelines/self-driving-car-timeline-themselves-top-11-automakers/

  28. Fitts, P.M. (ed.): Human engineering for an effective air-navigation and traffic-control system. In: Report prepared for the Air Navigation Development Board. National Research Council, Washington, D.C., March 1951

    Google Scholar 

  29. Stefferud, E.: The logic theory machine: a model heuristic program. Memorandum RM-3731-CC, The Rand Corporation, Santa Monica, CA, June 1963

    Google Scholar 

  30. Lázaro-Gredilla, M., Lin, D., Guntupalli, J.S., George, D.: Beyond imitation: zero-shot task transfer on robots by learning concepts as cognitive programs. Sci. Rob. 4(26), eaav3150 (2019)

    Google Scholar 

  31. Favarò, F.M., Nader, N., Eurich, S.O., Tripp, M., Varadaraju, N.: Examining accident reports involving autonomous vehicles in California. PLoS ONE 12(9), e0184952 (2017)

    Google Scholar 

  32. Lipton, Z.C.: The mythos of model interpretability: in machine learning, the concept of interpretability is both important and slippery. Queue 16(3), 31–57 (2018)

    Article  Google Scholar 

  33. Leslie, D., Burr, C., Aitken, M., Cowls, J., Katell, M., Briggs, M.: Artificial intelligence, human rights, democracy, and the rule of law: a primer. The Council of Europe (2021)

    Google Scholar 

  34. National Highway Traffic Safety Administration, United States Department of Transportation, Automated Vehicles for Safety. https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety

  35. Safety Alert for Operators (SAFO - 13002): Manual flight operations. U.S. Department of Transportation Federal Aviation Administration, 4 January 2013. https://www.faa.gov/other_visit/aviation_industry/airline_operators/airline_safety/safo/all_safos/media/2013/SAFO13002.pdf

  36. National Transportation Safety Board: Collision between vehicle controlled by developmental automated driving system and pedestrian. Public Meeting of 19 November 2019. https://www.ntsb.gov/news/events/Documents/2019-HWY18MH010-BMG-abstract.pdf

  37. AutoInsurance.org: Which states allow self-driving cars? (2021 Update), 26 February 2021. https://www.autoinsurance.org/which-states-allow-automated-vehicles-to-drive-on-the-road/. Accessed 30 June 2021

  38. Awad, E., et al.: The moral machine experiment. Nature 563(7729), 59–64 (2018)

    Article  Google Scholar 

  39. López-González, M.: For female leaders of tomorrow: cultivate an interdisciplinary mindset. In Women in Engineering (WIE) Forum USA East. IEEE (2017). https://doi.org/10.1109/WIE.2017.8285606

  40. Oecd.org: OECD Principles on Artificial Intelligence. https://www.oecd.org/going-digital/ai/principles/. Accessed 13 July 2021

  41. Responsible AI Institute: RAI Certification. https://www.responsible.ai/certification. Accessed 13 July 2021

  42. Gpai.org: The Global Partnership on Artificial Intelligence. https://www.gpai.ai/. Accessed 13 July 2021

Download references

Acknowledgements

Thanks to Dr. I. Gonzalez for her insightful comments and to the Institute for Human Intelligence for providing the required resources for this research.

Author information

Authors and Affiliations

  1. Institute for Human Intelligence, Baltimore, MD, USA

    Mónica López-González

Authors
  1. Mónica López-González
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mónica López-González .

Editor information

Editors and Affiliations

  1. University of Creteand Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

  3. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  4. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

  5. Smart Future Initiative, Frankfurt am Main, Hessen, Germany

    Norbert Streitz

  6. Faculty of Arts and Science, Kyushu University, Fukuoka, Japan

    Shin'ichi Konomi

  7. Siemens (United States), Princeton, NJ, USA

    Helmut Degen

  8. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

López-González, M. (2021). Applying Human Cognition to Assured Autonomy. In: Stephanidis, C., et al. HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence. HCII 2021. Lecture Notes in Computer Science(), vol 13095. Springer, Cham. https://doi.org/10.1007/978-3-030-90963-5_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90963-5_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90962-8

  • Online ISBN: 978-3-030-90963-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation