skip to main content
10.1145/3025453.3025462acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

The Trouble with Autopilots: Assisted and Autonomous Driving on the Social Road

Published: 02 May 2017 Publication History

Abstract

As self-driving cars have grown in sophistication and ability, they have been deployed on the road in both localised tests and as regular private vehicles. In this paper we draw upon publicly available videos of autonomous and assisted driving (specifically the Tesla autopilot and Google self-driving car) to explore how their drivers and the drivers of other cars interact with, and make sense of, the actions of these cars. Our findings provide an early perspective on human interaction with new forms of driving involving assisted-car drivers, autonomous vehicles and other road users. The focus is on social interaction on the road, and how drivers communicate through, and interpret, the movement of cars. We provide suggestions toward increasing the transparency of autopilots' actions for both their driver and other drivers.

Supplementary Material

MP4 File (p416-brown.mp4)

References

[1]
Airbus. Flight Operations Briefing Note: Standard Operating Procedures Optimum Use of Automation: FLT_OP- SOP- SEQ 02 - REV 03 - JUL. 2006.
[2]
Motoyuki Akamatsu, Paul Green, and Klaus Bengler. 2013. Automotive Technology and Human Factors Research: Past, Present, and Future. International Journal of Vehicular Technology 2013: e526180. https://doi.org/10.1155/2013/526180
[3]
Morana Alač. 2015. Social robots: Things or agents? AI & SOCIETY: 31, 4, 519--535. https://
[4]
Mike Ananny and Kate Crawford. 2016. Seeing without knowing: Limitations of the transparency ideal and its application to algorithmic accountability. New Media & Society online first https://doi.org/10.1177/1461444816676645
[5]
Lisanne Bainbridge. 1983. Ironies of automation. Automatica 19, 6: 775--779.
[6]
K. Bengler, K. Dietmayer, B. Farber, M. Maurer, C. Stiller, and H. Winner. 2014. Three Decades of Driver Assistance Systems: Review and Future Perspectives. IEEE Intelligent Transportation Systems Magazine 6, 4: 6--22. https://doi.org/10.1109/MITS.2014.2336271
[7]
Mark Bergen. 2015. Meet the Companies Building Self-Driving Cars for Google and Tesla (And Maybe Apple). Recode. Retrieved September 20, 2016 from http://www.recode.net/2015/10/27/11620026/meet-the-companies-building-self-driving-cars-for-google-and-tesla
[8]
Kavi Bhalla and Dinesh Mohan. 2016. Understanding the road safety performance of OECD countries. In Transport planning and traffic safety: making cities, roads, and vehicles safer, Geetam Tiwari and Dinesh Mohan (eds.) CRC Press, UK, 1--15.
[9]
Mark Blythe and Paul Cairns. 2009. Critical Methods and User Generated Content: The iPhone on YouTube. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 1467--1476. https://doi.org/10.1145/1518701.1518923
[10]
Barry Brown and Eric Laurier. 2012. The Normal Natural Troubles of Driving with GPS. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 1621--1630. https://doi.org/10.1145/2207676.2208285
[11]
Cesar Cadena, Luca Carlone, Henry Carrillo, Yasir Latif, Davide Scaramuzza, Jose Neira, Ian D. Reid, and John J. Leonard. 2016. Simultaneous Localization And Mapping: Present, Future, and the Robust-Perception Age. arXiv preprint arXiv:1606.05830. Retrieved September 20, 2016 from http://arxiv.org/abs/1606.05830
[12]
Stephen M. Casner, Edwin L. Hutchins, and Don Norman. 2016. The challenges of partially automated driving. Communications of the ACM 59, 5: 70--77.
[13]
Melisa Cefkin and Erik Vinkhuyzen. 2016. Developing Socially Acceptable Autonomous Vehicles. Ethnographic Praxis in Industry Conference Proceedings, p. 522--534 https://www.epicpeople.org
[14]
Melissa Cefkin. 2016. Human-Machine Interactions and the Coming Age of Autonomy | Platypus. Platypus: the castac blog. Retrieved September 20, 2016 from http://blog.castac.org/2016/01/age-ofautonomy/
[15]
Tim Dant. 2004. The driver-car. Theory, Culture & Society 21, 4-5: 61--79.
[16]
Elwys De Stefani. 2015. Formulating instructions. First actions in driving lessons. Retrieved September 20, 2016 from https://lirias.kuleuven.be/handle/123456789/533703
[17]
Paul Dourish. 1997. Accounting for system behaviour: Representation, reflection and resourceful action. Computers and Design in Context, MIT Press, Cambridge, MA, USA: 145--170.
[18]
Hubert Dreyfus, Stuart E. Dreyfus, and Tom Athanasiou. 2000. Mind over machine. Simon and Schuster. Retrieved September 20, 2016 from https://www.google.com/books?hl=en&lr=&id=e9W9m_4q4pYC&oi=fnd&pg=PR9&dq=mind+over+machine&ots=FiOEE8W6O2&sig=LkUriFSZzKIYLpgAn5cqkva2NJs
[19]
Hubert L. Dreyfus. 1992. What computers still can't do: a critique of artificial reason. MIT press. Retrieved September 20, 2016 from http://books.google.com/books?hl=en&lr=&id=7vS2ymQmpAC&oi=fnd&pg=PR9&dq=info:tDOnc5P0VbAJ:scholar.google.com&ots=1U2dRHuvTz&sig=8YrnhoWEpclD-PdrCp3CzQtIfNY
[20]
Mica R. Endsley and Esin O. Kiris. 1995. The out-of-the-loop performance problem and level of control in automation. Human Factors: The Journal of the Human Factors and Ergonomics Society 37, 2: 381--394.
[21]
Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. I always assumed that I wasn't really that close to [her]: Reasoning about Invisible Algorithms in News Feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 153--162. Retrieved December 21, 2016 from http://dl.acm.org/citation.cfm?id=2702556
[22]
William N. Evans and John D. Graham. 1991. Risk reduction or risk compensation? The case of mandatory safety-belt use laws. Journal of Risk and Uncertainty 4, 1: 61--73.
[23]
Nathaniel Fairfield and Chris Urmson. 2011. Traffic light mapping and detection. In Robotics and Automation (ICRA), 2011 IEEE International Conference on, 5421--5426. Retrieved September 20, 2016 from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5
[24]
Luke Fletcher, Seth Teller, Edwin Olson, David Moore, Yoshiaki Kuwata, Jonathan How, John Leonard, Isaac Miller, Mark Campbell, Dan Huttenlocher, and others. 2008. The MIT-Cornell collision and why it happened. Journal of Field Robotics 25, 10: 775--807.
[25]
A. Geiger, P. Lenz, and R. Urtasun. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 3354--3361. https://doi.org/10.1109/CVPR.2012.6248074
[26]
Lee Gomes. 2014. Google's Self-Driving Cars Still Face Many Obstacles. MIT Technology Review. Retrieved September 20, 2016 from https://www.technologyreview.com/s/530276/hiddenobstacles-for-googles-self-driving-cars/
[27]
Michael A. Goodrich and Alan C. Schultz. 2007. Human-robot interaction: a survey. Foundations and trends in human-computer interaction 1, 3: 203--275.
[28]
Google. 2016. Google Self-Driving Car Project Monthly Report August 2016. Retrieved from https://static.googleusercontent.com/media/www.google.com/en//selfdrivingcar/files/reports/report-0816.pdf
[29]
Pentti Haddington. 2012. Movement in action: Initiating social navigation in cars. Retrieved September 20, 2016 from http://www.degruyter.com/view/j/sem.2012.2012.issue-191/sem-2012-0059/sem-2012-0059.xml
[30]
Dave Harley and Geraldine Fitzpatrick. 2009. YouTube and intergenerational communication: the case of Geriatric1927. Universal access in the information society 8, 1: 5--20.
[31]
Christian Heath and Paul Luff. 2000. Technology in Action. Cambridge University Press
[32]
Juan Pablo Hourcade, Sarah L. Mascher, David Wu, and Luiza Pantoja. 2015. Look, My Baby Is Using an iPad! An Analysis of YouTube Videos of Infants and Toddlers Using Tablets. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 1915--1924. https://doi.org/10.1145/2702123.2702266
[33]
Chien-Ming Huang and Bilge Mutlu. 2012. Robot behavior toolkit: generating effective social behaviors for robots. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction, 25--32. Retrieved September 20, 2016 from http://dl.acm.org/citation.cfm?id=2157694
[34]
Nikki Jones and Geoffrey Raymond. 2012. "The Camera Rolls" Using Third-Party Video in Field Research. The Annals of the American Academy of Political and Social Science 642, 1: 109--123.
[35]
Oskar Juhlin. 2001. Traffic behaviour as social interaction - Implications for the design of artificial drivers. In The Social Production of Technology?: On the everyday life of things, Hans Glimell and Oskar Juhlin (eds.). BAS, Goteburg, Sweden, 19--38.
[36]
Oskar Juhlin. 2010. Social Media on the Road. Springer
[37]
Jack Katz. 1999. How Emotions Work. Chicago University Press.
[38]
Eric Laurier. 2016. YouTube: fragments of a video-tropic atlas. Area 48, 4: 488--495
[39]
Eric Laurier, Barry Brown, and Hayden Lorimer. 2012. What it means to change lanes: actions, emotions and wayfinding in the family car. Semiotica 191, 1: 117135.
[40]
Eric Laurier, Hayden Lorimer, Barry Brown, Owen Jones, Oskar Juhlin, Alison Noble, Mark Perry, David Pica, Paul Sormani, and Ignatz Strebel. 2008. Driving and "passengering": notes on the ordinary organization of car travel. Mobilities 3, 1: 1--23.
[41]
Key Jung Lee, Yeon Kyoung Joo, and Clifford Nass. 2014. Partially Intelligent Automobiles and Driving Experience at the Moment of System Transition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 3631--3634. https://doi.org/10.1145/2556288.2557370
[42]
Iolanda Leite, Carlos Martinho, and Ana Paiva. 2013. Social robots for long-term interaction: a survey. International Journal of Social Robotics 5, 2: 291--308.
[43]
John Leonard. 2015. Mapping, Localization, and SelfDriving Vehicles. Retrieved from http://ilp.mit.edu/images/conferences/2016/ict/presenta tions/Leonard.2016.ICT.pdf
[44]
S. Lowry, N. Sünderhauf, P. Newman, J. J. Leonard, D. Cox, P. Corke, and M. J. Milford. 2016. Visual Place Recognition: A Survey. IEEE Transactions on Robotics 32, 1: 1--19. https://doi.org/10.1109/TRO.2015.2496823
[45]
Markus Maurer, J. Christian Gerdes, Barbara Lenz, and Hermann Winner. 2016. Autonomous driving: technical, legal and social aspects. Retrieved September 20, 2016 from http://dl.acm.org/citation.cfm?id=2965082
[46]
Ross Mead and Maja Mataric. 2016. Robots Have Needs Too: How and Why People Adapt Their Proxemic Behavior to Improve Robot Social Signal Understanding. Journal of Human-Robot Interaction 5, 2: 48--68.
[47]
Alexander Meschtscherjakov, Rod McCall, Nicolas Louveton, Thomas Engel, Manfred Tscheligi, and Vincent Koenig. 2015. MaDSAV: maintaining driving skills in semi-autonomous vehicles. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 136--139. Retrieved September 20, 2016 from http://dl.acm.org/citation.cfm?id=2809732
[48]
Alexander Meschtscherjakov, Manfred Tscheligi, Dalila Szostak, Sven Krome, Bastian Pfleging, Rabindra Ratan, Ioannis Politis, Sonia Baltodano, Dave Miller, and Wendy Ju. 2016. HCI and Autonomous Vehicles: Contextual Experience Informs Design. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16), 3542--3549. https://doi.org/10.1145/2851581.2856489
[49]
Alexander Meschtscherjakov, Manfred Tscheligi, Dalila Szostak, Rabindra Ratan, Roderick McCall, Ioannis Politis, and Sven Krome. 2015. Experiencing Autonomous Vehicles: Crossing the Boundaries Between a Drive and a Ride. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15), 2413--2416. https://doi.org/10.1145/2702613.2702661
[50]
Lorenza Mondada. 2012. Talking and driving: multi-activity in the car. Semiotica 2012, 191: 223--256.
[51]
Bilge Mutlu, Takayuki Kanda, Jodi Forlizzi, Jessica Hodgins, and Hiroshi Ishiguro. 2012. Conversational gaze mechanisms for humanlike robots. ACM Transactions on Interactive Intelligent Systems (TiiS) 1, 2: 12.
[52]
Maurice Nevile. 2012. Interaction as distraction in driving: A body of evidence. Semiotica, 191: 169--196.
[53]
Nick Statt. 2016. Tesla customers have driven 100 million miles with Autopilot active. The Verge. Retrieved from http://www.theverge.com/2016/5/24/11761098/tesla-autopilot-self-driving-cars-100-million-miles
[54]
J. Nilsson, J. Silvlin, M. Brannstrom, E. Coelingh, and J. Fredriksson. 2016. If, When, and How to Perform Lane Change Maneuvers on Highways. IEEE Intelligent Transportation Systems Magazine 8, 4: 68--78. https://doi.org/10.1109/MITS.2016.2565718
[55]
Don Norman. 1992. Turn Signals Are the Facial Expressions of Automobiles. Addison Wesley.
[56]
Raja Parasuraman and Victor Riley. 1997. Humans and automation: Use, misuse, disuse, abuse. Human Factors: The Journal of the Human Factors and Ergonomics Society 39, 2: 230--253.
[57]
Frank Pasquale. 2015. The black box society: The secret algorithms that control money and information. Harvard University Press.
[58]
E. Pollard, P. Morignot, and F. Nashashibi. 2013. An ontology-based model to determine the automation level of an automated vehicle for co-driving. In 2013 16th International Conference on Information Fusion (FUSION), 596--603.
[59]
Gary Pritchard, John Vines, Pam Briggs, Lisa Thomas, and Patrick Olivier. 2014. Digitally driven: how location based services impact the work practices of London bus drivers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3617--3626. http://dx.doi.org/10.1145/2556288.2557156.
[60]
Edward Reynolds. 2011. Enticing a challengeable in arguments: sequence, epistemics and preference organisation. Pragmatics 21, 3: 411--430.
[61]
Daniel Rosenband. 2016. Are we there yet? Silicon in self-driving cars. Retrieved from http://www.hotchips.org/video-for-keynote-2-are-we-there-yet-silicon-in-self-driving-cars-by-daniel-rosenband-of-google-available-to-all/
[62]
Selma Sabanovic, Marek P. Michalowski, and Reid Simmons. 2006. Robots in the wild: Observing human-robot social interaction outside the lab. In 9th IEEE International Workshop on Advanced Motion Control, 2006., 596--601. Retrieved September 20, 2016 from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1
[63]
Dorsa Sadigh, Shankar Sastry, Sanjit A. Seshia, and Anca D. Dragan. 2016. Planning for autonomous cars that leverages effects on human actions. In Proceedings of the Robotics: Science and Systems Conference (RSS). Retrieved December 21, 2016 from https://pdfs.semanticscholar.org/e3e1/a23e0096f8ca51b783812310d44673a3c89a.pdf
[64]
Emanuel A. Schegloff. 2007. Sequence organization in interaction: Volume 1: A primer in conversation analysis. Cambridge University Press.
[65]
Mimi Sheller. 2007. Bodies, cybercars and the mundane incorporation of automated mobilities. Social & Cultural Geography 8, 2: 175--197.
[66]
Don Sherman. 2016. Semi-Autonomous Cars Compared! Tesla Model S vs. BMW 750i, Infiniti Q50S, and Mercedes-Benz S65 AMG - Feature. Car and driver. Retrieved September 20, 2016 from http://www.caranddriver.com/features/semi-autonomous-cars-compared-tesla-vs-bmw-mercedes-and-infiniti-feature
[67]
Neville A. Stanton and Philip Marsden. 1996. From fly-by-wire to drive-by-wire: Safety implications of automation in vehicles. Safety Science 24, 1: 35--49. https://doi.org/10.1016/S0925-7535(96)00067-7
[68]
Lucille Alice Suchman. 2007. Human-machine reconfigurations: plans and situated actions. Cambridge University Press.
[69]
Lucy Suchman. 1987. Plans and situated actions: The problem of human-machine communication. Cambridge University Press.
[70]
Marcus Sanchez Svensson, Christian Heath, and Paul Luff. 2007. Instrumental action: the timely exchange of implements during surgical operations. In ECSCW 2007. Springer, 41--60. Retrieved September 20, 2016 from http://link.springer.com/10.1007/978-1-84800031-5_3
[71]
C. Thorpe, M. Herbert, T. Kanade, and S. Shafer. 1991. Toward autonomous driving: the Carnegie Mellon University Navlab. I. Perception. IEEE Expert 6, 4: 31--42. https://doi.org/10.1109/64.85919
[72]
Sebastian Thrun, Michael Montemerlo, and Andrei Aron. Probabilistic Terrain Analysis For High-Speed Desert Driving. Retrieved September 20, 2016 from http://robots.stanford.edu/papers/thrun.mappingStanley.pdf
[73]
Rod Watson. 1999. Driving in forests and mountains: A pure and applied ethnography. Ethnographic studies 3: 50--60. https://doi.org/10.5449/idslu-001103654
[74]
Junqing Wei, John M. Dolan, and Bakhtiar Litkouhi. 2013. Autonomous vehicle social behavior for highway entrance ramp management. In Intelligent Vehicles Symposium (IV), 2013 IEEE, 201--207. Retrieved December 21, 2016 from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6
[75]
Junko Yoshida. 2016. Autopilot: Flying vs. Driving. Can lessons learned from aviation apply to cars? EE Times. Retrieved December 10, 2016 from http://www.eetimes.com/document.asp?doc_id=13292

Cited By

View all
  • (2025)Integrating Autonomous Shuttles: Insights, Challenges, and Strategic Solutions from Practitioners and Industry Experts’ PerceptionsFuture Transportation10.3390/futuretransp50100095:1(9)Online publication date: 20-Jan-2025
  • (2024)Towards Instrumented Fingerprinting of Urban Traffic: A Novel Methodology using Distributed Mobile Point-of-View CamerasProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675740(53-62)Online publication date: 22-Sep-2024
  • (2024)Honkable Gestalts: Why Autonomous Vehicles Get Honked AtProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675732(317-328)Online publication date: 22-Sep-2024
  • Show More Cited By

Index Terms

  1. The Trouble with Autopilots: Assisted and Autonomous Driving on the Social Road

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. automobile interfaces
    2. autonomous cars
    3. human-robot-interaction
    4. interaction
    5. self-driving
    6. social road
    7. video analysis

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)240
    • Downloads (Last 6 weeks)17
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Integrating Autonomous Shuttles: Insights, Challenges, and Strategic Solutions from Practitioners and Industry Experts’ PerceptionsFuture Transportation10.3390/futuretransp50100095:1(9)Online publication date: 20-Jan-2025
    • (2024)Towards Instrumented Fingerprinting of Urban Traffic: A Novel Methodology using Distributed Mobile Point-of-View CamerasProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675740(53-62)Online publication date: 22-Sep-2024
    • (2024)Honkable Gestalts: Why Autonomous Vehicles Get Honked AtProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675732(317-328)Online publication date: 22-Sep-2024
    • (2024)Encountering Autonomous Robots on Public StreetsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634936(561-571)Online publication date: 11-Mar-2024
    • (2024)Measuring Sociality in Driving InteractionIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.338386725:8(9224-9237)Online publication date: Aug-2024
    • (2024)Unlocking the Potential of Raw Images for Object Detection with YOLOv8 and BOT-SORT Techniques2024 5th International Conference on Machine Learning and Computer Application (ICMLCA)10.1109/ICMLCA63499.2024.10754493(252-257)Online publication date: 18-Oct-2024
    • (2024)Do automated vehicle trials test society? Testing mobility futures in the West MidlandsMobilities10.1080/17450101.2024.2356566(1-21)Online publication date: 4-Jun-2024
    • (2024)MindReaD: Enhancing Pedestrian-Vehicle Interaction with Micro-Level Reasoning Data AnnotationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2406053(1-16)Online publication date: 4-Oct-2024
    • (2024)Discovering the Power of External Human-Machine Interface: An EEG Study on the Driving Anger RegulationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2402118(1-14)Online publication date: 16-Sep-2024
    • (2024)Coordination between vehicles in trafficInteraction Studies. Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies / Social Behaviour and Communication in Biological and Artificial SystemsInteraction Studies10.1075/is.22014.mas24:3(362-379)Online publication date: 15-Feb-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media