Barry Brown
Skip Abstract Section
Abstract
The advent of autonomous cars creates a range of new questions about road safety, as well as a new collaborative domain for CSCW to analyse. This paper uses video data collected from five countries - India, Spain, France, Chile, and the USA - to study how road users interact with each other. We use interactional video analysis to document how co-ordination is achieved in traffic not just through the use of formal rules, but through situated communicative action. Human movement is a rich implicit communication channel and this communication is essential for safe manoeuvring on the road, such as in the co-ordination between pedestrians and drivers. We discuss five basic movements elements: gaps, speed, position, indicating and stopping. Together these elements can be combined to make and accept offers, show urgency, make requests and display preferences. We build on these results to explore lessons for how we can design the implicit motion of self-driving cars so that these motions are understandable - in traffic - by other road users. In discussion, we explore the lessons from this for designing the movement of robotic systems more broadly.
- Claudia Ackermann, Matthias Beggiato, Luka-Franziska Bluhm, and Josef Krems. 2018. Vehicle movement and its potential as implicit communication signal for pedestrians and automated vehicles. In Proceedings of the 6th Humanist Conference. 1--7.Google Scholar
- Lucy Anderson-Bashan, Benny Megidish, Hadas Erel, Iddo Wald, Guy Hoffman, Oren Zuckerman, and Andrey Grishko. 2018. The greeting machine: an abstract robotic object for opening encounters. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 595--602.Google ScholarDigital Library
- Mehmet Aydin Baytas, Damla Çay, Yuchong Zhang, Mohammad Obaid, Asim Evren Yantaç, and Morten Fjeld. 2019. The design of social drones: A review of studies on autonomous flyers in inhabited environments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.Google ScholarDigital Library
- Mark Bergen. 2015. Meet the Companies Building Self-Driving Cars for Google and Tesla (And Maybe Apple). http://www.recode.net/2015/10/27/11620026/meet-the-companies-building-self-driving-cars-for-google-and-teslaGoogle Scholar
- Mathias Broth, Jakob Cromdal, and Lena Levin. 2018. Showing where you're going. Instructing the accountable use of the indicator in live traffic. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 248--264.Google ScholarCross Ref
- Barry Brown and Eric Laurier. 2017. The trouble with autopilots: Assisted and autonomous driving on the social road. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM Press, 416--429.Google ScholarDigital Library
- Barry Brown, Moira McGregor, and Eric Laurier. 2013. iPhone in vivo: video analysis of mobile device use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1031--1040.Google ScholarDigital Library
- Cesar Cadena, Luca Carlone, Henry Carrillo, Yasir Latif, Davide Scaramuzza, Jose Neira, Ian D. Reid, and John J. Leonard. 2016. Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age. IEEE Transactions on robotics , Vol. 32, 6 (June 2016), 1309--1332. https://arxiv.org/abs/1606.05830v2Google ScholarDigital Library
- Jessica R Cauchard, Kevin Y Zhai, Marco Spadafora, and James A Landay. 2016. Emotion encoding in human-drone interaction. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 263--270.Google ScholarCross Ref
- Mark Colley and Rukzio Rukzio. 2020. A Design Space for External Communication of Autonomous Vehicles. In Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI'20). ACM Press, 212--222. https://doi.org/10.1145/3409120.3410646Google ScholarDigital Library
- Andrew Crabtree, Tom Rodden, Peter Tolmie, and Graham Button. 2009. Ethnography considered harmful. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 879--888. https://doi.org/10.1145/1518701.1518835Google ScholarDigital Library
- Elwys De Stefani. 2018. Formulating direction: Navigational instructions in driving lessons. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 283--303.Google ScholarCross Ref
- Elwys De Stefani, Mathias Broth, and Arnulf Deppermann. 2018. On the road: Communicating traffic. Language & Communication 65 (2018), 1--6.Google ScholarCross Ref
- Arnulf Deppermann. 2018. Instruction practices in German driving lessons: Differential uses of declaratives and imperatives. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 265--282.Google ScholarCross Ref
- Arnulf Deppermann, Eric Laurier, and Lorenza Mondada. 2018. Overtaking as an interactional achievement : Video analyses of participants' practices in traffic. Gesprächsforschung , Vol. 19 (2018), 1--131. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-149905Google Scholar
- Ian Dersley and Anthony Wootton. 2000. Complaint sequences within antagonistic argument. Research on Language and Social Interaction , Vol. 33, 4 (2000), 375--406.Google ScholarCross Ref
- Hadas Erel, Tzachi Shem Tov, Yoav Kessler, and Oren Zuckerman. 2019. Robots are Always Social: Robotic Movements are Automatically Interpreted as Social Cues. In Extended abstracts of the 2019 CHI conference on human factors in computing systems. 1--6.Google Scholar
- Joel E. Fischer, Stuart Reeves, Martin Porcheron, and Rein Ove Sikveland. 2019. Progressivity for voice interface design. In Proceedings of the 1st International Conference on Conversational User Interfaces - CUI '19. ACM Press, Dublin, Ireland, 1--8. https://doi.org/10.1145/3342775.3342788 tex.ids: fischer_progressivity_2019--1.Google ScholarDigital Library
- Grace de la Flor, Paul Luff, Marina Jirotka, John Pybus, Ruth Kirkham, and Annamaria Carusi. 2010. The Case of the Disappearing Ox: Seeing Through Digital Images to an Analysis of Ancient Texts. ACM, 1753397, 473--482. https://doi.org/10.1145/1753326.1753397Google ScholarDigital Library
- Harold Garfinkel. 1967. Studies in Ethnomethodology. Prentice Hall.Google Scholar
- A. Geiger, P. Lenz, and R. Urtasun. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3354--3361. https://doi.org/10.1109/CVPR.2012.6248074Google ScholarCross Ref
- Lee Gomes. 2014. Google's Self-Driving Cars Still Face Many Obstacles. https://www.technologyreview.com/s/530276/hidden-obstacles-for-googles-self-driving-cars/Google Scholar
- David González, Joshué Pérez, Vicente Milanés, and Fawzi Nashashibi. 2015. A review of motion planning techniques for automated vehicles. IEEE Transactions on Intelligent Transportation Systems, Vol. 17, 4 (2015), 1135--1145.Google ScholarDigital Library
- Charles Goodwin. 2000. Action and embodiment within situated human interaction. Journal of Pragmatics , Vol. 32 (2000), 1489--1522.Google ScholarCross Ref
- Charles Goodwin. 2018. Co-operative action. Cambridge University Press.Google Scholar
- Marjorie Harness Goodwin and Charles Goodwin. 2012. Car talk: Integrating texts, bodies, and changing landscapes. Semiotica , Vol. 191 (2012), 257--286.Google Scholar
- Azra Habibovic, Victor Malmsten Lundgren, Jonas Andersson, Maria Klingegård, Tobias Lagström, Anna Sirkka, Johan Fagerlönn, Claes Edgren, Rikard Fredriksson, Stas Krupenia, Dennis Saluäär, and Pontus Larsson. 2018. Communicating Intent of Automated Vehicles to Pedestrians. Frontiers in Psychology , Vol. 9 (Aug. 2018). https://doi.org/10.3389/fpsyg.2018.01336Google ScholarCross Ref
- Pentti Haddington. 2012. Movement in action: Initiating social navigation in cars. Semiotica, Vol. 2012, 191 (Jan. 2012), 137--167. https://doi.org/10.1515/sem-2012-0059Google ScholarCross Ref
- Pentti Haddington and Mirka Rauniomaa. 2014. Interaction between road users: offering space in traffic. Space and culture, Vol. 17, 2 (2014), 176--190.Google ScholarCross Ref
- Christian Heath, Jon Hindmarsh, and Paul Luff. 2010. Video in qualitative research: analysing social interaction in everyday life. Sage, London.Google Scholar
- Christian Heath and Paul Luff. 2000. Technology in action. Cambridge university press.Google ScholarDigital Library
- Chien-Ming Huang and Bilge Mutlu. 2012. Robot behavior toolkit: generating effective social behaviors for robots. In 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 25--32. https://doi.org/10.1145/2157689.2157694Google ScholarDigital Library
- Walther Jensen, Simon Hansen, and Hendrik Knoche. 2018. Knowing you, seeing me: investigating user preferences in Drone-Human acknowledgement. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--12.Google ScholarDigital Library
- Wendy Ju. 2015. The design of implicit interactions. Vol. 8. Morgan & Claypool Publishers. http://www.morganclaypool.com/doi/abs/10.2200/S00619ED1V01Y201412HCI028Google Scholar
- Oskar Juhlin. 2010. Social Media on the Road. Vol. 50. Springer London. http://dx.doi.org/10.1007/978--1--84996--332--9_1Google ScholarCross Ref
- Hermann Kaindl, Jürgen Falb, and Cristian Bogdan. 2008. Multimodal communication involving movements of a robot. In CHI'08 Extended Abstracts on Human Factors in Computing Systems. ACM, 3213--3218.Google ScholarDigital Library
- Young Woo Kim, Jae Hyun Han, Yong Gu Ji, and Seul Chan Lee. 2020. Exploring the Effectiveness of External Human-Machine Interfaces on Pedestrians and Drivers. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 65--68.Google Scholar
- Hideaki Kuzuoka, Shinya Oyama, Keiichi Yamazaki, Kenji Suzuki, and Mamoru Mitsuishi. 2000. GestureMan: a mobile robot that embodies a remote instructor's actions. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. ACM Press, 155--162. http://doi.acm.org/10.1145/358916.358986Google ScholarDigital Library
- Eric Laurier and Hayden Lorimer. 2009. Other ways: landscapes of commuting. Landscape Research, Vol. 37, 2 (2009), 207--224.Google ScholarCross Ref
- Eric Laurier, Hayden Lorimer, Barry Brown, Owain Jones, Oskar Juhlin, Allyson Noble, Mark Perry, Daniele Pica, Philippe Sormani, Ignaz Strebel, and others. 2008. Driving and ?passengering': Notes on the ordinary organization of car travel. Mobilities, Vol. 3, 1 (2008), 1--23. http://www.tandfonline.com/doi/abs/10.1080/17450100701797273Google ScholarCross Ref
- Eric Laurier, Daniel Muñoz, Rebekah Miller, and Barry Brown. 2020. A bip, a beeeep, and a beep beep: How horns are sounded in chennai traffic. Research on Language and Social Interaction , Vol. 53, 3 (2020), 341--356. Publisher: Taylor & Francis.Google Scholar
- Yee Mun Lee, Ruth Madigan, and Jorge Garcia. 2019. Understanding the Messages Conveyed by Automated Vehicles. In Proceedings of AutoUI 2019. 134--143. https://doi.org/10.1145/3342197.3344546Google ScholarDigital Library
- Iolanda Leite, Carlos Martinho, and Ana Paiva. 2013. Social robots for long-term interaction: a survey. International Journal of Social Robotics , Vol. 5, 2 (2013), 291--308. http://link.springer.com/article/10.1007/s12369-013-0178-yGoogle ScholarCross Ref
- Stephanie Lowry, Niko Sunderhauf, Paul Newman, John J. Leonard, David Cox, Peter Corke, and Michael J. Milford. 2016. Visual Place Recognition: A Survey. IEEE Transactions on Robotics , Vol. 32, 1 (Feb. 2016), 1--19. https://doi.org/10.1109/TRO.2015.2496823Google ScholarDigital Library
- Paul Luff and Christian Heath. 1998. Mobility in collaboration. In Proceedings of CSCW 1999. ACM, 305--314. http://portal.acm.org/citation.cfm?doid=289444.289505Google ScholarDigital Library
- Karthik Mahadevan, Sowmya Somanath, and Ehud Sharlin. 2018. Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 429:1--429:12. https://doi.org/10.1145/3173574.3174003 event-place: Montreal QC, Canada.Google ScholarDigital Library
- Markus Maurer, J. Christian Gerdes, Barbara Lenz, and Hermann Winner. 2016. Autonomous driving: technical, legal and social aspects. Springer. http://dl.acm.org/citation.cfm?id=2965082Google Scholar
- Paul McIlvenny, Mathias Broth, and Pentti Haddington. 2014. Moving together: Mobile formations in interaction. Space and Culture, Vol. 17, 2 (2014), 104--106.Google ScholarCross Ref
- Donald McMillan, Barry Brown, Ikkaku Kawaguchi, Razan Jaber, Jordi Solsona Belenguer, and Hideaki Kuzuoka. 2019. Designing with gaze: Tama--a gaze activated smart-speaker. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--26. Publisher: ACM New York, NY, USA.Google Scholar
- Donald McMillan, Moira McGregor, and Barry Brown. 2015. From in the wild to in vivo: Video Analysis of Mobile Device Use. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 494--503.Google ScholarDigital Library
- Natasha Merat, Yee Mun Lee, Gustav Markkula, Jim Uttley, Fanta Camara, Charles Fox, André Dietrich, Florian Weber, and Anna Schieben. 2019. How Do We Study Pedestrian Interaction with Automated Vehicles? Preliminary Findings from the European interACT Project. In Road Vehicle Automation 6 (Lecture Notes in Mobility ), , Gereon Meyer and Sven Beiker (Eds.). Springer International Publishing, 21--33.Google Scholar
- Sara Merlino and Lorenza Mondada. 2018. Crossing the street: How pedestrians interact with cars. Language & Communication , Vol. 65 (2018), 131--147.Google ScholarCross Ref
- Lorenza Mondada. 2018. Driving instruction at high speed on a race circuit: Issues in action formation and sequence organization. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 304--325.Google ScholarCross Ref
- Lars Müller, Malte Risto, and Colleen Emmenegger. 2016. The Social Behavior of Autonomous Vehicles. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 686--689. https://doi.org/10.1145/2968219.2968561 event-place: Heidelberg, Germany.Google ScholarDigital Library
- Amir Rasouli and John K. Tsotsos. 2019. Autonomous vehicles that interact with pedestrians: A survey of theory and practice. IEEE Transactions on Intelligent Transportation Systems, Vol. 21, 3 (2019), 900--918.Google ScholarCross Ref
- Stuart Reeves. 2017. Some conversational challenges of talking with machines. (Feb. 2017). https://nottingham-repository.worktribe.com/output/844412Google Scholar
- Malte Risto, Colleen Emmenegger, Erik Vinkhuyzen, Melissa Cefkin, and Jim Hollan. 2017. Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination. In Driving Assesment Conference, Vol. 9. University of Iowa. tex.ids: risto_human-vehicle_2017.Google Scholar
- A. Lincoln Ryave and James N. Schenkein. 1974. Notes on the art of walking. In Ethnomethodology, , R. Turner (Ed.). Penguin, Harmondsworth, 265--74.Google Scholar
- Selma Sabanovic, Marek P. Michalowski, and Reid Simmons. 2006. Robots in the wild: Observing human-robot social interaction outside the lab. In 9th IEEE International Workshop on Advanced Motion Control, 2006. IEEE, 596--601. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1631758Google ScholarCross Ref
- Harvey Sacks. 1995. Lectures on conversation: vol 1 & 2. Vol. I and II. Basil Blackwell, Oxford.Google Scholar
- Dorsa Sadigh, Nick Landolfi, Shankar S. Sastry, Sanjit A. Seshia, and Anca D. Dragan. 2018. Planning for cars that coordinate with people: leveraging effects on human actions for planning and active information gathering over human internal state. Autonomous Robots, Vol. 42, 7 (Oct. 2018), 1405--1426. https://doi.org/10.1007/s10514-018--9746--1Google ScholarDigital Library
- Dorsa Sadigh, Shankar Sastry, Sanjit A. Seshia, and Anca D. Dragan. 2016. Planning for autonomous cars that leverages effects on human actions. In Proceedings of the Robotics: Science and Systems Conference (RSS). https://pdfs.semanticscholar.org/e3e1/a23e0096f8ca51b783812310d44673a3c89a.pdfGoogle Scholar
- Emanuel A. Schegloff. 2007. Sequence Organization in Interaction: Volume 1: A Primer in Conversation Analysis. Cambridge University Press. googlebooksid: 5XbJRFQ4dhsC tex.ids= schegloffSequenceOrganizationInteraction2007a, schegloff_sequence_2007--2, schegloff_sequence_2007--3.Google ScholarCross Ref
- Albrecht Schmidt. 2000. Implicit human computer interaction through context. Personal technologies, Vol. 4, 2--3 (2000), 191--199.Google Scholar
- David Sirkin, Brian Mok, Stephen Yang, and Wendy Ju. 2015. Mechanical Ottoman: How Robotic Furniture Offers and Withdraws Support. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI '15). Association for Computing Machinery, Portland, Oregon, USA, 11--18. https://doi.org/10.1145/2696454.2696461Google ScholarDigital Library
- Robin James Smith. 2017. The practical organisation of space, interaction, and communication in and as the work of crossing a shared space intersection. Sociologica, Vol. 11, 2 (2017).Google Scholar
- Nick Statt. 2016. Tesla customers have driven 100 million miles with Autopilot active. The Verge (May 2016). http://www.theverge.com/2016/5/24/11761098/tesla-autopilot-self-driving-cars-100-million-miles tex.ids: nick_statt_tesla_2016, noauthor_tesla_nodate.Google Scholar
- Tanya Stivers and Jeffrey D. Robinson. 2006. A preference for progressivity in interaction. Language in society, Vol. 35, 3 (2006), 367--392.Google Scholar
- Dante Tezza and Marvin Andujar. 2019. The state-of-the-art of human--drone interaction: A survey. IEEE Access , Vol. 7 (2019), 167438--167454. Publisher: IEEE.Google ScholarCross Ref
- C. Thorpe, M. Herbert, T. Kanade, and S. Shafer. 1991. Toward autonomous driving: the Carnegie Mellon University Navlab. I. Perception. IEEE Expert, Vol. 6, 4 (Aug. 1991), 31--42. https://doi.org/10.1109/64.85919Google ScholarDigital Library
- Sebastian Thrun, Michael Montemerlo, and Andrei Aron. 2006. Probabilistic Terrain Analysis For High-Speed Desert Driving.. In Robotics: Science and Systems. 16--19. http://robots.stanford.edu/papers/thrun.mapping-Stanley.pdfGoogle Scholar
- Sylvaine Tuncer and Barry Brown. 2020. E-scooters on the Ground: Lessons for Redesigning Urban Micro-Mobility. In Proceedings of CHI 2020. ACM Press, Honolulu, USA. https://doi.org/10.1145/3313831.3376759Google ScholarDigital Library
- Chris Urmson, Joshua Anhalt, Drew Bagnell, Christopher Baker, Robert Bittner, M. N. Clark, John Dolan, Dave Duggins, Tugrul Galatali, Chris Geyer, and others. 2008. Autonomous driving in urban environments: Boss and the urban challenge. Journal of Field Robotics , Vol. 25, 8 (2008), 425--466. https://doi.org/10.15607/RSS.2006.II.021Google ScholarCross Ref
- Rod Watson. 1999. Driving in forests and mountains: A pure and applied ethnography. Ethnographic studies , Vol. 3 (1999), 50--60. https://doi.org/10.5449/idslu-001103654 ioGoogle ScholarCross Ref
Index Terms
- Designing Motion: Lessons for Self-driving and Robotic Motion from Human Traffic Interaction
Recommendations
Dynamic intersections and self-driving vehicles
ICCPS '18: Proceedings of the 9th ACM/IEEE International Conference on Cyber-Physical SystemsConnected and automated vehicles are expected to be at the core of future intelligent transportation systems. One of the main practical challenges for self-driving vehicles on public roads is safe cooperation and collaboration among multiple vehicles ...
A merging protocol for self-driving vehicles
ICCPS '17: Proceedings of the 8th International Conference on Cyber-Physical SystemsSelf-driving vehicle technologies are progressing rapidly and are expected to play a significant role in the future of transportation. One of the main challenges for self-driving vehicles on public roads is the safe cooperation and collaboration among ...
Study on mixed traffic of autonomous vehicles and human-driven vehicles with different cyber interaction approaches
AbstractThe emergence of autonomous vehicles will significantly improve traffic efficiency and safety. Before the fully autonomous driving of traffic system, the mixed traffic with autonomous and human-driven vehicles will be a typical feature ...
Comments