skip to main content
10.1145/3357236.3395465acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

A Wizard of Oz Study on Passengers' Experiences of a Robo-Taxi Service in Real-Life Settings

Published: 03 July 2020 Publication History

Abstract

Autonomous driving enables new mobility concepts such as shared-autonomous services. Although significant re-search has been done on passenger-car interaction, work on passenger interaction with robo-taxis is still rare. In this paper, we tackle the question of how passengers experience robo-taxis as a service in real-life settings to inform the interaction design. We conducted a Wizard of Oz study with an electric vehicle where the driver was hidden from the passenger to simulate the service experience of a robo-taxi. 10 participants had the opportunity to use the simulated shared-autonomous service in real-life situations for one week. By the week's end, 33 rides were completed and recorded on video. Also, we flanked the study conducting interviews before and after with all participants. The findings provided insights into four design themes that could inform the service design of robo-taxis along the different stages including hailing, pick-up, travel, and drop-off.

References

[1]
Sonia Baltodano, Srinath Sibi, Nikolas Martelaro, Nikhil Gowda, and Wendy Ju. 2015. The RRADS platform: a real road autonomous driving simulator. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 281--288.
[2]
Ralf Bohnsack. 2014. Documentary method. The SAGE handbook of qualitative data analysis: 217--233.
[3]
Barry Brown. 2017. The Social Life of Autonomous Cars.computer 50, 2: 92--96.
[4]
Barry Brown and Eric Laurier. 2017. The Trouble with Autopilots: Assisted and Autonomous Driving on the Social Road. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 416-- 429.
[5]
Wilco Burghout, Pierre Jean Rigole, and Ingmar Andreasson. 2015. Impacts of shared autonomous taxis in a metropolitan area. In Proceedings of the 94th annual meeting of the Transportation Research Board, Washington DC, 2015.
[6]
Carson, B. and Muoio, D. Google is spinning out its self-driving car business into a new company called Waymo.
[7]
Max Chafkin. 2016. Uber's first self-driving fleet arrives in Pittsburgh this month. Bloomberg Business Week 18.
[8]
Chia-Ming Chang, Koki Toda, Daisuke Sakamoto, and Takeo Igarashi. 2017. Eyes on a Car: an Interface Design for Communication between an Autonomous Car and a Pedestrian. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 65--73.
[9]
Ulrich Deinet. 2014. Raumaneignung Jugendlicher zwischen Schule, McDonald's und der Shopping mall. In Tätigkeit-Aneignung-Bildung. Springer, 215--232.
[10]
H. Detjen, S. Geisler, and S. Schneegass. 2019. Maneuver-based Driving for Intervention in Autono-mous Cars. In CHI '19 Workshop: Weaving the Threads of Vehicle Automation.
[11]
Verena Distler, Carine Lallemand, and Thierry Bellet. 2018. Acceptability and acceptance of autonomous mobility on demand: the impact of an immersive experience. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 612.
[12]
Grace Eden, Benjamin Nanchen, Randolf Ramseyer, and Florian Evéquoz. 2017. Expectation and experience: Passenger acceptance of autonomous public transportation vehicles. In IFIP Conference on HumanComputer Interaction, 360--363.
[13]
Dávid Földes and Csaba Csiszár. 2018. Framework for planning the mobility service based on autonomous vehicles. In 2018 Smart City Symposium Prague (SCSP), 1--6.
[14]
Paul Gao, Hans-Werner Kaas, Det Mohr, and Dominik Wee. 2016. Automotive revolution--perspective towards 2030: How the convergence of disruptive technology-driven trends could transform the auto industry. Advanced Industries, McKinsey & Company.
[15]
Nikhil Gowda, Wendy Ju, and Kirstin Kohler. 2014. Dashboard design for an autonomous car. In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 1--4.
[16]
Evin Bahar Guenes, Katharina Hottelart, and Patrice Reilhac. 2018. The Digital Driver of the Future-User Experience Research on Generation Z in Germany. In Road Vehicle Automation 4. Springer, 57--68.
[17]
Alexander Hars. 2015. Self-driving cars: The digital transformation of mobility. In Marktplätze im Umbruch. Springer, 539--549.
[18]
Namwoo Kang, Fred M. Feinberg, and Panos Y. Papalambros. 2017. Autonomous electric vehicle sharing system design. Journal of Mechanical Design 139, 1: 011402.
[19]
Sangwon Kim, Jennifer Jah Eun Chang, Hyun Ho Park, Seon Uk Song, Chang Bae Cha, Ji Won Kim, and Namwoo Kang. 2019. Autonomous Taxi Service Design and User Experience. International Journal of Human-- Computer Interaction: 1--20.
[20]
Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM) 9, 4: 269--275.
[21]
Andrew L. Kun, Susanne Boll, and Albrecht Schmidt. 2016. Shifting gears: User interfaces in the age of autonomous driving. IEEE Pervasive Computing 15, 1: 32--38.
[22]
Andrew L. Kun, Susanne Boll, and Albrecht Schmidt. 2016. Shifting gears: User interfaces in the age of autonomous driving. IEEE Pervasive Computing 15, 1: 32--38.
[23]
Tobias Lagström and Victor Malmsten Lundgren. 2015. An Investigation of Pedestrian-Driver Communication and Development of a Vehicle External Interface. Human Factors 84.
[24]
Leadem, Rose. 2017. Mercedes and Bosch Team Up to Create Self-Driving Taxi System. This new alliance seeks to make a dent in the nascent industry. In Entrepreneur, 4/5/2017. Available online at https://www.entrepreneur.com/article/292446.
[25]
Hod Lipson and Melba Kurman. 2016. Driverless: intelligent cars and the road ahead. Mit Press.
[26]
Todd Litman. 2017. Autonomous vehicle implementation predictions. Victoria Transport Policy Institute Victoria, Canada.
[27]
Felix Lorsignol. 2016. The next big paradigm shift in automotive design. Felix Lorsignol. Retrieved August 29, 2017 from https://medium.com/@florsignol/howto-design-a-driverless-car-4e11b5d9a630
[28]
Victor Malmsten Lundgren, Azra Habibovic, Jonas Andersson, Tobias Lagström, Maria Nilsson, Anna Sirkka, Johan Fagerlönn, Rikard Fredriksson, Claes Edgren, and Stas Krupenia. 2017. Will there be new communication needs when introducing automated vehicles to the urban context? In Advances in human aspects of transportation. Springer, 485--497.
[29]
Roderick McCall, Fintan McGee, Alexander Meschtscherjakov, Nicolas Louveton, and Thomas Engel. 2016. Towards a taxonomy of autonomous vehicle handover situations. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 193--200.
[30]
Alexander Meschtscherjakov, Manfred Tscheligi, Dalila Szostak, Rabindra Ratan, Roderick McCall, Ioannis Politis, and Sven Krome. 2015. Experiencing Autonomous Vehicles: Crossing the Boundaries between a Drive and a Ride. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, 2413--2416.
[31]
Brian Mok, Mishel Johns, David Miller, and Wendy Ju. 2017. Tunneled in: Drivers with active secondary tasks need more time to transition from automation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2840--2844.
[32]
Suvi Nenonen, Heidi Rasila, Juha-Matti Junnonen, and Sam Kärnä. 2008. Customer Journey--a method to investigate user experience. In Proceedings of the Euro FM Conference Manchester, 54--63.
[33]
NHTSA. Automated Vehicles for Safety. Retrieved from https://www.nhtsa.gov/technology-innovation/automated-vehicles-safety
[34]
Sina Nordhoff, Joost de Winter, Ruth Madigan, Natasha Merat, Bart van Arem, and Riender Happee. 2018. User acceptance of automated shuttles in BerlinSchöneberg: A questionnaire study. Transportation Research Part F: Traffic Psychology and Behaviour 58: 843--854.
[35]
Sina Nordhoff, Joost de Winter, William Payre, Bart van Arem, and Riender Happee. 2019. What impressions do users have after a ride in an automated shuttle? An interview study. Transportation Research Part F: Traffic Psychology and Behaviour 63: 252--269.
[36]
Christina Pakusch, Paul Bossauer, Markus Shakoor, and Gunnar Stevens. 2016. Using, Sharing, and Owning Smart Cars-A Future Scenario Analysis Taking General Socio-Technical Trends into Account.
[37]
Christina Pakusch, Gunnar Stevens, Alexander Boden, and Paul Bossauer. 2018. Unintended effects of autonomous driving: A study on mobility preferences in the future. Sustainability 10, 7: 2404.
[38]
Perkins, Chris. 2015. Where's your Uber? New color coding will help you find the right car. In Mashable 2015, 12/3/2015. Available online at https://mashable.com/2015/12/03/uber-spot-light-color-code/. Mashable 12/3/2015. Retrieved from https://mashable.com/2015/12/03/uber-spot-light-color-code/
[39]
Ingrid Pettersson and Wendy Ju. 2017. Design techniques for exploring automotive interaction in the drive towards automation. In Proceedings of the 2017 Conference on Designing Interactive Systems, 147--160.
[40]
Bastian Pfleging, Maurice Rang, and Nora Broy. 2016. Investigating user needs for non-driving-related activities during automated driving. In Proceedings of the 15th international conference on mobile and ubiquitous multimedia, 91--99.
[41]
Kathrin Pollmann, Oilver Stefani, Amelie Bengsch, Matthias Peissner, and Mathias Vukelic. 2019. How to Work in the Car of the Future?: A Neuroergonomical Study Assessing Concentration, Performance and Workload Based on Subjective, Behavioral and Neurophysiological Insights. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 54.
[42]
Simon Ramm, Joseph Giacomin, Duncan Robertson, and Alessio Malizia. 2014. A first approach to understanding and measuring naturalness in driver-car interaction. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 1--10.
[43]
Adam Richardson. 2010. Using customer journey maps to improve customer experience. Harvard business review 15, 1: 2--5.
[44]
Andreas Riener, Susanne Boll, and Andrew L. Kun. 2016. Automotive User Interfaces in the Age of Automation (Dagstuhl Seminar 16262). In Dagstuhl Reports.
[45]
Dirk Rothenbücher, Jamy Li, David Sirkin, Brian Mok, and Wendy Ju. 2016. Ghost driver: A field study investigating the interaction between pedestrians and driverless vehicles. In Robot and Human Interactive Communication (RO-MAN), 2016 25th IEEE International Symposium on, 795--802.
[46]
Wen Shen and Cristina Lopes. 2015. Managing autonomous mobility on demand systems for better passenger experience. In International Conference on Principles and Practice of Multi-Agent Systems, 20--35.
[47]
Roger Silverstone and Leslie Haddon. 1996. Design and the domestication of information and communication technologies: Technical change and everyday life.
[48]
David Sirkin, Kerstin Fischer, Lars Jensen, and Wendy Ju. 2016. Eliciting conversation in robot vehicle interactions. In 2016 AAAI Spring Symposium Series.
[49]
Aaron Steinfeld, Odest Chadwicke Jenkins, and Brian Scassellati. 2009. The oz of wizard: simulating the human for interaction research. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction, 101--108.
[50]
Gunnar Stevens, Paul Bossauer, Stephanie Vonholdt, and Christina Pakusch. 2019. Using Time and Space Efficiently in Driverless Cars: Findings of a Co-Design Study. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 405.
[51]
Gunnar Stevens, Johanna Meurer, Christina Pakusch, and Paul Bossauer. 2016. From a Driver-centric towards a Service-centric lens on Self-Driving Cars.
[52]
Adam Stocker and Susan Shaheen. 2017. Shared automated vehicles: Review of business models.
[53]
Helena Strömberg, Ingrid Pettersson, Jonas Andersson, Annie Rydström, Debargha Dey, Maria Klingegård, and Jodi Forlizzi. 2018. Designing for social experiences with and within autonomous vehicles--exploring methodological directions. Design Science 4.
[54]
Iis P. Tussyadiah, Florian J. Zach, and Jianxi Wang. 2017. Attitudes toward autonomous on demand mobility system: The case of self-driving taxi. In Information and Communication Technologies in Tourism 2017. Springer, 755--766.
[55]
Marcel Walch, Kristin Lange, Martin Baumann, and Michael Weber. 2015. Autonomous driving: investigating the feasibility of car-driver handover assistance. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 11--18.
[56]
Peter Wang, Srinath Sibi, Brian Mok, and Wendy Ju. 2017. Marionette: Enabling On-Road Wizard-of-Oz Autonomous Driving Studies. In Proceedings of the 2017 ACM/IEEE International Conference on HumanRobot Interaction, 234--243.
[57]
Philipp Wintersberger, Anna-Katharina Frison, and Andreas Riener. 2018. Man vs. Machine: Comparing a Fully Automated Bus Shuttle with a Manually Driven Group Taxi in a Field Study. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, 215--220.

Cited By

View all
  • (2024)How to Promote the Adoption of Electric Robotaxis: Understanding the Moderating Role of Inclusive Design on Interactive FeaturesSustainability10.3390/su1620888216:20(8882)Online publication date: 14-Oct-2024
  • (2024)Will Customers’ Understanding of the Trolley Dilemma Hinder Their Adoption of Robotaxi?Sustainability10.3390/su1607297716:7(2977)Online publication date: 3-Apr-2024
  • (2024)Changes in Non-Driving-Related Activities from Conditional to Full Automation and Their Implications for Interior Design: A Systematic Review and Meta-AnalysisApplied Sciences10.3390/app1420944214:20(9442)Online publication date: 16-Oct-2024
  • Show More Cited By

Index Terms

  1. A Wizard of Oz Study on Passengers' Experiences of a Robo-Taxi Service in Real-Life Settings

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference
      July 2020
      2264 pages
      ISBN:9781450369749
      DOI:10.1145/3357236
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 03 July 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. passengers
      2. robo-taxi
      3. service design
      4. shared autonomous vehicles
      5. wizard of oz

      Qualifiers

      • Research-article

      Conference

      DIS '20
      Sponsor:
      DIS '20: Designing Interactive Systems Conference 2020
      July 6 - 10, 2020
      Eindhoven, Netherlands

      Acceptance Rates

      Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

      Upcoming Conference

      DIS '25
      Designing Interactive Systems Conference
      July 5 - 9, 2025
      Funchal , Portugal

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)122
      • Downloads (Last 6 weeks)12
      Reflects downloads up to 25 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)How to Promote the Adoption of Electric Robotaxis: Understanding the Moderating Role of Inclusive Design on Interactive FeaturesSustainability10.3390/su1620888216:20(8882)Online publication date: 14-Oct-2024
      • (2024)Will Customers’ Understanding of the Trolley Dilemma Hinder Their Adoption of Robotaxi?Sustainability10.3390/su1607297716:7(2977)Online publication date: 3-Apr-2024
      • (2024)Changes in Non-Driving-Related Activities from Conditional to Full Automation and Their Implications for Interior Design: A Systematic Review and Meta-AnalysisApplied Sciences10.3390/app1420944214:20(9442)Online publication date: 16-Oct-2024
      • (2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
      • (2024)Deriving Non-Driving-Related Activities in Highly Automated Driving via an Autoethnographic Approach by Traveling Canada in a Recreational VehicleProceedings of Mensch und Computer 202410.1145/3670653.3670663(279-287)Online publication date: 1-Sep-2024
      • (2024)Navigating Privacy Patterns in the Era of Robotaxis2024 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW)10.1109/EuroSPW61312.2024.00011(32-39)Online publication date: 8-Jul-2024
      • (2024)Human or robot? Exploring different avatar appearances to increase perceived security in shared automated vehiclesJournal on Multimodal User Interfaces10.1007/s12193-024-00436-xOnline publication date: 30-Aug-2024
      • (2023)Prototyping Autonomous Vehicle Windshields with AR and Real-Time Object Detection Visualization: An On-Road Wizard-of-Oz StudyProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596051(2123-2137)Online publication date: 10-Jul-2023
      • (2023)Service Design Methods for the Design of Smart SurfacesService Design for Emerging Technologies Product Development10.1007/978-3-031-29306-1_13(235-247)Online publication date: 17-Mar-2023
      • (2022)Optimization of On-Demand Shared Autonomous Vehicle Deployments Utilizing Reinforcement LearningSensors10.3390/s2221831722:21(8317)Online publication date: 29-Oct-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media