skip to main content
10.1145/3126594.3126655acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

Reinventing the Wheel: Transforming Steering Wheel Systems for Autonomous Vehicles

Published: 20 October 2017 Publication History

Abstract

In this paper, we introduce two different transforming steering wheel systems that can be utilized to augment user experience for future partially autonomous and fully autonomous vehicles. The first one is a robotic steering wheel that can mechanically transform by using its actuators to move the various components into different positions. The second system is a LED steering wheel that can visually transform by using LEDs embedded along the rim of wheel to change colors. Both steering wheel systems contain onboard microcontrollers developed to interface with our driving simulator. The main function of these two systems is to provide emergency warnings to drivers in a variety of safety critical scenarios, although the design space that we propose for these steering wheel systems also includes the use as interactive user interfaces. To evaluate the effectiveness of the emergency alerts, we conducted a driving simulator study examining the performance of participants (N=56) after an abrupt loss of autonomous vehicle control. Drivers who experienced the robotic steering wheel performed significantly better than those who experienced the LED steering wheel. The results of this study suggest that alerts utilizing mechanical movement are more effective than purely visual warnings.

Supplementary Material

suppl.mov (uistf4432-file3.mp4)
Supplemental video
MP4 File (p229-mok.mp4)

References

[1]
David A. Abbink, Mark Mulder, and Erwin R. Boer. 2012. Haptic shared control: smoothly shifting control authority? Cognition, Technology & Work 14, 1: 19-- 28.
[2]
Dillis V. Allen. 1994. Steering wheel assembly with communication keyboard. Google Patents. Retrieved from https://www.google.com/patents/US5319803
[3]
Avinash Balachandran and J. Christian Gerdes. 2015. Designing Steering Feel for Steer-by-Wire Vehicles Using Objective Measures. IEEE/ASME Transactions on Mechatronics 20, 1: 373--383.
[4]
Frank Beruscha, Klaus Augsburg, and Dietrich Manstetten. 2011. Haptic warning signals at the steering wheel: A literature survey regarding lane departure warning systems. Retrieved from https://digital.lib.washington.edu/researchworks/handle /1773/34898
[5]
Arie P. van den Beukel and Mascha C. van der Voort. 2013. The influence of time-criticality on Situation Awareness when retrieving human control after automated driving. In 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), 2000--2005.
[6]
BMW Group. The Next 100 Years - Brand Visions. Retrieved from https://www.bmwgroup.com/en/next100/brandvisions. html
[7]
Avinoam Borowsky and Tal Oron-Gilad. 2016. The effects of automation failure and secondary task on drivers' ability to mitigate hazards in highly or semiautomated vehicles. Advances in Transportation Studies, 1.
[8]
Karel A. Brookhuis and Dick de Waard. 2010. Monitoring drivers' mental workload in driving simulators using physiological measures. Accident Analysis & Prevention 42, 3: 898--903.
[9]
Marcelo Coelho, Hiroshi Ishii, and Pattie Maes. 2008. Surflex: a programmable surface for the design of tangible interfaces. In CHI'08 extended abstracts on Human factors in computing systems, 3429--3434. http://dl.acm.org/citation.cfm?id=1358869
[10]
Marcelo Coelho and Jamie Zigelbaum. 2011. Shapechanging interfaces. Personal and Ubiquitous Computing 15, 2: 161--173.
[11]
Daniel Damböck and Klaus Bengler. Übernahmezeiten beim hochautomatisierten Fahren. Retrieved from http://www.ftm.mw.tum.de/uploads/media/24_Dambo eck.pdf
[12]
Tanja Döring, Dagmar Kern, Paul Marshall, Max Pfeiffer, Johannes Schöning, Volker Gruhn, and Albrecht Schmidt. 2011. Gestural Interaction on the Steering Wheel: Reducing the Visual Demand. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 483--492.
[13]
H. O. Duncan. 1927. The world on wheels, by H. O. Duncan.
[14]
Enes Selman Ege, Furkan Cetin, and Cagatay Basdogan. 2011. Vibrotactile feedback in steering wheel reduces navigation errors during GPS-guided car driving. In World Haptics Conference (WHC), 2011 IEEE, 345--348. http://ieeexplore.ieee.org/abstract/document/5945510/
[15]
Gregory M. Fitch, Jonathan M. Hankey, Brian M. Kleiner, and Thomas A. Dingus. 2011. Driver comprehension of multiple haptic seat alerts intended for use in an integrated collision avoidance system. Transportation Research Part F: Traffic Psychology and Behaviour 14, 4: 278--290.
[16]
Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming user interfaces: programmable particle stiffness and sensing for malleable and shape-changing devices. In Proceedings of the 25th annual ACM symposium on User interface software and technology, 519--528. http://dl.acm.org/citation.cfm?id=2380181
[17]
Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. In Uist, 417--426. http://dl.acm.org/citation.cfm?doid=2501988.2502032
[18]
Terrence Fong and Charles Thorpe. 2001. Vehicle Teleoperation Interfaces. Autonomous Robots 11, 1: 9-- 18.
[19]
Terrence W. Fong, Francois Conti, Sébastien Grange, and Charles Baur. 2001. Novel interfaces for remote driving: gesture, haptic, and PDA. In Intelligent Systems and Smart Manufacturing, 300--311. http://proceedings.spiedigitallibrary.org/data/Conferen ces/SPIEP/39298/300_1.pdf
[20]
Christian Gold, Daniel Damböck, Lutz Lorenz, and Klaus Bengler. 2013. "Take over!" How long does it take to get the driver back into the loop? In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 1938--1942. http://pro.sagepub.com/content/57/1/1938.short
[21]
Sungjae Hwang and Jung-hee Ryu. 2010. The Haptic steering Wheel: Vibro-tactile based navigation for the driving environment. In Pervasive Computing and Communications Workshops (PERCOM Workshops), 2010 8th IEEE International Conference on, 660--665. http://ieeexplore.ieee.org/abstract/document/5470517/
[22]
Wijnand A. IJsselsteijn, Huib de Ridder, Jonathan Freeman, and Steve E. Avons. 2000. Presence: concept, determinants, and measurement. 520--529.
[23]
International Organization for Standards. ISO 22324:2015(en), Societal security -- Emergency management -- Guidelines for colour-coded alerts. Retrieved from https://www.iso.org/obp/ui/#iso:std:50061:en
[24]
Toshio Ito, Arata Takata, and Kenta Oosawa. 2016. Time Required for Take-over from Automated to Manual Driving.
[25]
Dagmar Kern, Paul Marshall, Eva Hornecker, Yvonne Rogers, and Albrecht Schmidt. 2009. Enhancing navigation information with tactile output embedded into the steering wheel. Pervasive Computing: 42--58.
[26]
Miltos Kyriakidis, Joost C. F. de Winter, Neville Stanton, Thierry Bellet, Bart van Arem, Karel Brookhuis, Marieke Martens, Klaus Bengler, Jan Andersson, Natasha Merat, Nick Reed, Matt Flament, Marjan Hagenzieker, and Riender Happee. 2017. A human factors perspective on automated driving. Theoretical Issues in Ergonomics Science: 1--27.
[27]
John E. Lahiff. 1997. Vehicle information display on steering wheel surface. Google Patents. Retrieved from https://www.google.com/patents/US5691695
[28]
David Lakatos and Hiroshi Ishii. 2012. Towards Radical Atoms-Form-giving to transformable materials. In Cognitive Infocommunications (CogInfoCom), 2012 IEEE 3rd International Conference on, 37--40. http://ieeexplore.ieee.org/abstract/document/6422023/
[29]
Tin Lun Lam, Huihuan Qian, and Yangsheng Xu. 2010. Omnidirectional Steering Interface and Control for a Four-Wheel Independent Steering Vehicle. IEEE/ASME Transactions on Mechatronics 15, 3: 329--338.
[30]
Vivien Melcher, Stefan Rauh, Frederik Diederichs, Harald Widlroither, and Wilhelm Bauer. 2015. TakeOver Requests for Automated Driving. Procedia Manufacturing 3: 2867--2873.
[31]
Mercedes-Benz USA. The Mercedes-Benz F 015 Luxury in Motion. Retrieved July 16, 2017 from https://www.mbusa.com/vcm/MB/DigitalAssets/AboutUs/PressReleases/F_015_Luxury_in_Motion_enus.pdf
[32]
Georg Michelitsch, Jason Williams, Martin Osen, Beatriz Jimenez, and Stefan Rapp. 2004. Haptic chameleon: a new concept of shape-changing user interface controls with force feedback. In CHI'04 extended abstracts on Human factors in computing systems, 1305--1308. http://dl.acm.org/citation.cfm?id=986050
[33]
David Miller, Annabel Sun, Mishel Johns, Hillary Page Ive, David Sirkin, Sudipto Aich, and Wendy Ju. 2015. Distraction Becomes Engagement in Automated Driving. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, October 2015.
[34]
Brian Mok, Mishel Johns, Key Jung Lee, Hillary Page Ive, David Miller, and Wendy Ju. 2015. Timing of unstructured transitions of control in automated driving. In 2015 IEEE Intelligent Vehicles Symposium (IV), 1167--1172.
[35]
Brian Mok, Mishel Johns, Key Jung Lee, David Miller, David Sirkin, Page Ive, and Wendy Ju. 2015. Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles. In Intelligent Transportation Systems (ITSC), 2015 IEEE 18th International Conference on, 2458--2464. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7
[36]
Brian Mok, Mishel Johns, David Miller, and Wendy Ju. 2017. Tunneled In: Drivers with Active Secondary Tasks Need More Time to Transition from Automation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2840--2844. http://dl.acm.org/citation.cfm?id=3025713
[37]
Brian Mok, Mishel Johns, Stephen Yang, and Wendy Ju. 2017. Actions Speak Louder: Effects of a Transforming Steering Wheel on Post-Transition Driver Performance. In IEEE 20th International Conference on Intelligent Transportation Systems.
[38]
MOTOR1. Audi James 2025 virtual cockpit of the future. Retrieved from https://www.youtube.com/watch?v=LBiVk31rvjA
[39]
Mark Mulder, David A. Abbink, and Erwin R. Boer. 2008. The effect of haptic guidance on curve negotiation behavior of young, experienced drivers. In Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on, 804--809. http://ieeexplore.ieee.org/abstract/document/4811377/
[40]
Yoshitoshi Murata and Kazuhiro Yoshida. Automobile Driving Interface Using Gesture Operations for Disabled People. Retrieved April 4, 2017 from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1 .1.679.2206
[41]
Nissan USA. Nissan IDS Concept: Nissan's vision for the future of EVs and autonomous driving. Nissan Online Newsroom. Retrieved July 16, 2017 from http://nissannews.com/enUS/nissan/usa/releases/nissan-ids-concept-nissan-svision-for-the-future-of-evs-and-autonomous-driving
[42]
S. M. Petermeijer, S. Cieler, and J. C. F. de Winter. 2017. Comparing spatially static and dynamic vibrotactile take-over requests in the driver seat. Accident Analysis & Prevention 99, Part A: 218--227.
[43]
Bastian Pfleging, Stefan Schneegass, and Albrecht Schmidt. 2012. Multimodal Interaction in the Car: Combining Speech and Gestures on the Steering Wheel. In Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '12), 155--162.
[44]
Christopher J. Ploch, Jung Hwa Bae, Wendy Ju, and Mark Cutkosky. 2016. Haptic skin stretch on a steering wheel for displaying preview information in autonomous cars. In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on, 60--65. http://ieeexplore.ieee.org/abstract/document/7759035/
[45]
Jonas Radlmayr, Christian Gold, Lutz Lorenz, Mehdi Farid, and Klaus Bengler. 2014. How traffic situations and non-driving related tasks affect the take-over quality in highly automated driving. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 2063--2067. http://pro.sagepub.com/content/58/1/2063.short
[46]
Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbaek. 2012. Shapechanging Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 735--744.
[47]
SAE International. Taxonomy and Definitions for Terms Related to Driving Automation Systems for OnRoad Motor Vehicles. SAE International. Retrieved January 21, 2017 from http://standards.sae.org/j3016_201609/
[48]
SAE International. J2944: Operational Definitions of Driving Performance Measures and Statistics - SAE International. Retrieved from http://standards.sae.org/j2944_201506/
[49]
Gözel Shakeri, Alexander Ng, John H. Williamson, and Stephen A. Brewster. 2016. Evaluation of Haptic Patterns on a Steering Wheel. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Automotive'UI 16), 129--136.
[50]
David Sirkin and Wendy Ju. 2012. Consistency in physical and on-screen action improves perceptions of telepresence robots. In Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction, 57--64. http://dl.acm.org/citation.cfm?id=2157699
[51]
Micah Steele and R. Brent Gillespie. 2001. Shared control between human and machine: Using a haptic steering wheel to aid in land vehicle guidance. In Proceedings of the human factors and ergonomics society annual meeting, 1671--1675.
[52]
Joris C Verster and Thomas Roth. 2011. Standard operation procedures for conducting the on-the-road driving test, and measurement of the standard deviation of lateral position (SDLP). International Journal of General Medicine 4: 359--371.
[53]
Volvo Cars. Volvo Concept 26 | Intillisafe | Volvo Cars. Retrieved from http://www.volvocars.com/intl/about/our-innovationbrands/intellisafe/autonomous-driving/c26
[54]
Volvo Cars. Volvo Cars conducts research into driver sensors in order to create cars that get to know their drivers. Retrieved from https://www.media.volvocars.com/global/engb/media/pressreleases/140898/volvo-cars-conductsresearch-into-driver-sensors-in-order-to-create-carsthat-get-to-know-their-driv
[55]
David Wilfinger, Martin Murer, Sebastian Osswald, Alexander Meschtscherjakov, and Manfred Tscheligi. 2013. The Wheels Are Turning: Content Rotation on Steering Wheel Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1809--1812.
[56]
Yanfeng Automotive Interiors. XiM17: "the next living space" interior autonomous concept car debuts at NAIAS 2017. Retrieved from https://www.youtube.com/watch?v=56Ow8cw1m6o
[57]
Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: pneumatically actuated soft composite materials for shape changing interfaces. In Proceedings of the 26th annual ACM symposium on User interface software and Technology, 13--22. http://dl.acm.org/citation.cfm?id=2502037
[58]
Kathrin Zeeb, Axel Buchner, and Michael Schrauf. 2015. What determines the take-over time? An integrated model approach of driver take-over after automated driving. Accident Analysis & Prevention 78: 212--221.

Cited By

View all
  • (2023)Human-Vehicle Interaction to Support Driver's Situation Awareness in Automated Vehicles: A Systematic ReviewIEEE Transactions on Intelligent Vehicles10.1109/TIV.2022.32008268:3(2551-2567)Online publication date: Mar-2023
  • (2022)A Systematic Evaluation of Solutions for the Final 100m Challenge of Highly Automated VehiclesProceedings of the ACM on Human-Computer Interaction10.1145/35467136:MHCI(1-19)Online publication date: 20-Sep-2022
  • (2022)A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature ReviewProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346176:2(1-51)Online publication date: 7-Jul-2022
  • Show More Cited By

Index Terms

  1. Reinventing the Wheel: Transforming Steering Wheel Systems for Autonomous Vehicles

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
    October 2017
    870 pages
    ISBN:9781450349819
    DOI:10.1145/3126594
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 October 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. autonomous vehicles
    2. human machine interaction
    3. transforming steering wheel
    4. transition of control

    Qualifiers

    • Research-article

    Conference

    UIST '17

    Acceptance Rates

    UIST '17 Paper Acceptance Rate 73 of 324 submissions, 23%;
    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)63
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 21 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Human-Vehicle Interaction to Support Driver's Situation Awareness in Automated Vehicles: A Systematic ReviewIEEE Transactions on Intelligent Vehicles10.1109/TIV.2022.32008268:3(2551-2567)Online publication date: Mar-2023
    • (2022)A Systematic Evaluation of Solutions for the Final 100m Challenge of Highly Automated VehiclesProceedings of the ACM on Human-Computer Interaction10.1145/35467136:MHCI(1-19)Online publication date: 20-Sep-2022
    • (2022)A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature ReviewProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346176:2(1-51)Online publication date: 7-Jul-2022
    • (2022)Multimodal Displays for Takeover RequestsUser Experience Design in the Era of Automated Driving10.1007/978-3-030-77726-5_15(397-424)Online publication date: 1-Jan-2022
    • (2021)Evaluation of Imminent Take-Over Requests With Real Automation on a Test TrackHuman Factors: The Journal of the Human Factors and Ergonomics Society10.1177/0018720821105143565:8(1776-1792)Online publication date: 15-Dec-2021
    • (2020)Lookie Here! Designing Directional User Indicators across Displays in Conditional Driving AutomationSAE Technical Paper Series10.4271/2020-01-1201Online publication date: 14-Apr-2020
    • (2020)User Perception and the Effect of Forms and Movements in Human-Machine Interaction Applying Steer-By-Wire for Autonomous VehiclesHCI in Mobility, Transport, and Automotive Systems. Automated Driving and In-Vehicle Experience Design10.1007/978-3-030-50523-3_5(58-77)Online publication date: 19-Jul-2020
    • (2020)Designing an AI-Companion to Support the Driver in Highly Autonomous CarsHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_23(335-349)Online publication date: 10-Jul-2020
    • (2019)Secondary task and situation awareness, a mobile application for semi-autonomous vehicleProceedings of the 31st Conference on l'Interaction Homme-Machine10.1145/3366550.3372258(1-10)Online publication date: 10-Dec-2019
    • (2019)Secondary task and situation awareness, a mobile application for conditionally automated vehiclesProceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings10.1145/3349263.3351500(86-92)Online publication date: 21-Sep-2019
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media