Stefan Neumeier
Andreas Riener
ABSTRACT
In the domain of automated driving, numerous (technological) problems were solved in recent years, but still many limitations are around that could eventually prevent the deployment of automated driving systems (ADS) beyond SAE level 3. A remote operating fallback authority might be a promising solution. In order for teleoperation to function reliably and universal, it will make use of existing infrastructure, such as cellular networks. Unfortunately, cellular networks might suffer from variable performance. In this work, we investigate the effects of latency on task performance and perceived workload for different driving scenarios. Results from a simulator study (N=28) suggest that latency has negative influence on driving performance and subjective factors and led to a decreased confidence in Teleoperated Driving during the study. A latency of about 300 ms already led to a deteriorated driving performance, whereas variable latency did not consequently deteriorate driving performance.
- AOC. 2019. C32G1 | AOC Monitors. https://eu.aoc.com/en/gaming-monitors/c32g1/specs. Accessed: 08.07.2019.Google Scholar
- Ryad Chellali and Khelifa Baizid. 2011. What Maps and What Displays for Remote Situation Awareness and ROV Localization?. In Human Interface and the Management of Information. Interacting with Information, Gavriel Salvendy and Michael J. Smith (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 364--372.Google Scholar
- J. Y. C. Chen, E. C. Haas, and M. J. Barnes. 2007. Human Performance Issues and User Interface Design for Teleoperated Robots. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 37, 6 (Nov 2007), 1231--1245. https://doi.org/10.1109/TSMCC.2007.905819Google ScholarDigital Library
- Frederic Chucholowski, Tito Tang, and Markus Lienkamp. 2014. Teleoperated Driving Robust and Secure Data Connections. ATZelektronik worldwide 9, 1 (01 Feb 2014), 42--45. https://doi.org/10.1365/s38314-014-0226-xGoogle Scholar
- Frederic Emanuel Chucholowski. 2016. Evaluation of Display Methods for Teleoperation of Road Vehicles. Journal of Unmanned System Technology 3, 3 (2016), 80--85.Google ScholarCross Ref
- Alex Davies. 2017. Nissan's Path to Self-Driving Cars? Humans in Call Centers. https://www.wired.com/2017/01/nissans-self-driving-teleoperation/. Accessed on 21.10.2018.Google Scholar
- Alex Davies. 2019. The War to Remotely Control Self-Driving Cars Heats Up. https://www.wired.com/story/designated-driver-teleoperations-self-driving-cars/. Accessed on 04.04.2019.Google Scholar
- J. Davis, C. Smyth, and K. McDowell. 2010. The Effects of Time Lag on Driving Performance and a Possible Mitigation. IEEE Transactions on Robotics 26, 3 (June 2010), 590--593. https://doi.org/10.1109/TRO.2010.2046695Google ScholarDigital Library
- Matthias Dick, Oliver Wellnitz, and Lars Wolf. 2005. Analysis of Factors Affecting Players' Performance and Perception in Multiplayer Games. In Proceedings of 4th ACM SIGCOMM Workshop on Network and System Support for Games (NetGames '05). ACM, New York, NY, USA, 1--7. https://doi.org/10.1145/1103599.1103624Google ScholarDigital Library
- Forschungsgesellschaft für Straßen- und Verkehrswesen, Arbeitsgruppe Straßenentwurf. 2012. Richtlinien für die Anlage von Landstraßen: RAL.Google Scholar
- Anna-Katharina Frison, Philipp Wintersberger, Andreas Riener, Clemens Schartmüller, Linda Ng Boyle, Erika Miller, and Klemens Weigl. 2019. In UX We Trust: Investigation of Aesthetics and Usability of Driver-Vehicle Interfaces and Their Impact on the Perception of Automated Driving. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 144, 13 pages. https://doi.org/10.1145/3290605.3300374Google ScholarDigital Library
- J. Georg, J. Feiler, F. Diermeyer, and M. Lienkamp. 2018. Teleoperated Driving, a Key Technology for Automated Driving? Comparison of Actual Test Drives with a Head Mounted Display and Conventional Monitors. In 21st International Conference on Intelligent Transportation Systems (ITSC). IEEE, Maui, HI, USA, 3403--3408. https://doi.org/10.1109/ITSC.2018.8569408Google Scholar
- Sebastian Gnatzig, Frederic Chucholowski, Tito Tang, and Markus Lienkamp. 2013. A System Design for Teleoperated Road Vehicles.. In ICINCO 2013 - Proceedings of the 10th International Conference on Informatics in Control, Automation and Robotics. Reykjavik; Iceland, 231--238.Google Scholar
- Mark Harris. 2018. CES 2018: Phantom Auto Demonstrates First Remote-Controlled Car on Public Roads. https://spectrum.ieee.org/cars-that-think/transportation/self-driving/ces-2018-phantom-auto-demonstrates-first-remotecontrolled-car-on-public-roads. Accessed on 28.11.2018.Google Scholar
- Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139--183. https://doi.org/10.1016/S0166-4115(08)62386-9Google Scholar
- A. Hosseini and M. Lienkamp. 2016. Enhancing telepresence during the teleoperation of road vehicles using HMD-based mixed reality. In 2016 IEEE Intelligent Vehicles Symposium (IV). IEEE, Gothenburg, Sweden, 1366--1373. https://doi.org/10.1109/IVS.2016.7535568Google ScholarDigital Library
- Lei Kang, Wei Zhao, Bozhao Qi, and Suman Banerjee. 2018. Augmenting Self-Driving with Remote Control: Challenges and Directions. In Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications (HotMobile '18). ACM, New York, NY, USA, 19--24. https://doi.org/10.1145/3177102.3177104Google ScholarDigital Library
- A. H. Khan, M. A. Qadeer, J. A. Ansari, and S. Waheed. 2009. 4G as a Next Generation Wireless Network. In 2009 International Conference on Future Computer and Communication. IEEE, Kuala Lumpar, Malaysia, 334--338. https://doi.org/10.1109/ICFCC.2009.108Google ScholarDigital Library
- G. Knappe, A. Keinath, K. Bengler, and C. Meinecke. 2007. Driving Simulators as an Evaluation Tool - Assessment of the Influence of the Field of View and Secondary Tasks on Lane Keeping and Steering Performance. In 20th International Technical Conference on the Enhanced Safety of Vehicles (ESV) (DOT-HS), Vol. 810--736. Lyon, France.Google Scholar
- S Lichiardopol. 2007. A survey on teleoperation. Technische Universitat Eindhoven, DCT report (2007).Google Scholar
- Todd Litman. 2019. Autonomous Vehicle Implementation Predictions - Implications for Transport Planning. Technical Report. Victoria Transport Policy Institute Victoria, Canada.Google Scholar
- Ruilin Liu, Daehan Kwak, Srinivas Devarakonda, Kostas Bekris, and Liviu Iftode. 2017. Investigating Remote Driving over the LTE Network. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 264--269. https://doi.org/10.1145/3122986.3123008Google ScholarDigital Library
- Logitech. 2019. Logitech G920 & G29 Driving Force Steering Wheels & Pedals. https://www.logitechg.com/en-us/products/driving/driving-force-racing-wheel.html. Accessed: 08.07.2019.Google Scholar
- Jason P. Luck, Patricia L. McDermott, Laurel Allender, and Deborah C. Russell. 2006. An Investigation of Real World Control of Robotic Assets Under Communication Latency. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-robot Interaction (HRI '06). ACM, New York, NY, USA, 202--209. https://doi.org/10.1145/1121241.1121277Google Scholar
- Stefan Neumeier. 2019. OpenROUTS3D. https://git.io/fj8tn. Accessed: 16.05.2019.Google Scholar
- Stefan Neumeier and Christian Facchi. 2019. Towards a Driver Support System for Teleoperated Driving. In 22nd Intelligent Transportation Systems Conference (ITSC). IEEE, Auckland, New Zealand. Accepted Paper.Google ScholarDigital Library
- Stefan Neumeier, Nicolas Gay, Clemens Dannheim, and Christian Facchi. 2018. On the Way to Autonomous Vehicles - Teleoperated Driving. In AmE 2018 - Automotive meets Electronics; 9th GMM-Symposium. VDE, Dortmund, Germany, 1--6.Google Scholar
- Stefan Neumeier, Ermias Walelgne, Vaibhav Bajpai, Joerg Ott, and Christian Facchi. 2019. Measuring the Feasibility of Teleoperated Driving in Mobile Networks. In 2019 Network Traffic Measurement and Analysis Conference (TMA). IEEE, Paris, France, 113--120.Google Scholar
- C. W. Nielsen, M. A. Goodrich, and R. W. Ricks. 2007. Ecological Interfaces for Improving Mobile Robot Teleoperation. IEEE Transactions on Robotics 23, 5 (Oct 2007), 927--941. https://doi.org/10.1109/TRO.2007.907479Google ScholarDigital Library
- On-Road Automated Driving (ORAD) committee. 2018. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles.Google Scholar
- PlayseatStore. 2019. Playseat Evolution Alcantara - For all your racing needs. https://www.playseatstore.com/evolution-playstation.html#swatch_id=2156. Accessed: 08.07.2019.Google Scholar
- Xiaotong Shen, Zhuang Jie Chong, Scott Pendleton, Guo Ming James Fu, Baoxing Qin, Emilio Frazzoli, and Marcelo H. Ang. 2016. Teleoperation of On-Road Vehicles via Immersive Telepresence Using Off-the-shelf Components. Springer International Publishing, Cham, 1419--1433. https://doi.org/10.1007/978-3-319-08338-4_102Google Scholar
- Trent W Victor, Emma Tivesten, Par Gustavsson, Joel Johansson, Fredrik Sangberg, and Mikael Ljung Aust. 2018. Automation expectation mismatch: Incorrect prediction despite eyes on threat and hands on wheel. Human factors 60, 8 (2018), 1095--1116.Google Scholar
- Steve Vozar and Dawn M. Tilbury. 2014. Driver Modeling for Teleoperation with Time Delay. IFAC Proceedings Volumes 47, 3 (2014), 3551--3556. https://doi.org/10.3182/20140824-6-ZA-1003.02275 19th IFAC World Congress.Google Scholar
- Alan Ft Winfield. 2000. Future Directions in Tele-operated Robotics. In Telerobotic Applications.Google Scholar
Index Terms
- Teleoperation: The Holy Grail to Solve Problems of Automated Driving? Sure, but Latency Matters
Recommendations
Driving with Black Box Assistance: Teleoperated Driving Interface Design Guidelines for Computational Driver Assistance Systems in Unstructured Environments
AutomotiveUI '23: Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular ApplicationsThis paper presents design guidelines for teleoperated driving interfaces within computational driver assistance systems for unstructured environments. The purpose of the guidelines is to manage the unpredictability of computational model-based ...
Generative Model-Based Simulation of Driver Behavior When Using Control Input Interface for Teleoperated Driving in Unstructured Canyon Terrains
Towards Autonomous Robotic SystemsAbstractUnmanned ground vehicles (UGVs) in unstructured environments mostly operate through teleoperation. To enable stable teleoperated driving in unstructured environments, some research has suggested driver assistance and evaluation methods that ...
FineComb: measuring microscopic latency and loss in the presence of reordering
Modern stock trading and cluster applications require microsecond latencies and almost no losses in data centers. This paper introduces an algorithm called FineComb that can obtain fine-grain end-to-end loss and latency measurements between edge routers ...
Comments