skip to main content
10.1145/3177102.3177104acmconferencesArticle/Chapter ViewAbstractPublication PageshotmobileConference Proceedingsconference-collections
research-article

Augmenting Self-Driving with Remote Control: Challenges and Directions

Published: 12 February 2018 Publication History

Abstract

Self-driving or autonomous vehicle systems are being designed over the world with increasing success in recent years. In spite of many advances so far, it is unlikely that such systems are going to ever achieve perfect accuracy under all conditions. In particular, occasional failures are anticipated when such vehicles encounter situations not observed before, or conflicting information is available to the system from the environment. Under such infrequent failure scenarios, the research community has so far, considered two alternatives -- to return control to the driver in the vehicle, which has its own challenges and limitations, or to attempt to safely "park" the vehicle out of harm's way. In this paper, we argue that a viable third alternative exists -- on failure of the self-driving function in the vehicle, the system could return control to a remote human driver located in response centers distributed across the world. This remote human driver will augment the self-driving system in vehicles, only when failures occur, which may be due to bad weather, malfunction, contradiction in sensory inputs, and other such conditions. Of course, a remote driving extension is fraught with many challenges, including the need for some Quality of Service guarantees, both in latency and throughput, in connectivity between the vehicles on the road and the response center, so that the remote drivers can react efficiently to the road conditions. To understand some of the challenges, we have set up real-time streaming testbed and evaluate frame latency with different parameter settings under today's LTE and Wi-Fi networks. While additional optimization techniques can be applied to further reduce streaming latency, we recognize that significant new design of the communication infrastructure is both necessary and possible.

References

[1]
Wikipedia. https://en.wikipedia.org/wiki/Autonomous_car.
[2]
Todd Litman. Autonomous vehicle implementation predictions. Report, 2014.
[3]
Waymo. On the road to fully self-driving, waymo safety report. 2016.
[4]
Autonomous Mercedes-Benz Research & Development. http://mbrdna.com/divisions/autonomous-driving/.
[5]
AutoX. Camera-first ai brings self-driving cars out of the lab and into the real world. https://www.autox.ai/, 2016.
[6]
Daily Mail. http://www.dailymail.co.uk/sciencetech/article-4889594/Google-s-spent-1-1-BILLION-self-driving-cars.html.
[7]
Detlev Marpe, Thomas Wiegand, and Gary J Sullivan. The h. 264/mpeg4 advanced video coding standard and its applications. IEEE communications magazine, 2006.
[8]
Lothar Pantel and Lars C Wolf. On the impact of delay on real-time multiplayer games. In Proceedings of the 12th international workshop on Network and operating systems support for digital audio and video, pages 23--29. ACM, 2002.
[9]
Scott Drew Pendleton, Hans Andersen, Xinxin Du, Xiaotong Shen, Malika Meghjani, You Hong Eng, Daniela Rus, and Marcelo H. Ang. Perception, planning, control, and coordination for autonomous vehicles. Machines, 2017.
[10]
Junxian Huang, Feng Qian, Yihua Guo, Yuanyuan Zhou, Qiang Xu, Z. Morley Mao, Subhabrata Sen, and Oliver Spatscheck. An in-depth study of lte: effect of network protocol and application behavior on performance. In ACM SIGCOMM. ACM, 2013.
[11]
Shunqing Zhang, Xiuqiang Xu, Yiqun Wu, and Lei Lu. 5g: Towards energy-efficient, low-latency and high-reliable communications networks. In ICCS. IEEE, 2014.
[12]
Hanbyul Seo, Ki-Dong Lee, Shinpei Yasukawa, Ying Peng, and Philippe Sartori. Lte evolution for vehicle-to-everything services. IEEE Communications Magazine, 2016.
[13]
Zhenyu Song, Longfei Shangguan, and Kyle Jamieson. Wi-fi goes to town: Rapid picocell switching for wirelesstransit networks. In ACM SIGCOMM Computer Communication Review. ACM, 2017.
[14]
Xinggong Zhang, Yang Xu, Hao Hu, Yong Liu, Zongming Guo, and Yao Wang. Profiling skype video calls: Rate control and video quality. In INFOCOM, 2012 Proceedings IEEE. IEEE, 2012.
[15]
Chenguang Yu, Yang Xu, Bo Liu, and Yong Liu. "can you see me now?" a measurement study of mobile video calls. In INFOCOM, 2014 Proceedings IEEE. IEEE, 2014.
[16]
GStreamer. https://gstreamer.freedesktop.org/.
[17]
Xiaozhi Chen, Huimin Ma, Ji Wan, Bo Li, and Tian Xia. Multi-view 3d object detection network for autonomous driving. In IEEE CVPR, 2017.
[18]
John Leonard, Jonathan How, Seth Teller, Mitch Berger, Stefan Campbell, Gaston Fiore, Luke Fletcher, Emilio Frazzoli, Albert Huang, Sertac Karaman, et al. A perception-driven autonomous urban vehicle. Journal of Field Robotics, 2008.
[19]
Eun-Kyu Lee, Mario Gerla, Giovanni Pau, Uichin Lee, and Jae-Han Lim. Internet of vehicles: From intelligent grid to autonomous cars and vehicular fogs. International Journal of Distributed Sensor Networks, 2016.
[20]
Ankit Singla, Balakrishnan Chandrasekaran, P. Godfrey, and Bruce Maggs. The internet at the speed of light. In HotNets. ACM, 2014.
[21]
Mamta Agiwal, Abhishek Roy, and Navrati Saxena. Next generation 5g wireless networks: A comprehensive survey. IEEE Communications Surveys & Tutorials, 2016.
[22]
Michael Stonebraker, Uur Çetintemel, and Stan Zdonik. The 8 requirements of real-time stream processing. ACM SIGMOD, 2005.
[23]
Kyungmin Lee, David Chu, Eduardo Cuervo, Johannes Kopf, Yury Degtyarev, Sergey Grizan, Alec Wolman, and Jason Flinn. Outatime: Using speculation to enable low-latency continuous interaction for mobile cloud gaming. In MobiSys. ACM, 2015.
[24]
Li Li, Ke Xu, Dan Wang, Chunyi Peng, Kai Zheng, Haiyang Wang, Rashid Mijumbi, and Xiangxiang Wang. A measurement study on skype voice and video calls in lte networks on high speed rails. In IWQoS. IEEE, 2017.
[25]
Najah Abu Ali, Abd-Elhamid M. Taha, and Hossam S. Hassanein. Quality of service in 3gpp r12 lte-advanced. IEEE Communications Magazine, 2013.
[26]
Guan-Hua Tu, Chi-Yu Li, Chunyi Peng, Zengwen Yuan, Yuanjie Li, Xiaohu Zhao, and Songwu Lu. Volte*: A lightweight voice solution to 4g lte networks. In HotMobile. ACM, 2016.

Cited By

View all
  • (2024)Self-Driving CarsReal-World Applications of AI Innovation10.4018/979-8-3693-4252-7.ch016(331-360)Online publication date: 22-Nov-2024
  • (2024)A Multidisciplinary Approach for the Sustainable Technical Design of a Connected, Automated, Shared and Electric Vehicle Fleet for Inner CitiesWorld Electric Vehicle Journal10.3390/wevj1508036015:8(360)Online publication date: 9-Aug-2024
  • (2024)Network Latency in Teleoperation of Connected and Autonomous Vehicles: A Review of Trends, Challenges, and Mitigation StrategiesSensors10.3390/s2412395724:12(3957)Online publication date: 18-Jun-2024
  • Show More Cited By

Index Terms

  1. Augmenting Self-Driving with Remote Control: Challenges and Directions

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      HotMobile '18: Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications
      February 2018
      130 pages
      ISBN:9781450356305
      DOI:10.1145/3177102
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 12 February 2018

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. live streaming
      2. remote control
      3. self-driving car

      Qualifiers

      • Research-article

      Funding Sources

      • US National Science Foundation

      Conference

      HotMobile '18
      Sponsor:

      Acceptance Rates

      HotMobile '18 Paper Acceptance Rate 19 of 65 submissions, 29%;
      Overall Acceptance Rate 96 of 345 submissions, 28%

      Upcoming Conference

      HOTMOBILE '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)164
      • Downloads (Last 6 weeks)10
      Reflects downloads up to 12 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Self-Driving CarsReal-World Applications of AI Innovation10.4018/979-8-3693-4252-7.ch016(331-360)Online publication date: 22-Nov-2024
      • (2024)A Multidisciplinary Approach for the Sustainable Technical Design of a Connected, Automated, Shared and Electric Vehicle Fleet for Inner CitiesWorld Electric Vehicle Journal10.3390/wevj1508036015:8(360)Online publication date: 9-Aug-2024
      • (2024)Network Latency in Teleoperation of Connected and Autonomous Vehicles: A Review of Trends, Challenges, and Mitigation StrategiesSensors10.3390/s2412395724:12(3957)Online publication date: 18-Jun-2024
      • (2024)Dynamic Inversion Method of Calculating Large-Scale Urban Building Height Based on Cooperative Satellite Laser Altimetry and Multi-Source Optical Remote SensingLand10.3390/land1308112013:8(1120)Online publication date: 24-Jul-2024
      • (2024)Understanding the Workload of Remote Truck Operators with Discrete Event SimulationProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/1071181324126298968:1(947-948)Online publication date: 12-Aug-2024
      • (2024)Latency-Free Driving Scene Prediction for On-Road Teledriving With Future-Image-GenerationIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.343548125:11(16676-16686)Online publication date: Nov-2024
      • (2024)Large Data Transfer Optimization for Improved Robustness in Real-Time V2X-CommunicationIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2024.343654843:11(3515-3526)Online publication date: Nov-2024
      • (2024)Fundamental Rules of Teleoperated Driving with Network Latency on Curvy Roads2024 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV55156.2024.10588495(1841-1846)Online publication date: 2-Jun-2024
      • (2024)Towards Kbps-level Vehicle Teleoperation via Persistent-Transient Environment Modelling2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS58592.2024.10802639(13875-13882)Online publication date: 14-Oct-2024
      • (2024)Performance measurement in railway remote driving implementationsIET Intelligent Transport Systems10.1049/itr2.1258018:12(2759-2774)Online publication date: 10-Oct-2024
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      EPUB

      View this article in ePub.

      ePub

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media