skip to main content
10.1145/3489517.3530445acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article
Public Access

Zhuyi: perception processing rate estimation for safety in autonomous vehicles

Published: 23 August 2022 Publication History

Abstract

The processing requirement of autonomous vehicles (AVs) for high-accuracy perception in complex scenarios can exceed the resources offered by the in-vehicle computer, degrading safety and comfort. This paper proposes a sensor frame processing rate (FPR) estimation model, Zhuyi, that quantifies the minimum safe FPR continuously in a driving scenario. Zhuyi can be employed post-deployment as an online safety check and to prioritize work. Experiments conducted using a multi-camera state-of-the-art industry AV system show that Zhuyi's estimated FPRs are conservative, yet the system can maintain safety by processing only 36% or fewer frames compared to a default 30-FPR system in the tested scenarios.

References

[1]
B. Boroujerdian et al. RoboRun: A Robot Runtime to Exploit Spatial Heterogeneity. In ACM/IEEE Design Automation Conference (DAC), 2021.
[2]
Y. Chai et al. MultiPath: Multiple Probabilistic Anchor Trajectory Hypotheses for Behavior Prediction. CoRR, abs/1910.05449, 2019.
[3]
T.-W. Chin et al. Domain-specific Approximation for Object Detection. IEEE Micro, 38(1):31--40, 2018.
[4]
A. Kamenev et al. PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation. CoRR, abs/2109.11094, 2021.
[5]
NIO NAD. https://www.nio.com/no_NO/nad.
[6]
D. Nistér et al. The Safety Force Field. NVIDIA White Paper, 2019.
[7]
NVIDIA DRIVE SDK | NVIDIA Developer. https://developer.nvidia.com/drive/drive-sdk.
[8]
NVIDIA DRIVE Sim. https://developer.nvidia.com/drive/drive-sim.
[9]
NVIDIA Jetson AGX Orin. https://www.nvidia.com/content/dam/en-zz/Solutions/gtcf21/jetson-orin/nvidia-jetson-agx-orin-technical-brief.pdf.
[10]
NVIDIA Opens Up Hyperion 8 AV Platform - NVIDIA Blog. https://blogs.nvidia.com/blog/2021/04/12/nvidia-hyperion-8-autonomous-vehicle-platform/.
[11]
V. J. Reddi et al. MLPerf Inference Benchmark. In International Symposium on Computer Architecture (ISCA), 2020.
[12]
SURFACE VEHICLE RECOMMENDED PRACTICE Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. SAE J3016, 2016.
[13]
S. Shalev-Shwartz et al. On a Formal Model of Safe and Scalable Self-driving Cars. CoRR, abs/1708.06374, 2017.
[14]
Y. C. Tang et al. Multiple Futures Prediction. CoRR, abs/1911.00997, 2019.
[15]
H. Zhao et al. Driving Scenario Perception-Aware Computing System Design in Autonomous Vehicles. In IEEE International Conference on Computer Design (ICCD), 2020.
[16]
H. Zhao et al. Safety Score: A Quantitative Approach to Guiding Safety-Aware Autonomous Vehicle Computing System Design. In IEEE Intelligent Vehicles Symposium (IV), 2020.
[17]
H. Zhao et al. Suraksha: A Framework to Analyze the Safety Implications of Perception Design Choices in AVs. In International Symposium on Software Reliability Engineering (ISSRE), 2021.

Cited By

View all
  • (2024)Shared Memory-contention-aware Concurrent DNN Execution for Diversely Heterogeneous System-on-ChipsProceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming10.1145/3627535.3638502(243-256)Online publication date: 2-Mar-2024
  • (2024)Silent Data Corruption in Robot Operating System: A Case for End-to-End System-Level Fault Analysis Using Autonomous UAVsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.333229343:4(1037-1050)Online publication date: Apr-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DAC '22: Proceedings of the 59th ACM/IEEE Design Automation Conference
July 2022
1462 pages
ISBN:9781450391429
DOI:10.1145/3489517
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 August 2022

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

Conference

DAC '22
Sponsor:
DAC '22: 59th ACM/IEEE Design Automation Conference
July 10 - 14, 2022
California, San Francisco

Acceptance Rates

Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

Upcoming Conference

DAC '25
62nd ACM/IEEE Design Automation Conference
June 22 - 26, 2025
San Francisco , CA , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)172
  • Downloads (Last 6 weeks)22
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Shared Memory-contention-aware Concurrent DNN Execution for Diversely Heterogeneous System-on-ChipsProceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming10.1145/3627535.3638502(243-256)Online publication date: 2-Mar-2024
  • (2024)Silent Data Corruption in Robot Operating System: A Case for End-to-End System-Level Fault Analysis Using Autonomous UAVsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2023.333229343:4(1037-1050)Online publication date: Apr-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media