skip to main content
10.1145/3605098.3635996acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

MOT-AS: Real-Time Scheduling Framework for Multi-Object Tracking Capturing Accuracy and Stability

Published: 21 May 2024 Publication History

Abstract

Unlike existing accuracy-centric multi-object tracking (MOT), MOT subsystems for autonomous vehicles (AVs) must accurately perceive the surrounding conditions of the vehicle and timely deliver the perception results to the control subsystems before losing stability. In this paper, we proposed MOT-AS (Multi-Object Tracking systems capturing Accuracy and Stability), a novel handover-aware MOT execution and scheduling framework tailored for AVs with multi-cameras, which aims to maximize tracking accuracy without sacrificing system stability. Given the resource limitations inherent to AVs, MOT-AS partitions the handover-aware MOT execution into two distinct sub-executions: tracking handover objects that move across multiple cameras (referred to as global association) and those that move within a single camera (termed local association). It selectively performs the global association only when necessary and carries out local association with multiple execution options to explore the trade-off between accuracy and stability. Building upon MOT-AS, we developed a new scheduling framework encompassing a new MOT task model, offline stability analysis, and online scheduling algorithm to maximize accuracy without compromising stability. We implemented MOT-AS on both high-end and embedded GPU platforms using the Nuscenes dataset, demonstrating enhanced tracking accuracy and stability over conventional MOT systems, irrespective of their handover considerations.

References

[1]
Alex Bewley, Zongyuan Ge, Lionel Ott, Fabio Ramos, and Ben Upcroft. 2016. Simple online and realtime tracking. In IEEE international conference on image processing (ICIP). 3464--3468.
[2]
Holger Caesar, Varun Bankiti, Alex H Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, and Oscar Beijbom. 2020. nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 11621--11631.
[3]
Jinkun Cao, Xinshuo Weng, Rawal Khirodkar, Jiangmiao Pang, and Kris Kitani. 2022. Observation-centric sort: Rethinking sort for robust multi-object tracking. arXiv preprint arXiv:2203.14360 (2022).
[4]
Donghwa Kang, Seunghoon Lee, Hoon Sung Chwa, Seung-Hwan Bae, Chang Mook Kang, Jinkyu Lee, and Hyeongboo Baek. 2022. RT-MOT: Confidence-Aware Real-Time Scheduling Framework for Multi-Object Tracking Tasks. In IEEE Real-Time Systems Symposium (RTSS). IEEE, 318--330.
[5]
Philipp Kohl, Andreas Specker, Arne Schumann, and Jurgen Beyerer. 2020. The mta dataset for multi-target multi-camera pedestrian tracking by weighted distance aggregation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 1042--1043.
[6]
Hyoeun Lee, Youngjoon Choi, Taeho Han, and Kanghee Kim. 2022. Probabilistically Guaranteeing End-to-End Latencies in Autonomous Vehicle Computing Systems. IEEE Trans. Comput. 71, 12 (2022), 3361--3374.
[7]
Jinkyu Lee and Kang G Shin. 2017. Development and use of a new task model for cyber-physical systems: A real-time scheduling perspective. Journal of Systems and Software 126 (2017), 45--56.
[8]
NVIDIA. 2018. Tesla V100. [Online]. Available: https://www.nvidia.com/en-us/data-center/v100/.
[9]
NVIDIA. 2018. Xavier Developer Kit. [Online]. Available: https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/jetson-agx-xavier.
[10]
NVIDIA. 2023. Orin Developer Kit. [Online]. Available: https://www.nvidia.com/ko-kr/autonomous-machines/embedded-systems/jetson-orin/.
[11]
Xingang Pan, Ping Luo, Jianping Shi, and Xiaoou Tang. 2018. Two at once: Enhancing learning and generalization capacities via ibn-net. In Proceedings of the European Conference on Computer Vision (ECCV). 464--479.
[12]
Ziqi Pang, Jie Li, Pavel Tokmakov, Dian Chen, Sergey Zagoruyko, and Yu-Xiong Wang. 2023. Standing Between Past and Future: Spatio-Temporal Modeling for Multi-Camera 3D Multi-Object Tracking. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 17928--17938.
[13]
Yijun Qian, Lijun Yu, Wenhe Liu, and Alexander G Hauptmann. 2020. Electricity: An efficient multi-camera vehicle tracking system for intelligent city. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 588--589.
[14]
Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 779--788.
[15]
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Advances in Neural Information Processing Systems (NeurIPS).
[16]
Ergys Ristani, Francesco Solera, Roger Zou, Rita Cucchiara, and Carlo Tomasi. 2016. Performance measures and a data set for multi-target, multi-camera tracking. In European Conference on Computer Vision (ECCV). 17--35.
[17]
Ultralytics. 2020. YOLOv5 [Online]. Available: https://github.com/ultralytics/yolov5.
[18]
Yifu Zhang, Peize Sun, Yi Jiang, Dongdong Yu, Zehuan Yuan, Ping Luo, Wenyu Liu, and Xinggang Wang. 2021. Bytetrack: Multi-object tracking by associating every detection box. arXiv preprint arXiv:2110.06864 (2021).
[19]
Kaiyang Zhou, Yongxin Yang, Andrea Cavallaro, and Tao Xiang. 2019. Omni-scale feature learning for person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 3702--3712.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SAC '24: Proceedings of the 39th ACM/SIGAPP Symposium on Applied Computing
April 2024
1898 pages
ISBN:9798400702433
DOI:10.1145/3605098
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2024

Check for updates

Author Tags

  1. autonomous vehicles
  2. multi-object tracking
  3. handover
  4. stability analysis
  5. real-time scheduling

Qualifiers

  • Research-article

Funding Sources

  • National Research Foundation of Korea (NRF)

Conference

SAC '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Upcoming Conference

SAC '25
The 40th ACM/SIGAPP Symposium on Applied Computing
March 31 - April 4, 2025
Catania , Italy

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 48
    Total Downloads
  • Downloads (Last 12 months)48
  • Downloads (Last 6 weeks)7
Reflects downloads up to 26 Dec 2024

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media