StarStream: Live Video Analytics over Space Networking
Pages 7909 - 7917
Abstract
Streaming videos from resource-constrained front-end devices over networks to resource-rich cloud servers has long been a common practice for surveillance and analytics. Most existing live video analytics (LVA) systems, however, have been built over terrestrial networks, limiting their applications during natural disasters and in remote areas that desperately call for real-time visual data delivery and scene analysis. With the recent advent of space networking, in particular, Low Earth Orbit (LEO) satellite constellations such as Starlink, high-speed truly global Internet access is becoming available and affordable. This paper examines the challenges and potentials of LVA over modern LEO satellite networking (LSN). Using Starlink as the testbed, we have carried out extensive in-the-wild measurements to gain insights into its achievable performance for LVA. The results reveal that the uplink bottleneck in today's LSN, together with the volatile network conditions, can significantly affect the service quality of LVA and necessitate prompt adaptation. We accordingly develop StarStream, a novel LSN-adaptive streaming framework for LVA. At its core, StarStream is empowered by a Transformer-based network performance predictor tailored for LSN and a content-aware configuration optimizer. We discuss a series of key design and implementation issues of StarStream and demonstrate its effectiveness and superiority through trace-driven experiments with real-world network and video processing data.
References
[1]
E. Alimpertis, A. Markopoulou, C. Butts, and K. Psounis. 2019. City-Wide Signal Strength Maps: Prediction with Random Forests. In The World Wide Web Conference (WWW'19). 2536--2542.
[2]
G. Ananthanarayanan, P. Bahl, P. Bodík, K. Chintalapudi, M. Philipose, L. Ravindranath, and S. Sinha. 2017. Real-Time Video Analytics: The Killer App for Edge Computing. IEEE Computer, Vol. 50, 10 (2017), 58--67.
[3]
AWS. 2024. Amazon EC2 P3 Instances. https://aws.amazon.com/ec2/instance-types/p3/. [Online; accessed 6 August 2024].
[4]
C. Canel, T. Kim, G. Zhou, C. Li, H. Lim, D. G. Andersen, M. Kaminsky, and S. R. Dulloor. 2019. Scaling Video Analytics on Constrained Edge Nodes. In Proceedings of the 2nd SysML Conference (SysML'19).
[5]
X. Cao and X. Zhang. 2023. SaTCP: Link-Layer Informed TCP Adaptation for Highly Dynamic LEO Satellite Networks. In IEEE Conference on Computer Communications (INFOCOM'23). IEEE, 1--10.
[6]
CNBC. 2021. Google wins cloud deal from Elon Musk?s SpaceX for Starlink internet connectivity. https://www.cnbc.com/2021/05/13/google-cloud-wins-spacex-deal-for-starlink-internet-connectivity.html. [Online; accessed 6 August 2024].
[7]
FFmpeg. 2022. FFmpeg Documentation. https://ffmpeg.org/doxygen/4.4/index.html. [Online; accessed 6 August 2024].
[8]
FFmpeg. 2023. H.264 Video Encoding Guide. https://trac.ffmpeg.org/wiki/Encode/H.264. [Online; accessed 6 August 2024].
[9]
M. Ghoshal, Z J. Kong, Q. Xu, Z. Lu, S. Aggarwal, I. Khan, Y. Li, Y C. Hu, and D. Koutsonikolas. 2022. An In-Depth Study of Uplink Performance of 5G mmWave Networks. In Proceedings of the ACM SIGCOMM Workshop on 5G and Beyond Network Measurements, Modeling, and Use Cases (5G-MeMU'22). 29--35.
[10]
iPerf. 2024. iPerf - The ultimate speed test tool for TCP, UDP and SCTP. https://iperf.fr/iperf-download.php. [Online; accessed 6 August 2024].
[11]
M. M Kassem, A. Raman, D. Perino, and N. Sastry. 2022. A Browser-side View of Starlink Connectivity. In Proceedings of the 22nd ACM Internet Measurement Conference (IMC'22). 151--158.
[12]
J. Lee, S. Lee, J. Lee, S. Sathyanarayana, H. Lim, J. Lee, X. Zhu, S. Ramakrishnan, D. Grunwald, K. Lee, et al. 2020. PERCEIVE: Deep Learning-based Cellular Uplink Prediction Using Real-Time Scheduling Patterns. In Proceedings of the 18th International Conference on Mobile Systems, Applications, and Services (MobiSys'20). 377--390.
[13]
C. Li, R.-X. Zhang, T. Huang, L. Jia, and L. Sun. 2023. Concerto: Client-server Orchestration for Real-Time Video Analytics. In Proceedings of the 31st ACM International Conference on Multimedia (MM'23). 9215--9223.
[14]
Y. Li, A. Padmanabhan, P. Zhao, Y. Wang, G. H. Xu, and R. Netravali. 2020. Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication (SIGCOMM'20). 359--376.
[15]
S. Liu, T. Wang, J. Li, D. Sun, M. Srivastava, and T. Abdelzaher. 2022. AdaMask: Enabling Machine-Centric Video Streaming with Adaptive Frame Masking for DNN Inference Offloading. In Proceedings of the 30th ACM International Conference on Multimedia (MM'22). 3035--3044.
[16]
G. Lv, Q. Wu, W. Wang, Z. Li, and G. Xie. 2022. Lumos: Towards Better Video Streaming QoE through Accurate Throughput Prediction. In IEEE Conference on Computer Communications (INFOCOM'22). IEEE, 650--659.
[17]
S. Ma, Y. C. Chou, M. Zhang, H. Fang, H. Zhao, J. Liu, and W. I Atlas. 2024. LEO Satellite Network Access in the Wild: Potentials, Experiences, and Challenges. IEEE Network (2024).
[18]
S. Ma, Y. C. Chou, H. Zhao, L. Chen, X. Ma, and J. Liu. 2023. Network Characteristics of LEO Satellite Constellations: A Starlink-Based Measurement from End Users. In IEEE Conference on Computer Communications (INFOCOM'23). IEEE, 1--10.
[19]
F. Michel, M. Trevisan, D. Giordano, and O. Bonaventure. 2022. A First Look at Starlink Performance. In Proceedings of the 22nd ACM Internet Measurement Conference (IMC'22). 130--136.
[20]
A. Narayanan, E. Ramadan, R. Mehta, X. Hu, Q. Liu, R. A. Fezeu, U. K. Dayalan, S. Verma, P. Ji, T. Li, et al. 2020. Lumos5G: Mapping and Predicting Commercial mmWave 5G Throughput. In Proceedings of the ACM Internet Measurement Conference (IMC'20). 176--193.
[21]
A. Padmanabhan, N. Agarwal, A. Iyer, G. Ananthanarayanan, Y. Shu, N. Karianakis, G. H. Xu, and R. Netravali. 2023. Gemel: Model Merging for Memory-Efficient, Real-Time Video Analytics at the Edge. In Proceedings of the 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI'23). 973--994.
[22]
SpaceX. 2024. High-Speed Internet by SpaceX. https://www.starlink.com/. [Online; accessed 6 August 2024].
[23]
Starlink. 2024. How Starlink Works. https://www.starlink.com/technology. [Online; accessed 6 August 2024].
[24]
H. B. Tanveer, M. Puchol, R. Singh, A. Bianchi, and R. Nithyanand. 2023. Making Sense of Constellations: Methodologies for Understanding Starlink's Scheduling Algorithms. In Companion of the 19th International Conference on Emerging Networking EXperiments and Technologies (CoNEXT'23). 37--43.
[25]
TelecomReview. 2024. The Race for Space Internet Builds Up Pace. https://www.telecomreview.com/articles/reports-and-coverage/7713-the-race-for-space-internet-builds-up-pace. [Online; accessed 6 August 2024].
[26]
Twitch. 2024. Broadcast Guidelines. https://help.twitch.tv/s/article/broadcast-guidelines. [Online; accessed 6 August 2024].
[27]
Ultralytics. 2024. YOLOv8: A New State-of-the-Art Computer Vision Model. https://yolov8.com/. [Online; accessed 6 August 2024].
[28]
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N Gomez, Ł. Kaiser, and I. Polosukhin. 2017. Attention Is All You Need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS'17) (2017).
[29]
L. Wang, X. Zhang, H. Su, and J. Zhu. 2024. A Comprehensive Survey of Continual Learning: Theory, Method and Application. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 46, 8 (2024), 5362--5383.
[30]
WCCFtech. 2022. Starlink Turns On Laser Satellites For Region With Four Months Long Night. https://wccftech.com/starlink-turns-on-laser-satellites-for-region-with-fourth-month-long-night/. [Online; accessed 6 August 2024].
[31]
Q. Wen, T. Zhou, C. Zhang, W. Chen, Z. Ma, J. Yan, and L. Sun. 2023. Transformers in Time Series: A Survey. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence (IJCAI'23). 6778--6786.
[32]
Wikipedia. 2024. List of Starlink and Starshield launches. https://en.wikipedia.org/wiki/List_of_Starlink_and_Starshield_launches. [Online; accessed 6 August 2024].
[33]
Wikipedia. 2024. Starlink. https://en.wikipedia.org/wiki/Starlink. [Online; accessed 6 August 2024].
[34]
F. Yan, H. Ayers, C. Zhu, S. Fouladi, J. Hong, K. Zhang, P. Levis, and K. Winstein. 2020. Learning in situ: a randomized experiment in video streaming. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI'20), Vol. 20. 495--511.
[35]
J. Yi, M. R. Islam, S. Aggarwal, D. Koutsonikolas, Y C. Hu, and Z. Yan. 2020. An Analysis of Delay in Live 360° Video Streaming Systems. In Proceedings of the 28th ACM International Conference on Multimedia (MM'20). 982--990.
[36]
X. Yin, A. Jindal, V. Sekar, and B. Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM'15). 325--338.
[37]
YouTube. 2024. 4K Road traffic video for object detection and tracking. https://www.youtube.com/watch?v=QuUxHIVUoaY. [Online; accessed 20 March 2024].
[38]
YouTube. 2024. Choose live encoder settings, bitrates, and resolutions. https://support.google.com/youtube/answer/2853702. [Online; accessed 6 August 2024].
[39]
YouTube. 2024. Highway sounds cars trucks passing by for sleeping relaxing. https://www.youtube.com/watch?v=TW3EH4cnFZo. [Online; accessed 20 March 2024].
[40]
YouTube. 2024 d. Live Street Webcam. https://www.youtube.com/watch?v=VR-x3HdhKLQ. [Online; accessed 20 March 2024].
[41]
YouTube. 2024 e. Mori Point, Pacifica CA 4K Live. https://www.youtube.com/watch?v=xf0NCn-1rws. [Online; accessed 20 March 2024].
[42]
B. Zhang, X. Jin, S. Ratnasamy, J. Wawrzynek, and E. A Lee. 2018. AWStream: Adaptive Wide-Area Streaming Analytics. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM'18). 236--252.
[43]
H. Zhang, G. Ananthanarayanan, P. Bodik, M. Philipose, P. Bahl, and M. J. Freedman. 2017. Live Video Analytics at Scale with Approximation and Delay-Tolerance. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI'17). 377--392.
[44]
W. Zhang, Z. He, L. Liu, Z. Jia, Y. Liu, M. Gruteser, D. Raychaudhuri, and Y. Zhang. 2021. ELF: Accelerate High-resolution Mobile Deep Vision with Content-aware Parallel Offloading. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking (MobiCom'21). 201--214.
[45]
H. Zhao, H. Fang, F. Wang, and J. Liu. 2023. Realtime Multimedia Services over Starlink: A Reality Check. In Proceedings of the 33rd Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV'23). 43--49.
[46]
H. Zhou, S. Zhang, J. Peng, S. Zhang, J. Li, H. Xiong, and W. Zhang. 2021. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting. In Proceedings of the AAAI conference on artificial intelligence (AAAI'21), Vol. 35. 11106--11115.
[47]
X. Zhu, S. Sen, and Z M. Mao. 2021. Livelyzer: Analyzing the First-Mile Ingest Performance of Live Video Streaming. In Proceedings of the 12th ACM Multimedia Systems Conference (MMSys'21). 36--50.
Index Terms
- StarStream: Live Video Analytics over Space Networking
Recommendations
High-order ionospheric delay correction of GNSS data for precise reduced-dynamic determination of LEO satellite orbits: cases of GOCE, GRACE, and SWARM
AbstractIonospheric delay is one of the main error sources in the precise orbit determination (POD) of low earth orbit (LEO) satellites using spaceborne global navigation satellite system (GNSS) data. The ionospheric-free linear combination is usually ...
High-precision orbit determination for a LEO nanosatellite using BDS-3
AbstractThe Tianping-1B is a 20-kg low earth orbit nanosatellite with a commercial multi-GNSS receiver based on a microelectromechanical system. This receiver collects concurrent code and phase dual-frequency measurements from the global positioning ...
An improved method for LEO orbit prediction using predicted accelerometer data
AbstractThe Low Earth Orbit (LEO) enhanced Global Navigation Satellite System (LeGNSS) relies on LEO satellites to broadcast GNSS-like navigation signals, providing real-time satellite orbit and clock information to enhance GNSS service performance. To ...
Comments
Information & Contributors
Information
Published In
October 2024
11719 pages
ISBN:9798400706868
DOI:10.1145/3664647
- General Chairs:
- Jianfei Cai,
- Mohan Kankanhalli,
- Balakrishnan Prabhakaran,
- Susanne Boll,
- Program Chairs:
- Ramanathan Subramanian,
- Liang Zheng,
- Vivek K. Singh,
- Pablo Cesar,
- Lexing Xie,
- Dong Xu
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MM '24
Sponsor:
MM '24: The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne VIC, Australia
Acceptance Rates
MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 152Total Downloads
- Downloads (Last 12 months)152
- Downloads (Last 6 weeks)85
Reflects downloads up to 01 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in