short-paper

Towards autonomous semantic stream fusion for distributed video streams

Authors:

Manh Nguyen-Duc,

Anh Le-Tuan,

Manfred Hauswirth,

Danh Le-PhuocAuthors Info & Claims

DEBS '21: Proceedings of the 15th ACM International Conference on Distributed and Event-based Systems

Pages 172 - 175

https://doi.org/10.1145/3465480.3467837

Published: 28 June 2021 Publication History

Get Access

Abstract

Video streams are becoming ubiquitous in smart cities and traffic monitoring. Recent advances in computer vision with deep neural networks enable querying a rich set of visual features from these video streams. However, it is challenging to deploy these queries on edge devices due to the resource intensive nature of the computing operations of this sort. Hence, this paper will demonstrate our approach in pushing these computing operations closer to the video stream sources via autonomous stream fusion agents. These agents will facilitate an edge computing paradigm that enables edge devices to utilize its computing resources to serve federated queries over video streams. Our demonstration shows that edge devices can significantly alleviate the bottleneck of the centralized server in dealing with distributed video streams.

References

[1]

Armin Haller et al. 2019. The modular SSN ontology: A joint W3C and OGC standard specifying the semantics of sensors, observations, sampling, and actuation. Semantic Web (2019).

Google Scholar

[2]

Zheng Tange et la. 2019. CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification. CVPR (2019).

Google Scholar

[3]

Daniel Kang, Peter Bailis, and Matei Zaharia. 2019. BlazeIt: Optimizing Declarative Aggregation and Limit Queries for Neural Network-Based Video Analytics. Proc. VLDB Endow. (2019).

Digital Library

Google Scholar

[4]

Danh Le-Phuoc. 2017. Operator-aware approach for boosting performance in RDF stream processing. Semantic Web Journal 42 (2017).

Google Scholar

[5]

Danh Le-Phuoc. 2018. Adaptive Optimisation For Continuous Multi-Way Joins Over RDF Streams. Companion Proceedings of the The Web Conference 2018 (2018).

Google Scholar

[6]

Danh Le-Phuoc, Minh Dao-Tran, Josiane Xavier Parreira, and Manfred Hauswirth. 2011. A native and adaptive approach for unified processing of linked streams and linked data. ISWC'11 (2011).

Digital Library

Google Scholar

[7]

Danh Le-Phuoc, Thomas Eiter, and Anh Le-Tuan. 2021. A Scalable Reasoning and Learning Approach for Neural-Symbolic Stream Fusion. AAAI'21 (2021).

Google Scholar

[8]

Anh Le-Tuan, Conor Hayes, Marcin Wylot, and Danh Le-Phuoc. 2018. RDF4Led: An RDF Engine for Lightweight Edge Devices. In IOT '18.

Digital Library

Google Scholar

[9]

Yuanqi Li, Arthi Padmanabhan, Pengzhan Zhao, Yufei Wang, Guoqing Harry Xu, and Ravi Netravali. 2020. Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics. SIGCOMM'20.

Digital Library

Google Scholar

[10]

BBC News. 2015. CCTV: Too many cameras useless, warns surveillance watchdog Tony Porter. https://www.bbc.com/news/uk-30978995. Accessed: 2021-05-07.

Google Scholar

[11]

Manh Nguyen-Duc, Anh Le-Tuan, Jean-Paul Calbimonte, Manfred Hauswirth, and Danh Le-Phuoc. 2020. Autonomous RDF Stream Processing for IoT Edge Devices. In Semantic Technology. Springer, Cham, 304--319.

Google Scholar

[12]

Joseph Redmon, Santosh Kumar Divvala, Ross B. Girshick, and Ali Farhadi. 2015. You Only Look Once: Unified, Real-Time Object Detection. CoRR (2015).

Google Scholar

[13]

Shaoqing Ren, Kaiming He, Ross B. Girshick, and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. CoRR (2015).

Google Scholar

[14]

Mengwei Xu, Xiwen Zhang, Yunxin Liu, Gang Huang, Xuanzhe Liu, and Felix Xiaozhu Lin. 2020. Approximate query service on autonomous IoT cameras. In MobiSys '20.

Digital Library

Google Scholar

Cited By

View all

Le Phuoc DSchimmler SLe-Tuan AA.Kuehn UHauswirth M(2023)Towards a Decentralized Data Hub and Query System for Federated Dynamic Data SpacesCompanion Proceedings of the ACM Web Conference 202310.1145/3543873.3587646(1452-1457)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543873.3587646
Le-Tuan ABowden DLe-Phuoc D(2023)Semantic Programming for Device-Edge-Cloud Continuum2023 IEEE 31st International Conference on Network Protocols (ICNP)10.1109/ICNP59255.2023.10355630(1-6)Online publication date: 10-Oct-2023
https://doi.org/10.1109/ICNP59255.2023.10355630
Le-Phuoc DHauswirth M(2022)Semantic Stream Processing and ReasoningEncyclopedia of Big Data Technologies10.1007/978-3-319-63962-8_287-2(1-10)Online publication date: 16-Mar-2022
https://doi.org/10.1007/978-3-319-63962-8_287-2

Index Terms

Towards autonomous semantic stream fusion for distributed video streams
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

Attentive Decision-making and Dynamic Resetting of Continual Running SRNNs for End-to-End Streaming Keyword Spotting
ICONS '22: Proceedings of the International Conference on Neuromorphic Systems 2022

Efficient end-to-end processing of continuous and streaming signals is one of the key challenges for Artificial Intelligence (AI) in particular for Edge applications that are energy-constrained. Spiking neural networks are explored to achieve efficient ...
Sketching distributed sliding-window data streams

While traditional data management systems focus on evaluating single, ad hoc queries over static data sets in a centralized setting, several emerging applications require (possibly, continuous) answers to queries on dynamic data that is widely ...
Distributed reasoning on semantic data streams
ISWC'12: Proceedings of the 11th international conference on The Semantic Web - Volume Part II

Data streams are being continually generated in diverse application domains such as traffic monitoring, smart buildings, and so on. Stream Reasoning is the area that aims to combine reasoning techniques with data streams. In this paper, we present our ...

Comments

Information & Contributors

Information

Published In

DEBS '21: Proceedings of the 15th ACM International Conference on Distributed and Event-based Systems

June 2021

207 pages

ISBN:9781450385558

DOI:10.1145/3465480

General Chairs:
Alessandro Margara
Politecnico di Milano, Italy
,
Emanuele Della Valle
Politecnico di Milano, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Conference

DEBS '21

Sponsor:

DEBS '21: The 15th ACM International Conference on Distributed and Event-based Systems

June 28 - July 2, 2021

Virtual Event, Italy

Acceptance Rates

DEBS '21 Paper Acceptance Rate 7 of 26 submissions, 27%;

Overall Acceptance Rate 145 of 583 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
187
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Le Phuoc DSchimmler SLe-Tuan AA.Kuehn UHauswirth M(2023)Towards a Decentralized Data Hub and Query System for Federated Dynamic Data SpacesCompanion Proceedings of the ACM Web Conference 202310.1145/3543873.3587646(1452-1457)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543873.3587646
Le-Tuan ABowden DLe-Phuoc D(2023)Semantic Programming for Device-Edge-Cloud Continuum2023 IEEE 31st International Conference on Network Protocols (ICNP)10.1109/ICNP59255.2023.10355630(1-6)Online publication date: 10-Oct-2023
https://doi.org/10.1109/ICNP59255.2023.10355630
Le-Phuoc DHauswirth M(2022)Semantic Stream Processing and ReasoningEncyclopedia of Big Data Technologies10.1007/978-3-319-63962-8_287-2(1-10)Online publication date: 16-Mar-2022
https://doi.org/10.1007/978-3-319-63962-8_287-2

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

Attentive Decision-making and Dynamic Resetting of Continual Running SRNNs for End-to-End Streaming Keyword Spotting

Sketching distributed sliding-window data streams

Distributed reasoning on semantic data streams