A Contributory Public-Event Recording and Querying System
Pages 185 - 198
Abstract
CCTV (Closed-Circuit Television) systems are commonly used for security and surveillance. They provide a visual record of events, which can be used to monitor criminal activity, support investigations, and improve public safety. Many cities have implemented a number of cameras for surveillance, with Delhi, India having 1446 cameras per square mile. These cameras are installed mainly by official traffic police or city authorities, but private organizations and individuals also have their cameras pointed toward public spaces. In many cases, the city authorities or police require query capability and access of the video feed from these CCTV cameras to perform diligent inquiries but the private entities usually do not share the raw footage due to various concerns.
To address the above issue, we introduce the "Public Event Recording and Querying System (PERQS)", a video analysis-based querying system. PERQS is a contributory CCTV network that encompasses both private and public parties. PERQS provides a reliable and secure solution for querying CCTV video feeds by leveraging video analytic algorithms. It ensures video privacy by allowing participants to perform video analysis locally on their servers. Additionally, PERQS employs hash-based commitments and query consensus, guaranteeing tamper-proof and accurate results. Furthermore, it provides a novel consensus mechanism called time-travel consensus to build trust in the query output even in the case of a lack of cameras pointing at a particular location. We introduce a query language PERQL, similar to SQL, which makes the system expandable and flexible. The plug-and-play architecture allows for integration with advanced vision models and algorithms for analysis.
References
[1]
1211 2022. An overview of video analytics in security. https://www.ifsecglobal.com/video-surveillance/overview-video-analytics-security/ (accessed on 23 October 2023).
[2]
1231 2022. Surveillance camera statistics: which cities have the most CCTV cameras? https://www.comparitech.com/vpn-privacy/the-worlds-most-surveilled-cities/ (accessed on 23 October 2023).
[3]
1234 2021. Global Surveillance Camera Markets 2021--2025. https://www.prnewswire.com/news-releases/global-surveillance-camera-markets-2021-2025---integration-of-ai-systems-adoption-of-iot-based-surveillance-systems-spy-and-hidden-cameras-growth-in-transition-from-analog-to-ip-cameras-301359651.html (accessed on 23 October 2023).
[4]
1241 2021. Adoption of advanced video analytics is "rising rapidly", NW Security UK study finds. https://www.ifsecglobal.com/video-surveillance/adoption-of-advanced-video-analytics-is-rising-rapidly-nw-security-uk-study-finds/ (accessed on 23 October 2023).
[5]
1251 2021. INDIA CCTV MARKET - GROWTH, TRENDS, COVID-19 IMPACT, AND FORECASTS (2022 - 2027). https://www.mordorintelligence.com/industry-reports/india-cctv-market (accessed on 23 October 2023).
[6]
Elli Androulaki, Artem Barger, Vita Bortnikov, Christian Cachin, Konstantinos Christidis, Angelo De Caro, David Enyeart, Christopher Ferris, Gennady Laventman, Yacov Manevich, Srinivasan Muralidharan, Chet Murthy, Binh Nguyen, Manish Sethi, Gari Singh, Keith Smith, Alessandro Sorniotti, Chrysoula Stathakopoulou, Marko Vukolić, Sharon Weed Cocco, and Jason Yellick. 2018. Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains. In Proceedings of the Thirteenth EuroSys Conference (Porto, Portugal) (EuroSys '18). Association for Computing Machinery, New York, NY, USA, Article 30, 15 pages.
[7]
Guilherme H. Apostolo, Pablo Bauszat, Vinod Nigade, Henri E. Bal, and Lin Wang. 2022. Live Video Analytics as a Service. In Proceedings of the 2nd European Workshop on Machine Learning and Systems (Rennes, France) (EuroMLSys '22). Association for Computing Machinery, New York, NY, USA, 37--44.
[8]
Walid Aref, Moustafa Hammad, Ann Christine Catlin, Ihab Ilyas, Thanaa Ghanem, Ahmed Elmagarmid, and Mirette Marzouk. 2003. Video Query Processing in the VDBMS Testbed for Video Database Research. In Proceedings of the 1st ACM International Workshop on Multimedia Databases (New Orleans, LA, USA) (MMDB '03). Association for Computing Machinery, New York, NY, USA, 25--32.
[9]
Luca Ballan, Gabriel J. Brostow, Jens Puwein, and Marc Pollefeys. 2010. Unstructured Video-Based Rendering: Interactive Exploration of Casually Captured Videos. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2010) (July 2010), 1--11.
[10]
Aayush Bansal, Minh Vo, Yaser Sheikh, Deva Ramanan, and Srinivasa G. Narasimhan. 2020. 4D Visualization of Dynamic Events From Unconstrained Multi-View Videos. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA, June 13--19, 2020. Computer Vision Foundation / IEEE, 5365--5374.
[11]
Richard Barker. 2022. How many CCTV cameras are in London? https://clarionuk.com/resources/how-many-cctv-cameras-are-in-london/ (accessed on 23 October 2023).
[12]
Favyen Bastani, Songtao He, Arjun Balasingam, Karthik Gopalakrishnan, Mohammad Alizadeh, Hari Balakrishnan, Michael Cafarella, Tim Kraska, and Sam Madden. 2020. MIRIS: Fast Object Track Queries in Video. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data (Portland, OR, USA) (SIGMOD '20). Association for Computing Machinery, New York, NY, USA, 1907--1921.
[13]
Frank Cangialosi, Neil Agarwal, Venkat Arun, Srinivas Narayana, Anand Sarwate, and Ravi Netravali. 2022. Privid: Practical, Privacy-Preserving Video Analytics Queries. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22). USENIX Association, Renton, WA, 209--228. https://www.usenix.org/conference/nsdi22/presentation/cangialosi
[14]
AI CITY CHALLENGE. 2021. AI City Challenge Dataset 2021. https://www.aicitychallenge.org/2021-data-and-evaluation/ (accessed on 10 March 2023).
[15]
Brian Curran. 2018. What are Oracles? Smart Contracts, Chainlink and The Oracle Problem. https://blockonomi.com/oracles-guide/ (accessed on 23 October 2023).
[16]
Shivdeep Singh Dave Enyeart. 2023. Benchmarking Hyperledger Fabric 2.5 Performance. https://www.hyperledger.org/blog/2023/02/16/benchmarking-hyperledger-fabric-2-5-performance (accessed on 23 October 2023).
[17]
Marta Fernandez, Paula Moral, Alvaro Garcia-Martin, and Jose M. Martinez. 2021. Vehicle Re-Identification Based on Ensembling Deep Learning Features Including a Synthetic Training Dataset, Orientation and Background Features, and Camera Verification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 4068--4076.
[18]
Christopher Ferris. 2019. Does Hyperledger Fabric perform at scale? https://www.ibm.com/blog/does-hyperledger-fabric-perform-at-scale/ (accessed on 23 October 2023).
[19]
M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Qian Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. 1995. Query by image and video content: the QBIC system. Computer 28, 9 (1995), 23--32.
[20]
Mariana-Iuliana Georgescu, Antonio Bărbălău, Radu Tudor Ionescu, Fahad Shahbaz Khan, Marius Claudiu Popescu, and Mubarak Shah. 2020. Anomaly Detection in Video via Self-Supervised and Multi-Task Learning. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2020), 12737--12747.
[21]
Hongpeng Guo, Shuochao Yao, Zhe Yang, Qian Zhou, and Klara Nahrstedt. 2021. CrossRoI: Cross-Camera Region of Interest Optimization for Efficient Real Time Video Analytics at Scale. In Proceedings of the 12th ACM Multimedia Systems Conference (Istanbul, Turkey) (MMSys '21). Association for Computing Machinery, New York, NY, USA, 186--199.
[22]
Hyperledger. 2023. Hyperledger Fabric - GitHub. https://github.com/hyperledger/fabric
[23]
Samvit Jain, Xun Zhang, Yuhao Zhou, Ganesh Ananthanarayanan, Junchen Jiang, Yuanchao Shu, Paramvir Bahl, and Joseph Gonzalez. 2020. Spatula: Efficient cross-camera video analytics on large camera networks. In 2020 IEEE/ACM Symposium on Edge Computing (SEC). 110--124.
[24]
Facundo Lezama Javier Couto. 2022. A Guide to Video Analytics: Applications and Opportunities. https://tryolabs.com/guides/video-analytics-guide (accessed on 23 October 2023).
[25]
Junchen Jiang, Ganesh Ananthanarayanan, Peter Bodik, Siddhartha Sen, and Ion Stoica. 2018. Chameleon: Scalable Adaptation of Video Analytics. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (Budapest, Hungary) (SIGCOMM '18). Association for Computing Machinery, New York, NY, USA, 253--266.
[26]
Wei Jiang and Jinwei Gu. 2015. Video stitching with spatial-temporal content-preserving warping. In 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 42--48.
[27]
Manu Joseph, Harsh Raj, Anubhav Yadav, and Aaryamann Sharma. 2022. AskYourDB: An end-to-end system for querying and visualizing relational databases using natural language. arXiv:2210.08532 [cs.DB]
[28]
Daniel Kang, Peter Bailis, and Matei Zaharia. 2018. BlazeIt: optimizing declarative aggregation and limit queries for neural network-based video analytics. arXiv preprint arXiv:1805.01046 (2018).
[29]
Daniel Kang, Francisco Romero, Peter D. Bailis, Christos Kozyrakis, and Matei Zaharia. 2022. VIVA: An End-to-End System for Interactive Video Analytics. In 12th Conference on Innovative Data Systems Research, CIDR 2022, Chaminade, CA, USA, January 9--12, 2022. www.cidrdb.org. https://www.cidrdb.org/cidr2022/papers/p75-kang.pdf
[30]
Andrej Karpathy, George Toderici, Sanketh Shetty, Thomas Leung, Rahul Sukthankar, and Li Fei-Fei. 2014. Large-Scale Video Classification with Convolutional Neural Networks. 2014 IEEE Conference on Computer Vision and Pattern Recognition (2014), 1725--1732.
[31]
A. Khochare, A. Krishnan, and Y. Simmhan. 2021. A Scalable Platform for Distributed Object Tracking Across a Many-Camera Network. IEEE Transactions on Parallel Distributed Systems 32, 06 (jun 2021), 1479--1493.
[32]
Kubernetes. 2023. Kubernetes: Production Grade Container Orchestration. https://kubernetes.io/
[33]
Jingwen Li, Lei Huang, and Changping Liu. 2012. People Counting across Multiple Cameras for Intelligent Video Surveillance. In 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance. 178--183.
[34]
Yuanqi Li, Arthi Padmanabhan, Pengzhan Zhao, Yufei Wang, Guoqing Harry Xu, and Ravi Netravali. 2020. Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (Virtual Event, USA) (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 359--376.
[35]
Peng Liu, Bozhao Qi, and Suman Banerjee. 2018. EdgeEye: An Edge Service Framework for Real-Time Intelligent Video Analytics. In Proceedings of the 1st International Workshop on Edge Systems, Analytics and Networking (Munich, Germany) (EdgeSys'18). Association for Computing Machinery, New York, NY, USA, 1--6.
[36]
Sujit Biswas Milind Naphade, Vinay Kolar. 2018. Multi-Camera Large-Scale Intelligent Video Analytics with DeepStream SDK. https://developer.nvidia.com/blog/multi-camera-large-scale-iva-deepstream-sdk (accessed on 23 October 2023).
[37]
D.L. Mills. 1991. Internet time synchronization: the network time protocol. IEEE Transactions on Communications 39, 10 (1991), 1482--1493.
[38]
Thomas L. Norman. 2017. Chapter 6 - Electronics Elements: A Detailed Discussion. In Effective Physical Security (Fifth Edition), Lawrence J. Fennelly (Ed.). Butterworth-Heinemann, 95--137.
[39]
Rishabh Poddar, Ganesh Ananthanarayanan, Srinath Setty, Stavros Volos, and Raluca Ada Popa. 2020. Visor: Privacy-Preserving Video Analytics as a Cloud Service. In 29th USENIX Security Symposium (USENIX Security 20). USENIX Association, 1039--1056. https://www.usenix.org/conference/usenixsecurity20/presentation/poddar
[40]
Alex Poms, Will Crichton, Pat Hanrahan, and Kayvon Fatahalian. 2018. Scanner: Efficient Video Analysis at Scale. ACM Trans. Graph. 37, 4, Article 138 (jul 2018), 13 pages.
[41]
Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. ArXiv abs/1804.02767 (2018).
[42]
E. Regnath, N. Shivaraman, S. Shreejith, A. Easwaran, and S. Steinhorst. 2020. Blockchain, what time is it? Trustless Datetime Synchronization for IoT. In 2020 International Conference on Omni-layer Intelligent Systems (COINS).
[43]
Shaoqing Ren, Kaiming He, Ross B. Girshick, and Jian Sun. 2015. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (2015), 1137--1149.
[44]
Karen Simonyan and Andrew Zisserman. 2014. Two-Stream Convolutional Networks for Action Recognition in Videos. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 1 (Montreal, Canada) (NIPS'14). Cambridge, MA, USA, 9 pages.
[45]
Bharat Singh, Tim K. Marks, Michael J. Jones, Oncel Tuzel, and Ming Shao. 2016. A Multi-stream Bi-directional Recurrent Neural Network for Fine-Grained Action Detection. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016), 1961--1970.
[46]
Saleem Durai M. A. Sreenu G. 2019. Intelligent video surveillance: a review through deep learning techniques for crowd analysis. In Journal of Big Data 6.
[47]
D. Tran, L. Bourdev, R. Fergus, L. Torresani, and M. Paluri. 2015. Learning Spatiotemporal Features with 3D Convolutional Networks. In 2015 IEEE International Conference on Computer Vision (ICCV). Los Alamitos, CA, USA.
[48]
Ultralytics. 2023. YOLOv3 in PyTorch > ONNX > CoreML > TFLite. https://github.com/ultralytics/yolov3
[49]
Mark Patel Vasanth Ganesan, Yubing Ji. 2016. Video meets the Internet of Things. https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/video-meets-the-internet-of-things (accessed on 23 October 2023).
[50]
Duc-Quang Vu, Ngan T. H. Le, and Jia-Ching Wang. 2021. Self-Supervised Learning via multi-Transformation Classification for Action Recognition. ArXiv abs/2102.10378 (2021).
[51]
Han Wang, Shangyu Xie, and Yuan Hong. 2020. VideoDP: A Flexible Platform for Video Analytics with Differential Privacy. Proceedings on Privacy Enhancing Technologies 2020 (2020), 277 -- 296.
[52]
Junjue Wang, Brandon Amos, Anupam Das, Padmanabhan Pillai, Norman Sadeh, and Mahadev Satyanarayanan. 2017. A Scalable and Privacy-Aware IoT Service for Live Video Analytics. In Proceedings of the 8th ACM on Multimedia Systems Conference (Taipei, Taiwan) (MMSys'17). Association for Computing Machinery, New York, NY, USA, 38--49.
[53]
Limin Wang, Yuanjun Xiong, Zhe Wang, Yu Qiao, Dahua Lin, Xiaoou Tang, and Luc Van Gool. 2016. Temporal Segment Networks: Towards Good Practices for Deep Action Recognition. In European Conference on Computer Vision.
[54]
X. Wang, Ross B. Girshick, Abhinav Kumar Gupta, and Kaiming He. 2017. Nonlocal Neural Networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (2017).
[55]
Xue Wang, Jianbo Shi, Hyun Soo Park, and Qing Wang. 2017. Motion-Based Temporal Alignment of Independently Moving Cameras. IEEE Transactions on Circuits and Systems for Video Technology 27, 11 (2017), 2344--2354.
[56]
Danielle Whittaker. 2021. Why AI CCTV is the future of security and surveillance in public spaces. https://www.securitymagazine.com/articles/96719-why-ai-cctv-is-the-future-of-security-and-surveillance-in-public-spaces (accessed on 23 October 2023).
[57]
Xinyi Wu, Zhenyao Wu, Yujun Zhang, Lili Ju, and Song Wang. 2019. Multi-Video Temporal Synchronization by Matching Pose Features of Shared Moving Subjects. In 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). 2729--2738.
[58]
Tiantu Xu, Luis Materon Botelho, and Felix Xiaozhu Lin. 2019. VStore: A Data Store for Analytics on Large Videos. In Proceedings of the Fourteenth EuroSys Conference 2019 (Dresden, Germany) (EuroSys '19). Association for Computing Machinery, New York, NY, USA, Article 16, 17 pages.
[59]
Xiaoyi Yu, Kenta Chinomi, Takashi Koshimizu, Naoko Nitta, Yoshimichi Ito, and Noboru Babaguchi. 2008. Privacy protecting visual processing for secure video surveillance. In 2008 15th IEEE International Conference on Image Processing. 1672--1675.
[60]
Haoyu Zhang, Ganesh Ananthanarayanan, Peter Bodik, Matthai Philipose, Paramvir Bahl, and Michael J. Freedman. 2017. Live Video Analytics at Scale with Approximation and Delay-Tolerance. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). USENIX Association, Boston, MA, 377--392. https://www.usenix.org/conference/nsdi17/technical-sessions/presentation/zhang
[61]
Tan Zhang, Aakanksha Chowdhery, Paramvir (Victor) Bahl, Kyle Jamieson, and Suman Banerjee. 2015. The Design and Implementation of a Wireless Video Surveillance System. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (Paris, France) (MobiCom '15). Association for Computing Machinery, New York, NY, USA, 426--438.
[62]
Kang Zheng, Hao Guo, Xiaochuan Fan, Hongkai Yu, and Song Wang. 2016. Identifying Same Persons from Temporally Synchronized Videos Taken by Multiple Wearable Cameras. In 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). 810--818.
Index Terms
- A Contributory Public-Event Recording and Querying System
Recommendations
A Blockchain-Based Platform for the e-Procurement Management in the Public Sector
Model and Data EngineeringAbstractPublic procurement represents an important part of the countries’ budgets. It is impossible to effectively solve the problem of public expenditure without establishing a rational and transparent public procurement management system. These markets ...
Decentralised Autonomous Organisations for Public Procurement
EASE '23: Proceedings of the 27th International Conference on Evaluation and Assessment in Software EngineeringBlockchain has been recognised as a technological breakthrough with the ability to support new decentralised security-based solutions in sectors such as information technology and finance. Blockchain allows different communities to create Decentralised ...
Technology adoption in the public sector: an exploratory study of e-government in Malaysia
ICEGOV '07: Proceedings of the 1st international conference on Theory and practice of electronic governanceAll around the world, the quest to improve government service delivery is becoming an important agenda for most governments. Information and Communications Technology (ICT) and the Internet in particular have opened new possibilities for the government ...
Comments
Information & Contributors
Information
Published In
December 2023
405 pages
Copyright © 2023 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 August 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
SEC '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 40 of 100 submissions, 40%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 87Total Downloads
- Downloads (Last 12 months)87
- Downloads (Last 6 weeks)23
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in