skip to main content
10.1145/3589610.3596275acmconferencesArticle/Chapter ViewAbstractPublication PagescpsweekConference Proceedingsconference-collections
research-article

ISVABI: In-Storage Video Analytics Engine with Block Interface

Published: 13 June 2023 Publication History

Abstract

The wide use of cameras in the past decade has increased the need to process video data significantly. Due to the large volume of video data, analyzing videos to extract useful information has become a critical challenge. Several prior works have tried to accelerate video analytics workloads by offloading some operations to embedded processors within storage devices.
However, most of these works require changing the block I/O interface of a normal solid-state drive (SSD) to a key-value interface, which in turn changes data structures within SSDs and requires re-programming existing applications when deploying these designs to existing warehouse-level data centers. In addition, when processing large videos, key-value SSDs perform two times slower than block I/O interface SSDs. In this work, we propose ISVABI, a software/firmware approach that maintains the SSD block I/O interface which provides offloaded operations for user-space video analytics workloads without requiring SSD hardware modification. We implement ISVABI on the Cosmos+ OpenSSD platform and show that the proposed ISVABI outperforms normal SSDs by 4.18x for various types of video operations while consuming 16% less power. We evaluate ISVABI on five real-world video analytics workloads and show a 1.89x end-to-end latency improvement.

References

[1]
rapl-tool. kentcz. github.com/kentcz/rapl-tools
[2]
Xilinx XPE. AMD Xilinx. https://www.xilinx.com/products/ technology/power/xpe.html
[3]
Ian F. Adams, John Keys, and Michael P. Mesnier. 2019. Respecting the Block Interface-Computational Storage Using Virtual Objects. In Proceedings of the 11th USENIX Conference on Hot Topics in Storage and File Systems (Renton, WA, USA) ( HotStorage'19). USENIX Association, USA, 10. https://doi.org/10.5555/3357062.3357076
[4]
Ganesh Ananthanarayanan et al. 2020. Live Video Analytics with Microsoft Rocket for reducing edge compute costs.
[5]
Tim Bisson, Ke Chen, Changho Choi, Vijay Balakrishnan, and Yangsuk Kee. 2018. Crail-KV: A High-Performance Distributed Key-Value Store Leveraging Native KV-SSDs over NVMe-oF. In 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC). 1-8. https://doi.org/10.1109/PCCC. 2018.8710776
[6]
João Carreira and Andrew Zisserman. 2017. Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. CoRR abs/1705.07750 ( 2017 ). arXiv: 1705. 07750
[7]
L. Ceci. 2022. Hours of video uploaded to YouTube every minute 2007-2020. Statista (04 2022 ).
[8]
Chanwoo Chung, Jinhyung Koo, Junsu Im, Arvind, and Sungjin Lee. 2019. LightStore: Software-Defined Network-Attached Key-Value Drives. In Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems (Providence, RI, USA) ( ASPLOS '19). Association for Computing Machinery, New York, NY, USA, 939-953. https://doi.org/10.1145/ 3297858.3304022
[9]
Jiajun Deng, Zhengyuan Yang, Tianlang Chen, Wengang Zhou, and Houqiang Li. 2022. TransVG: End-to-End Visual Grounding with Transformers. arXiv:2104.08541 [cs.CV]
[10]
Hsuan-I Ho, Wei-Chen Chiu, and Yu-Chiang Frank Wang. 2017. For Your Eyes Only: Learning to Summarize First-Person Videos. CoRR abs/1711.08922 ( 2017 ). arXiv: 1711. 08922
[11]
Junsu Im, Jinwook Bae, Chanwoo Chung, Arvind, and Sungjin Lee. 2020. PinK: High-speed In-storage Key-value Store with Bounded Tails. In USENIX ATC 20. 173-187. https://doi.org/10.5555/3489146.3489158
[12]
Veronia Iskandar, Mohamed A. Abd El Ghany, and Diana Göhringer. 2022. Near-Memory Computing on FPGAs with 3D-Stacked Memories: Applications, Architectures, and Optimizations. ACM Trans. Reconfigurable Technol. Syst. 16, 1, Article 16 (dec 2022 ), 32 pages. https://doi.org/10.1145/3547658
[13]
Jingwei Ji, Ranjay Krishna, Li Fei-Fei, and Juan Carlos Niebles. 2019. Action Genome: Actions as Composition of Spatio-temporal Scene Graphs. https://doi.org/arXiv: 1912.06992v1 arXiv: 1912. 06992 [cs.CV]
[14]
Yanqin Jin, Hung-Wei Tseng, Yannis Papakonstantinou, and Steven Swanson. 2017. KAML: A Flexible, High-Performance Key-Value SSD. In HPCA' 17. 373-384. https://doi.org/10.1109/HPCA. 2017.15
[15]
Jaewook Kwak, Sangjin Lee, Kibin Park, Jinwoo Jeong, and Yong Ho Song. 2020. Cosmos+ OpenSSD: Rapid Prototype for Flash Storage Systems. ACM Trans. Storage 16, 3, Article 15 ( 2020 ), 35 pages. https://doi.org/10.1145/3385073
[16]
Joo Hwan Lee, Hui Zhang, Veronica Lagrange, Praveen Krishnamoorthy, Xiaodong Zhao, and Yang Seok Ki. 2020. SmartSSD: FPGA Accelerated Near-Storage Data Analytics on SSD. IEEE Computer Architecture Letters 19, 2 ( 2020 ). https://doi.org/10.1109/LCA. 2020.3009347
[17]
Yunjae Lee, Jinha Chung, and Minsoo Rhu. 2022. SmartSAGE: Training Large-Scale Graph Neural Networks Using in-Storage Processing Architectures. In Proceedings of the 49th Annual International Symposium on Computer Architecture (New York, New York) (ISCA '22). Association for Computing Machinery, New York, NY, USA, 932-945. https://doi.org/10.1145/3470496.3527391
[18]
Huaishao Luo, Lei Ji, Botian Shi, Haoyang Huang, Nan Duan, Tianrui Li, Jason Li, Taroon Bharti, and Ming Zhou. 2020. UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation. arXiv: 2002. 06353 [cs.CV]
[19]
Vikram Sharma Mailthody, Zaid Qureshi, Weixin Liang, Ziyan Feng, Simon Garcia de Gonzalo, Youjie Li, Hubertus Franke, Jinjun Xiong, Jian Huang, and Wen-mei Hwu. 2019. DeepStore: In-Storage Acceleration for Intelligent Queries. In Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO '52). 224-238. https://doi.org/10.1145/3352460.3358320
[20]
Leonardo Marmol, Swaminathan Sundararaman, Nisha Talagala, and Raju Rangaswami. 2015. NVMKV: A Scalable, Lightweight, FTL-Aware Key-Value Store. In Proceedings of the 2015 USENIX Conference on Usenix Annual Technical Conference (Santa Clara, CA) (USENIX ATC '15). USENIX Association, USA, 207-219. https://doi.org/10.5555/ 2813767.2813783
[21]
Luis Remis and Chaunté W. Lacewell. 2021. Using VDMS to Index and Search 100M Images. Proc. VLDB Endow. 14, 12 ( 2021 ), 3240-3252. https://doi.org/10.14778/3476311.3476381
[22]
Zhenyuan Ruan, Tong He, and Jason Cong. 2019. INSIDER: Designing in-Storage Computing System for Emerging High-Performance Drive. In Proceedings of USENIX ATC'19. 379-394. https://doi.org/10.5555/ 3358807.3358840
[23]
Manoj P. Saha, Adnan Maruf, Bryan S. Kim, and Janki Bhimani. 2021. KV-SSD: What Is It Good For?. In 2021 58th ACM/IEEE Design Automation Conference (DAC). 1105-1110. https://doi.org/10.1109/DAC18074. 2021.9586111
[24]
Sahand Salamat, Armin Haj Aboutalebi, Behnam Khaleghi, Joo Hwan Lee, Yang Seok Ki, and Tajana Rosing. 2021. NASCENT: Near-Storage Acceleration of Database Sort on SmartSSD. In The 2021 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (Virtual Event, USA) (FPGA '21). Association for Computing Machinery, New York, NY, USA, 262-272. https://doi.org/10.1145/3431920.3439298
[25]
Fadime Sener and Angela Yao. 2018. Zero-Shot Anticipation for Instructional Activities. CoRR abs/ 1812.02501 ( 2018 ). arXiv: 1812.02501
[26]
Charu Sharma, Siddhant Raj Kapil, and David Chapman. 2021. Person Re-Identification with a Locally Aware Transformer. CoRR abs/2106.03720 ( 2021 ). arXiv: 2106. 03720
[27]
Mark Wilkening, Udit Gupta, Samuel Hsia, Caroline Trippel, CaroleJean Wu, David Brooks, and Gu-Yeon Wei. 2021. RecSSD: Near Data Processing for Solid State Drive Based Recommendation Inference. In Proceedings of ASPLOS'21. 717-729. https://doi.org/10.1145/3445814. 3446763
[28]
Weihong Xu, Jaeyoung Kang, and Tajana Rosing. 2022. A NearStorage Framework for Boosted Data Preprocessing of Mass Spectrum Clustering. In Proceedings of DAC'22 (San Francisco, California). Association for Computing Machinery, New York, NY, USA, 313-318. https://doi.org/10.1145/3489517.3530449
[29]
Hao Zhang, Aixin Sun, Wei Jing, and Joey Tianyi Zhou. 2020. Spanbased Localizing Network for Natural Language Video Localization. https://doi.org/arXiv: 2004.13931 arXiv: 2004. 13931 [cs.CL]
[30]
Yi Zheng, Joshua Fixelle, Nagadastagiri Challapalle, Pingyi Huo, Zhaoyan Shen, Zili Shao, Mircea Stan, and Vijaykrishnan Narayanan. 2022. ISKEVA: In-SSD Key-Value Database Engine for Video Analytics Applications. In Proceedings of LCTES'22. 50-60. https://doi.org/10. 1145/3519941.3535068
[31]
Chenchen Zhu, Yihui He, and Marios Savvides. 2019. Feature Selective Anchor-Free Module for Single-Shot Object Detection. arXiv: 1903. 00621 [cs.CV]
[32]
Ji Zhu, Hua Yang, Nian Liu, Minyoung Kim, Wenjun Zhang, and MingHsuan Yang. 2019. Online Multi-Object Tracking with Dual Matching Attention Networks. arXiv: 1902. 00749 [cs.CV]

Index Terms

  1. ISVABI: In-Storage Video Analytics Engine with Block Interface

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    LCTES 2023: Proceedings of the 24th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems
    June 2023
    147 pages
    ISBN:9798400701740
    DOI:10.1145/3589610
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 June 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. SSD
    2. SSD Firmware
    3. video analytics

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    LCTES '23

    Acceptance Rates

    Overall Acceptance Rate 116 of 438 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 208
      Total Downloads
    • Downloads (Last 12 months)63
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media