Abstract
This paper proposes a video compression algorithm which bases on the combination of feature compression framework and multi-object tracking network. Here, the multi-object tracking network uses joint detection and embedding (JDE) network. The feature compression framework is consisted of extraction network, encoder/decoder and reconstruction network. More specifically, features of the last layer which is before FPN (Feature Pyramid Network) in JDE are first condensed by extraction network to obtain a low-dimensional compact representation. The compact representation allows for losing feature details, whilst capturing several key important cues within the feature at an extremely low bit-rate cost. Then, the condensed features are encoded and decoded by DCT (Discrete Cosine Transform) method. After that, the features are restored by reconstruction network. Therefore, our method combines deep neural network and DCT, so as to constitute a new hybrid compression architecture to ensure robust and efficient compression. The proposed method is evaluated on object tracking task and the experimental results prove that this proposed framework significantly outperforms both image anchor and feature anchor. In particular, it is reported that 46.70% BD-rate saving can be achieved against the image anchor and 92.17% BD-rate saving can be achieved against the feature anchor for the object tracking task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Networking, C.V.: Cisco Global Cloud Index: Forecast and Methodology, 2015–2020, white paper, Cisco Public, San Jose, p. 2016 (2016)
Brady, D.J., Gehm, M.E., Stack, R.A., Marks, D.L., et al.: Multiscale gigapixel photography. Nature 486(7403), 386–389 (2012)
Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High dynamic range video. ACM Trans. Graph (TOG) 22(3), 319–325 (2003)
Winken, M., Marpe, D., Schwarz, H., Wiegand, T.: Bit-depth scalable video coding. In: Proceedings of the IEEE International Conference on Image Processing, vol. 1, pp. I–5. IEEE (2007)
Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A.: Overview of the H. 264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13(7), 560–576 (2003)
Sullivan, G.J., Ohm, J.-R., Han, W.-J., Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol. 22(12), 1649–1668 (2012)
Bross, B., Chen, J., Liu, S., Wang, Y.-K.: Versatile video coding (draft 5). In: Joint Video Experts Team (JVET) of ITU-T SG, vol. 16, pp. 3–12 (2019)
Lim, H., Park, H.: A ringing-artifact reduction method for block-DCT-based image resizing. IEEE Trans. Circuits Syst. Video Technol. 21(7), 879–889 (2011)
Schiopu, I., Huang, H., Munteanu, A.: CNN-based intra-prediction for lossless HEVC. IEEE Trans. Circuits Syst. Video Technol. 30(7), 1816–1828 (2019)
Zhang, Z.T., Yeh, C.H., Kang, L.W., Lin, M.H.: Efficient CTU-based intra frame coding for HEVC based on deep learning. In: Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, pp. 661–664. IEEE (2017)
Liu, C., Sunyz, H., Kattoz, J., Zeng, X., Fan, Y.: A QP-adaptive mechanism for CNN-based filter in video coding. In: 2022 IEEE International Symposium on Circuits and Systems (2022).https://doi.org/10.1109/ISCAS48785.2022.9937233
Ahmed, N., Natarajan, T., Rao, K.R.: Discrete cosine transform. IEEE Trans. Comput. 100(1), 90–93 (1974). https://doi.org/10.1109/T-C.1974.223784
Wang, Z., Zheng, L., Liu, Y., Li, Y., Wang, S.: Towards real-time multi-object tracking. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.M. (eds.) Computer Vision – ECCV 2020, ECCV 2020, vol. 12356. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58621-8_7
Milan, A., Leal-Taix´e, L., Reid, I., Roth, S., Schindler, K.: Mot16: a benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831 (2016)
Yu, F., Li, W., Li, Q., Liu, Y., Shi, X., Yan, J.: Poi: multiple object tracking with high performance detection and appearance feature. In: Hua, G., Jégou, H. (eds.) ECCV 2016. LNCS, vol. 9914, pp. 36–42. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-48881-3_3
Curcio, I.: Evaluation Framework for Video Coding for Machines, N193 (2022)
Dollár, P., Wojek, C., Schiele, B., Perona, P.: Pedestrian detection: a benchmark. In: CVPR (2009)
Zhang, S., Benenson, R., Schiele, B.: CityPersons: a diverse dataset for pedestrian detection. In: CVPR (2017)
Xiao, T., Li, S., Wang, B., Lin, L., Wang, X.: Joint detection and identification feature learning for person search. In: CVPR (2017)
Zheng, L., Zhang, H., Sun, S., Chandraker, M., Yang, Y., Tian, Q.: Person re-identification in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1367–1376 (2017)
Ess, A., Leibe, B., Schindler, K., Van Gool, L.: A mobile vision system for robust multi-person tracking. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
Milan, A., Leal-Taixé, L., Reid, I., Roth, S., Schindler, K.: MOT16: A benchmark for multi-object tracking. arXiv preprint arXiv:1603.00831 (2016)
Gao, W., Xu, X., Qin, M., Liu, S.: An open dataset for video coding for machines standardization. In: 2022 IEEE International Conference on Image Processing (ICIP) (2022). https://doi.org/10.1109/ICIP46576.2022.9897525
TVD Datasets Homepage. https://multimedia.tencent.com/resources/tvd
Bernardin, K., Elbs, A., Stiefelhagen, R. Multiple object tracking performance metrics and evaluation in a smart room environment. In: Sixth IEEE International Workshop on Visual Surveillance in Conjunction with ECCV (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Chen, Y., Wang, L., Zhang, Y. (2024). A Hybrid Model for Video Compression Based on the Fusion of Feature Compression Framework and Multi-object Tracking Network. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14435. Springer, Singapore. https://doi.org/10.1007/978-981-99-8552-4_2
Download citation
DOI: https://doi.org/10.1007/978-981-99-8552-4_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8551-7
Online ISBN: 978-981-99-8552-4
eBook Packages: Computer ScienceComputer Science (R0)