Abstract
Many evolving video services and applications for intelligent security systems require reliable transmission of high quality video to diverse clients over heterogeneous networks using available system resources. Scalable video coding (SVC) is one of the emerging video compression technologies with such potential capabilities. Advances in lifting-based motion-compensated temporal filtering (MCTF) have enabled highly efficient and flexible spatial, temporal, signal-to-noise ratio (SNR), and complexity scalability to be realized over a wide range of bit rates. In this paper, we present an algorithm to improve the update step of MCTF, which serves as an important informative step for the coding performance of SVC. A novel update-step algorithm, which takes advantage of the chrominance information of the video sequence and the correlation of the motion vectors (MVs) of the neighboring blocks as well as the correlation of the derived update MVs in the low-pass frames, is proposed to improve update step of MCTF by (1) computing correct update motion information, (2) generating correct amount of energy contained in the high-pass frames. Experimental results show that the proposed algorithm can significantly improve the quality of the reconstructed video sequence in visual quality.
Similar content being viewed by others
References
J.-R. Ohm, “Three-Dimensional Subband Coding With Motion Compensation,” IEEE Trans. Image Proc., vol. 3, 1994, pp. 559–571, Sept.
W. Sweldens, “The Lifting Scheme: A New Construction of Second Generation Wavelets,” SIAM J. Math. Analy., vol. 29, 1998, pp. 511–546.
B. Pesquet-Popescu and V. Bottreau, “Three-Dimensional Lifting Schemes for Motion Compensated Video Compression,” IEEE Proc. ICASSP, vol. 3, 2001, pp. 1793–1796.
L. Luo, J. Li, S. Li, Z. Zhuang, and Y.-Q. Zhang, “Motion Compensated Lifting Wavelet and its Application in Video Coding,” IEEE ICME, pp. 365–368, 2001.
A. Secker and D. Taubman, “Motion-Compensated Highly-Scalable Video Compression Using an Adaptive 3D Wavelet Transform Based on Lifting,” IEEE Proc., ICIP, pp. 1029–1032, 2001.
N. Mehreseresht and D. Taubman, “Adaptively Weighted Update Steps in Motion Compensated Lifting Based Scalable Video Compression,” IEEE Proc. ICIP, vol. 2, 2003, pp. 771–774.
L. Song, J. Xu, H. Xiong, F. Wu, “Content Adaptive Update Steps for Lifting-Based Motion Compensated Temporal Filtering,” Proc. PCS, San Francisco, CA, Dec. 2004.
P. Chen, K. Hanke, T. Rusert, and J. W. Woods, “Improvements to the MC-EZBC Scalable Video Coder,” IEEE Proc. ICIP, vol. 2, 2003, pp. 14–17, Sept.
R. Xiong, F. Wu, S. Li, Z. Xiong, and Y.-Q. Zhang, “Exploiting Temporal Correlation With Adaptive Block-Size Motion Alignment for 3D Wavelet Coding,” SPIE VCIP, San Jose, CA, Jan. 2004.
A. Secker and D. Taubman, “Highly Scalable Video Compression Using A Lifting-Based 3D Wavelet Transform With Deformable Mesh Motion Compensation,” IEEE Proc. ICIP, vol. 3, 2002, pp. 24–28, Jun.
D. S. Turaga and M. van der Shaar, “Content-Adaptive Filtering in the UMCTF Framework,” IEEE Proc. ICASSP, vol. 3, 2003, pp. 6–10, April.
J.-R. Ohm, “Advances in Scalable Video Coding,” Proc. IEEE, vol. 93, No. 1, Jan. 2005.
J. Reichel, H. Schwarz and M. Wien, “Scalable Video Coding—Working Draft 2,” in JVT-O202, 15th Meeting, Busan, Korea, 16–22, April 2005.
A. N. Netravali and B. G. Haskell, Digital Pictures: Representation, Compression, and Standards, 2nd ed., Plenum, New York, NY, 1995.
R. C. Gonzalez and R. E. Woods, Digital Image Processing, 2nd ed., Prentice Hall, New Jersey, 2002, pp. 282–348.
W. Shreiber, Fundamentals of Electronic Imaging Systems, Springer, New York, 1993.
J. C. Tsai, C. H. Hsieh, S. K. Weng, and M. F. Lai, “Block-Matching Motion Estimation Using Correlation Search Algorithm,” Signal Proc.: Image Commun., vol. 13, 1998, pp. 119–133. Aug.
M. van der Schaar, M. Domanski, “Description of Core Experiments in MPEG-21 Scalable Video Coding,” ISO/IECJTC1/N6521, Redmond, USA, July 2004.
JSVM, “JSVM 1.0 Software,” in JVT-N024, 14th Meeting, Hong Kong, China, 17–21, January 2005.
A. M. Tourapis, O. C. Au and M. L. Liou, “Highly Efficient Predictive Zonal Algorithm For Fast Block-Matching Motion Estimation,” IEEE Trans. Circuits Syst. Video Technol., vol. 12, 2002, pp. 934–947, Oct.
Y. Chen, J. Xu, F. Wu and H. Xiong, “Improvement Of The Update Step In JSVM,” in JVT-O030, 15th Meeting, Busan, Korea, 16–22, April, 2005.
X. Wang, M. Karczewicz, Y. Bao, and J. Ridge, “Simplified Update Step Operation for MCTF,” in JVT-O015, 15th Meeting, Busan, Korea, 16–22, April 2005.
W. Han and B. Lee, “Closed-Loop Update-Step In MCTF for Scalable Video Coding,” in JVT-O062, 15th Meeting, Busan, Korea, 16–22, April 2005.
ISO/IECJTC1/SC29/WG11/N6880, Applications and Requirements for Scalable Video Coding, Hong Kong, China, January 2005.
T. C. Thang, T. M. Bae, Y. J. Jung, et al., “Spatial Scalability of Multiple ROIs in Surveillance Video,” JVT-O037, 15th Meeting, Busan, Korea, 16–22, April 2005.
Z. Lu, W. Lin, Z. Li, K. Lim, X. Lin and S. Rahardja, “Perceptual Region-of-Interest (ROI) Based Scalable Video Coding,” in JVT-O056, 15th Meeting, Busan, Korea, 16–22, April 2005.
G. Sullivan, “General Characteristics and Design Considerations for Temporal Subband Video Coding” in VCEG-U06, 21st Meeting, Waikoloa, USA, 8–12, December 2003.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, F., Ling, N. & Yang, X. Improved Update Step for Scalable Video Coding in Video Surveillance. J VLSI Sign Process Syst Sign Im 49, 425–442 (2007). https://doi.org/10.1007/s11265-007-0094-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-007-0094-1