Skip to main content
SpringerLink
Log in

Coding modes-based frame skip avoidance scheme for low bit rate video coding

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Frame skips are commonly applied in the rate control procedure of low bit rate video coding. In order to reduce the probability of frame skips, a frame skip avoidance scheme based on the analysis of coding modes is proposed. A measure named normalized mode affection factor (NMAF) is proposed so as to analyze the affection of each coding mode on the quality and bit rate of videos. Based on the NMAF, a frame skip avoidance scheme is designed considering the buffer fullness. Experimental results demonstrate that the proposed scheme could reduce the number of skipped frames greatly; meanwhile the rate distortion performance could also be improved a lot. Compared with JVT-W042, an average 0.45 dB PSNR could be achieved at the same coding bit rate and the average number of skipped frames could be reduced as 11.44 for all the tested video sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Chen, Z., Ngan, K.N.: Recent advances in rate control for video coding. Signal Process. Image Commun. 22(1), 19–38 (2007)

    Article  Google Scholar 

  2. MPEG-2 Test Model 5. Doc. ISO/IEC JTC1/SC29 WG11/93-400 April 1993 (1993)

  3. Corbera, J.R., Lei, S.: Rate control in DCT video coding for low-delay communications. IEEE Trans. Circuits Syst. Video Technol. 9(1), 172–185 (1999)

    Article  Google Scholar 

  4. Lee, H.J., Chiang, T., Zhang, Y.Q.: Scalable rate control for MPEG-4 video. IEEE Trans. Circuits Syst. Video Technol. 10(6), 878–894 (2000)

    Article  Google Scholar 

  5. Li, Z., Pan, F., Lim, K.P., Feng, G., Lin, X., Rahardja, S.: Adaptive basic unit layer rate control for JVT. ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-G012. In: 7th Meeting. Pattaya, Thailand (2003)

  6. Leontaris, A., Tourapis, A.M.: Rate control reorganization in the joint model (JM) reference software. In: ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-W042. In: 23rd Meeting. San Jose, CA, USA (2007)

  7. Advanced video coding for generic audiovisual services, ITU-T recommendation H.264 and ISO/IEC14496–10 AVC Standard, March, 2010

  8. Sun, Y., Zhou, Y., Feng, Z., He, Z., Sun, S.: Incremental rate control for H.264/AVC video compression. IET Image Process. 3(5), 286–298 (2009)

    Article  Google Scholar 

  9. Lin, Q., Feng, G.: The bit allocation and RDO mode based rate control algorithm. In: Proceedings 2010 International Conference on Anti-Counterfeiting Security and Identification in Communication (ASID), pp. 154–157, July 2010

  10. Wiegand, T., Schwarz, H., Joch, A., Kossentini, F., Sullivan, G.J.: Rate-constrained coder control and comparison of video coding standards. IEEE Trans. Circuits Syst. Video Technol. 13(7), 688–703 (2003)

    Article  Google Scholar 

  11. Li, X., Oertel, N., Hutter, A., Kaup, A.: Laplace distribution based lagrangian rate distortion optimization for hybrid video coding. IEEE Trans. Circuits Syst. Video Technol. 19(2), 193–205 (2009)

    Article  Google Scholar 

  12. ITU-T Q6/16 Visual Coding and ISO/IEC JTC1/SC29/WG11: Coding of moving pictures and audio. In: Joint call for proposals on video compression technology. In: Proceedings of 39th meeting of ITU-T Video Coding Experts Group (VCEG), Kyoto, Japan, January, 2010

  13. Everett, H.: Generalized Lagrange multiplier method for solving problems of optimum allocation of resources. Oper. Res. 11(3), 399–417 (1963)

    Article  MATH  MathSciNet  Google Scholar 

  14. Ortega, A., Ramchandran, K.: Rate distortion methods for image and video compression: an overview. IEEE Signal Process. Mag. 15, 23–50 (1998)

    Article  Google Scholar 

  15. Zhang, J., Yi, X., Ling, N., Shang, W.: Context adaptive lagrange multiplier (CALM) for rate-distortion optimal motion estimation in video coding. IEEE Trans. Circuits Syst. Video Technol. 20(6), 820–828 (2010)

    Article  Google Scholar 

  16. Wiegand, T., Girod, B.: Lagrange multiplier selection in hybrid video coder control. In: Proceedings of IEEE International Conference on Image Processing (ICIP 2001) vol. 3, pp. 542–545 (2001)

  17. Yang, F., Wan, S., Izquierdo1, E.: Lagrange multiplier selection for 3-D wavelet based scalable video coding. In: Proc. IEEE International conference on Image Processing (ICIP 2007), pp. 309–312, September 2007

  18. Li, M., Chang, Y., Yang, F., Wan, S., Xiong, S.L.: Frame layer rate control for H.264/AVC with hierarchical B-frames. Signal Process. Image Commun. 24 (3), pp. 177–199 (2009)

    Google Scholar 

  19. Lee, H.J., Chiang, T., Zhang, Y.Q.: Scalable rate control for MPEG-4 video. IEEE Trans. Circuits Syst. Video Technol. 10(6), 878–894 (2000)

    Article  Google Scholar 

  20. Gray, R.M., Neuhoff, D.L.: Quantization. IEEE Trans. Inf. Theory 44(6), 2325–2383 (1998)

    Article  MATH  MathSciNet  Google Scholar 

  21. Wang, H., Kwong, S.: Rate-distortion optimization of rate control for H.264 with adaptive initial quantization parameter determination. IEEE Trans. Circuits Syst. Video Technol. 18(1), 140–144 (2008)

    Article  Google Scholar 

  22. JVT Reference Software Version JM 15.1: Available online at http://iphome.hhi.de/suehring/tml/download/old_jm/jm15.1.zip. Accessed 22 Dec 2011

  23. Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. In: Proceedings of the 13th ITU-T VCEG meeting, Doc. M33. Austin, Texas (2001)

  24. Wan, S., Izquierdo, E.: Rate-distortion optimized motion-compensated prediction for packet loss resilient video coding. IEEE Trans. Image Process. 16(5), 1327–1338 (2007)

    Article  MathSciNet  Google Scholar 

  25. Ding, J.R., Yang, J.F.: Adaptive group-of-pictures and scene change detection methods based on existing H.264 advanced video coding information. IET Image Process. 2(2), 85–94 (2008)

    Article  Google Scholar 

  26. Chasanis, V.T., Likas, A.C., Galatsanos, N.P.: Scene detection in videos using shot clustering and sequence alignment. IEEE Trans. Multimed. 11(1), 89–100 (2009)

    Article  Google Scholar 

  27. Grecos, C., Yang, M.: An improved rate control algorithm based on a novel shot detection scheme for the H.264/AVC standard. J. Real Time Image Process. 4(1), 91–106 (2008)

    Article  Google Scholar 

  28. Baroncini, V., Felice, R., Iacovoni, G.: Variable frame rate control jerkiness-driven. J. Real Time Image Process. 4(2), 167–179 (2008)

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported partially by Chinese Post Doctor Foundation (2011M500734, 2011M501131), Independent Innovation Foundation of Shandong University (2011GN061 and 2010JC007), the National Basic Research Program of China (973Program.2009CB320905, 2010CB735906), the National Natural Science Foundation of China (60872024, 61001180), the Cultivation Fund the Key Scientific and Technical Innovation Project (708059).

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Shandong University, Ji’nan, 250100, China

    Hui Yuan & Ju Liu

  2. State Key Laboratory of ISN, Xidian University, Xi’an, 710071, China

    Jiangtao Ren

  3. Hisense State Key Laboratory of Digital Multi-Media Technology Co. Ltd., Qingdao, 266061, China

    Ju Liu & Yujun Li

Authors
  1. Hui Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ju Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiangtao Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yujun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hui Yuan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yuan, H., Liu, J., Ren, J. et al. Coding modes-based frame skip avoidance scheme for low bit rate video coding. J Real-Time Image Proc 9, 609–619 (2014). https://doi.org/10.1007/s11554-011-0237-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-011-0237-2

Keywords

Search

Navigation