Skip to main content
SpringerLink
Log in

Rate control of hierarchical B prediction structure for multi-view video coding

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Rate control plays an important role in regulating bit streams in video coding. In order to obtain good coding performance, the hierarchical B prediction structure has been adopted in Multi-view Video Coding (MVC). However, the conventional rate control scheme is not efficient in the hierarchical B prediction structure. In this paper, we propose a rate control algorithm to address this problem. First, the accurate estimation of Mean Absolute Distortion (MAD) of the current frame is desired for both quantization parameter (QP) selection and Rate Distortion Optimization (RDO). Considering the hierarchical B structure, a bi-directional MAD prediction model is proposed to predict the MAD of the current frame by using the actual MADs of the encoded frames in the lower Temporal Layers (TLs). Second, the number of header bits has a close relationship with the TLs in the hierarchical B prediction structure. Therefore, we propose an enhanced prediction method in which a proportional relationship of the header bits is introduced if the frames are located in different TLs. Experimental results show that our proposed algorithm can achieve both accurate target bit rate and good coding performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Chen Y, Pandit P, and Yea S (2009) WD 4 reference software for MVC (JMVC). ISO/IEC JTC1/SC29/WG11 and ITU-T Q6/SG16, Doc. JVT-AD207

  2. Chi MC, Chen MJ, Hsu CT (2004) Region-of interest video coding by fuzzy control for h.263+ standards. In: IEEE Int Symp and Circuits Syst (ISCAS), pp 93–96

  3. Cho YJ, Kuo CCJ, Kwon DK (2007) Gop-based rate control for h.264/svc with hierarchical B-pictures. In: IEEE IntInf. Hiding Multimed Signal Processing (IIHMSP), pp 387–390

  4. Cho YJ, Liu JY, Kwon DK, and Kuo CCJ (2009) H.264/SVC temporal bit allocation with dependent distortion model. In: IEEE Int Conf Acoustics Speech Signal Processing (ICASSP), pp 641–644

  5. Hu SD, Wang HL, Kwong S, Zhao TS, Kuo CCJ (2011) Rate control optimization for temporal-layer scalable video coding. IEEE Trans Circ Syst Video Technol 21(8):1152–1162

    Article  Google Scholar 

  6. ISO/IEC JTC1/SC29/WG11 (2005) Survey of algorithms used for multi-view video coding (MVC). Doc. N6909

  7. ITU-T Recommendation H.264 (2010) Advanced video coding for generic audio visual services

  8. Lee HJ, Chiang TH, Zhang YQ (2000) Scalable rate control for MPEG-4 video. IEEE Trans Circ Syst Video Technol 10(6):878–894

    Article  Google Scholar 

  9. Lee JY, Wey HC, Park DS (2011) A fast and efficient multi-view depth image coding method based on temporal and inter-view corrections of texture images. IEEE Trans Circ Syst Video Tech 21(12):1859–1868

    Article  Google Scholar 

  10. Li ZG, An P, Yan Tao LF, Zhang ZY (2009) Macroblock layer rate control in multi-view video coding. J Appl Sci 27(5):502–507

    Google Scholar 

  11. Li M, Chang YL, Yang FZ, Wan S, Lin SX, Xiong LH (2009) Frame layer rate control for H.264/AVC with hierarchical B-frames. Signal Process: Image Commun 24:177–199

    Google Scholar 

  12. Li ZG, Pan F, Lim KP, Feng G, Lin X, Rahardja S (2003) Adaptive basic unit layer rate control for JVT. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, Doc. JVT-G012

  13. Lim J, Kim J, Ngan KN (2003) Advanced rate control technologies for 3D-HDTV. IEEE Trans Consum Electron 49(4):1498–1507

    Article  Google Scholar 

  14. Liu Y, Li ZG, Soh YC (2008) Rate control of H.264/AVC scalable extension. IEEE Trans Circ Syst Video Technol 18(1):116–121

    Article  Google Scholar 

  15. Liu F, Xiong J, Fan JJ, Lin QJ (2011) Efficient rate control algorithm for multi-view video coding. China Commun:83–89

  16. Merkle P, Müller K, Wiegand T (2010) 3D video: acquisition, coding, and display. IEEE Trans Consum Electron 56(2):946–950

    Article  Google Scholar 

  17. Merkle P, Smolić A, Müller K, Wiegand T (2007) Efficient prediction structures for multiview video coding. IEEE Trans Circ Syst Video Tech 17(1):1461–1473

    Article  Google Scholar 

  18. Müller K, Merkle P, Schwarz H (2006) Multiview video coding based on H.264/MPEG4-AVC using hierarchical B pictures. In: Picture Coding Symposium, pp 24–26

  19. Natio S, Matsumoto S (1999) 34/35Mbps 3D-HDTV digital coding scheme using a modified motion compensation with disparity vectors. In: SPIE Vis Commun Image Process (VCIP), pp. 1082–1089

  20. Park S, Sim DY (2009) An efficient rate-control algorithm for multi-view video coding. In: IEEE Int Symp Consum Electron (ISCE), pp 25–28

  21. Seo CW, Kang JW, Han JK, Nguyen TQ (2010) Efficient bit allocation and rate control algorithms for hierarchical video coding. IEEE Trans Circ Syst Video Technol 20(9):1210–1223

    Article  Google Scholar 

  22. Shen LQ, Liu Z, Zhang ZY (2011) A novel H.264 rate control algorithm with consideration of visual attention. Multimed Tools Appl. doi:10.1007/s11042-011-0893-z

  23. Son NR, Shin YJ, Yoo JM, Lee GS (2006) A new macroblock-layer rate control for H.264/AVC using Quadratic R-D model. Lect Notes In Comput Sci 4319:822–831

    Article  Google Scholar 

  24. Vetro A, Wiegand T, Sullivan GJ (2011) Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard. Proc IEEE 99(4):626–642

    Article  Google Scholar 

  25. Woo W, Ortega A (1999) Optimal blockwise dependent quantization for stereo image coding. IEEE Trans Circ Syst Video Technol 9(6):861–867

    Article  Google Scholar 

  26. Xu L, Gao W, Ji XY, Zhao DB (2007) Rate control for hierarchical B-picture coding with scaling-factors. In: IEEE Int Symp and Circuits Syst (ISCAS), pp 27–30

  27. Xu L, Kwong S, Zhao TS, Zhou Y (2011) Priority pyramid based bit allocation for multiview video coding. In: IEEE Vis Commun Image Processing (VCIP), pp 6–9

  28. Yan T, An P, Shen LQ, Zhang Q, Zhang ZY (2009) Rate control algorithm for multi-view video coding based on correlation analysis. In: IEEE Symp On Photonic Opo electron (SOPO), pp 14–16

  29. Yi XQ, Ling N (2006) Improved H.264 rate control by enhanced MAD-based frame complexity prediction. J Vis Commun Image Represent 17(2):407–424

    Article  Google Scholar 

  30. Zeng HQ, Ma KK, Cai CH (2011) Fast mode decision for multiview video coding using mode correction. IEEE Trans Circ Syst Video Tech 21(11):1659–1666

    Article  Google Scholar 

  31. Zhu ZJ, Liang F, Jiang GY, Yu M (2007) Bit allocation and rate control algorithm for stereo video coding. In: 3DTV conference, pp 7–9

  32. Zhu C, Liu M (2009) Multiple description video coding based on hierarchical B pictures. IEEE Trans Circ Syst Video Technol 19(4):511–521

    Article  Google Scholar 

Download references

Acknowledgment

The authors would like to thank the reviewers for their constructive and valuable comments on this paper. We would also like to thank Prof. Zhenhua Ling, Dr. Haoming Chen and Dr. Chen Zhao for comments and suggestions. This research was partially supported by the Natural Science Foundation of China (No.61271324, 60932007, 61002029, 61001178, 61202266), Natural Science Foundation of Tianjin (No.12JCYBJC10400, 12JCQNJC00500, 12JCQNJC00300), and Research Fund for the Doctoral Program of Higher Education of China (No.20110032120029).

Author information

Authors and Affiliations

  1. School of Electronic Information Engineering, Tianjin University, Tianjin, 300072, China

    Jianjun Lei, Kun Feng, Meimin Wu, Shuai Li & Chunping Hou

  2. Department of Electrical Engineering, University of Washington, Seattle, WA, 98195, USA

    Jianjun Lei

Authors
  1. Jianjun Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kun Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Meimin Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shuai Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Chunping Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianjun Lei.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lei, J., Feng, K., Wu, M. et al. Rate control of hierarchical B prediction structure for multi-view video coding. Multimed Tools Appl 72, 825–842 (2014). https://doi.org/10.1007/s11042-013-1386-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1386-z

Keywords

Search

Navigation