Abstract
Frame rate up-conversion (FRUC) is a useful technique for a lot of practical applications, such as display format conversion, low bitrate video coding and slow motion playback. Unlike traditional approaches, such as frame repetition or linear frame interpolation, motion-compensated frame interpolation (MCFI) technique which takes block motion into account is regarded as a more efficient scheme. By considering the deficiencies in previous works, new criteria and coding schemes for enhancing motion derivation and interpolation processes are suggested. We then integrate the proposed MCFI scheme into the decoding process of the latest coding standard, H.264/AVC. In addition, adaptive frame skip is fulfilled at the encoder side to maximize the power of MCFI in video coding applications. As a result, the encoder can adopt the MCFI dynamically and can decide whether the input frame should be coded or dropped then interpolated. Experimental results show that our proposal indeed enhances the overall quality, both subjectively and objectively, especially for the low bitrate video coding.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20, 21–36 (2003)
Kuo, T.-y., Kuo, C.-C.: Motion-compensated interpolation for low-bit-rate video quality enhancement. In: Proc. of SPIE Applications of Digital Image Processing XXI, July 1998. LNCS, vol. 3460, pp. 277–288 (1998)
Jeon, B.-W., Lee, G.-I., Lee, S.-H., Park, R.-H.: Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure. IEEE Trans. on Consumer Electronics 49(3), 499–508 (2003)
Liu, T., Lo, K.-T., Feng, J., Zhang, X.: Frame interpolation scheme using inertia motion interpolation. Proc. of Signal Processing:Image Communication 18, 221–229 (2003)
Lee, S.-H., Kwon, O., Park, R.-H.: Weighted-adaptive motion-compensated frame rate-up conversion. IEEE Trans. on Consumer Electronics 49(3), 485–492 (2003)
Ha, T., Lee, S., Kim, J.: Motion compensated frame interpolation by new block-based motion estimation algorithm. IEEE Trans. on Consumer Electronics 50(2), 752–759 (2004)
Chen, Y.-K., Vetro, A., Sun, H., Kung, S.Y.: Frame-rate up-conversion using transmitted true motion vectors. In: IEEE Second Workshop on Multimedia Signal Processing, December 1998, pp. 622–627 (1998)
Sasai, H., Kondo, S., Kadono, S.: Frame-rate up-conversion using reliable analysis of transmitted motion information. In: Proc. of IEEE International Conference on Acoustics, Speech, & Signal Processing (May 2004)
Zhai, J., Yu, K., Li, J., Li, S.: A low complexity motion compensated frame interpolation method. To be appeared Proc. of IEEE International Symposium on Circuits and Systems (2005)
Kuo, T.-y., Kim, J.W., Kuo, C.-C.J.: Motion-compensated frame interpolation scheme for H.263 codec. In: IEEE International Symposium on Circuits and Systems, vol. 4, pp. 491–494 (May 1999)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. on Image Processing 13(4), 600–612 (2004)
Yang, Y.-T., Wang, S.-W., Tung, Y.-S., Huang, Y.-C., Wu, J.-L.: Low Bitrate and Full Frame Rate Video Communication by Motion-Compensated Frame Interpolation. To be appeared in EURASIP 2005 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, YT., Tung, YS., Wu, JL., Weng, CY. (2005). Low-Bitrate Video Quality Enhancement by Frame Rate Up-Conversion and Adaptive Frame Encoding. In: Ho, YS., Kim, HJ. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3768. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11582267_73
Download citation
DOI: https://doi.org/10.1007/11582267_73
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30040-3
Online ISBN: 978-3-540-32131-6
eBook Packages: Computer ScienceComputer Science (R0)