Skip to main content
SpringerLink
Log in

Transcoding with Resolution Conversion Using Super-Resolution and Irregular Sampling

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

In transcoding, quantization and other techniques could result in lower video output quality. To address this problem a novel super-resolution (SR) algorithm based on irregular sampling (IS) is presented in this paper. The high-resolution (HR) frame is obtained as an interpolation of one or more previous frames; the resulting interpolated frame has samples non-uniformly spaced in the areas where movement happened. To reconstruct the irregular sampled frame we use a well-known irregular sampling algorithm modified to perform in 2-D space. Moreover, because SR algorithms are in general computationally expensive, we also present a hardware feasibility study. The proposed solution does not target any specific application but we have specifically tested the algorithm in a transcoding environment. In particular, we have applied it to VC-1 to H.264 transcoding and applied down/up sampling. Experimental results show that the proposed algorithm improves video quality significantly.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9

Similar content being viewed by others

References

  1. SMPTE. Standard for television: VC-1 compressed video bitstream format and decoding process. SMPTE 421M-2006.

  2. ITU-T. (2007). Advanced video coding for generic audiovisual services. ITU-T Rec. H.264 V.8, Nov.

  3. Lee, Y. -R., & Lin, C. -W. (2007). Visual quality enhancement in DCT-domain spatial downscaling transcoding using generalized DCT decimation. IEEE Transactions on Circuits and Systems for Video Technology, 17(8), August.

  4. Dugad, R., & Ahuja, N. (2001). A fast scheme for image size change in the compressed domain. IEEE Transactions on Circuits and Systems for Video Technology, 11(4). April.

  5. Lee, J. -B., Kalva, H. (2006). An efficient algorithm for VC-1 to H.264 video transcoding in progressive compression. Proceedings of IEEE International Conference on Multimedia and Expo.

  6. Pantoja, M., Kalva, H., & Lee, J.-B. (2007). P-frame transcoding in VC-1 to H.264 transcoders. Proceedings of IEEE International Conference on Image Processing, 5, 297–300. San Antonio, Texas.

    Google Scholar 

  7. Pantoja, M., Ling, N., & Shang, W. (2007). Coefficient conversion for transform domain VC-1 to H.264 transcoding. Proc IEEE Workshop on Signal Processing Systems, 363–367. Shanghai, China, Oct. 17–19.

  8. Park, S., Park, M., & Kang, M. (2003). Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine, 20, 21–36. doi:10.1109/MSP.2003.1203207.

    Article  Google Scholar 

  9. Segall, C. A., Molina, R., & Katsaggelos, A. K. (2003). High-resolution images from low-resolution compressed video. IEEE Signal Processing Magazine, 20, 37–48. doi:10.1109/MSP.2003.1203208.

    Article  Google Scholar 

  10. Brandi, F., de Queiroz, R., & Mukherjee, D. (2008). Super-resolution using key frames and motion estimation. Proceedings of IEEE International Conference on Image Processing, 1, 321–324.

    Google Scholar 

  11. Su, H., Tang, L., Tretter, D., & Zhou, J. (2008). A practical and adaptive framework for super-resolution. Proceedings of IEEE International Conference on Image Processing, 1, 1236–1249.

    Google Scholar 

  12. Prendergast, R. S., & Nguyen, T. (2008). A block-based super-resolution for video sequences. Proceedings of IEEE International Conference on Image Processing, 1, 1240–1243.

    Google Scholar 

  13. Grochening, K. (1992). Reconstruction algorithms in irregular sampling. Mathematics of Computation, 59(99), 181–194. doi:10.2307/2152989.

    Article  MathSciNet  Google Scholar 

  14. Feichtinger, H. G., Cenker, C., & Steier, H. (1991). Fast iterative and non-iterative reconstruction methods in irregular sampling. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 1773–1776.

  15. Sauer, K. D., & Allebach, J. P. (1987). Iterative reconstruction of band-limited images from nonuniformly spaced samples. IEEE Transactions on Circuits and Systems-I, 34(12), 1497–1506. doi:10.1109/TCS.1987.1086088.

    Article  Google Scholar 

  16. Strohmer, T. (1997). Computationally attractive reconstruction of band limited images from irregular samples. IEEE Transactions on Image Processing, 6(4), 540–548. doi:10.1109/83.563319.

    Article  MathSciNet  Google Scholar 

  17. Early, D. S., & Long, D. G. (2001). Image reconstruction and enhanced resolution imaging from irregular samples. IEEE Transactions on Geosciences and Remote Sensing, 39(2), 291–302. doi:10.1109/36.905237.

    Article  Google Scholar 

  18. de Haan, G., Biezen, P. W. A. C., Huijgen, H., & Ojo, O. A. (1993). True-motion estimation with 3-D recursive search block matching. IEEE Transactions on Circuits and Systems for Video Technology, 3(5), 368–379. doi:10.1109/76.246088.

    Article  Google Scholar 

  19. Tom, B. C., & Katsaggelos, A. K. (1996). Resolution enhancement of video sequences using motion compensation. Proceedings of IEEE International Conference on Image Processing, 1, 713–716.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Santa Clara University, Santa Clara, CA, 95053, USA

    Maria Pantoja & Nam Ling

Authors
  1. Maria Pantoja
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nam Ling
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Maria Pantoja.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Pantoja, M., Ling, N. Transcoding with Resolution Conversion Using Super-Resolution and Irregular Sampling. J Sign Process Syst 60, 305–313 (2010). https://doi.org/10.1007/s11265-009-0368-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-009-0368-x

Keywords

Search

Navigation