Skip to main content

Video Deblurring and Super-Resolution Technique for Multiple Moving Objects

  • Conference paper
Computer Vision – ACCV 2010 (ACCV 2010)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6495))

Included in the following conference series:

Abstract

Video camera is now commonly used and demand of capturing a single frame from video sequence is increasing. Since resolution of video camera is usually lower than digital camera and video data usually contains a many motion blur in the sequence, simple frame capture can produce only low quality image; image restoration technique is inevitably required. In this paper, we propose a method to restore a sharp and high-resolution image from a video sequence by motion deblur for each frame followed by super-resolution technique. Since the frame-rate of the video camera is high and variance of feature appearance in successive frames and motion of feature points are usually small, we can still estimate scene geometries from video data with blur. Therefore, by using such geometric information, we first apply motion deblur for each frame, and then, super-resolve the images from the deblurred image set. For better result, we also propose an adaptive super-resolution technique considering different defocus blur effects dependent on depth. Experimental results are shown to prove the strength of our method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ben-Ezra, M., Nayar, S.: Motion Deblurring using Hybrid Imaging. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. I, pp. 657–664 (2003)

    Google Scholar 

  2. Tai, Y.W., Du, H., Brown, M.S., Lin, S.: Image/video deblurring using a hybrid camera. In: CVPR (2008)

    Google Scholar 

  3. Farsiu, S., Robinson, M.D., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. on Image Processing 13, 1327–1344 (2004)

    Article  Google Scholar 

  4. Lucy, L.: An iterative technique for the rectification of observed distributions. J. of Astronomy 79, 745–754 (1974)

    Article  Google Scholar 

  5. Irani, M.I., Peleg, S.: Improving resolution by image registration. CVGIP 53, 231–239 (1991)

    Google Scholar 

  6. Levin, A., Weiss, Y., Durand, F., Freeman, W.: Understanding and evaluating blind deconvolution algorithms. In: CVPR, pp. 1964–1971 (2009)

    Google Scholar 

  7. Li, F., Yu, J., Chai, J.: A hybrid camera for motion deblurring and depth map super-resolution. In: CVPR (2008)

    Google Scholar 

  8. Sroubek, F., Gabriel, C., Flusser, J.: A unified approach to superresolution and multichannel blind deconvolution. IEEE Trans. on Image Processing 16, 2322–2332 (2007)

    Article  MathSciNet  Google Scholar 

  9. Fergus, R., Singh, B., Hertzmann, A., Roweis, S.T., Freeman, W.T.: Removing camera shake from a single photograph. In: SIGGRAPH, pp. 787–794 (2006)

    Google Scholar 

  10. Shan, Q., Jia, J., Agarwala, A.: High-quality motion deblurring from a single image. In: ACM Transactions on Graphics, SIGGRAPH (2008)

    Google Scholar 

  11. Levin, A., Fergus, R., Durand, F., Freeman, W.: Image and depth from a conventional camera with a coded aperture. In: SIGGRAPH (2007)

    Google Scholar 

  12. Levin, A., Sand, P., Cho, T.S., Durand, F., Freeman, W.T.: Motion-invariant photography. In: SIGGRAPH, pp. 1–9 (2008)

    Google Scholar 

  13. Cho, S., Matsushita, Y., Lee, S.: Removing non-uniform motion blur from images. In: ICCV, pp. 1–8 (2007)

    Google Scholar 

  14. Farsiu, S., Elad, M., Milanfar, P.: A practical approach to superresolution. In: Visual Communications and Image Processing, vol. 6077 (2006)

    Google Scholar 

  15. Katsaggelos, A.K., Molina, R., Mateos, J.: Super Resolution of Images and Video. Morgan & Claypool Publishers, San Francisco (2006)

    Google Scholar 

  16. Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Processing Magazine 20, 21–36 (2003)

    Article  Google Scholar 

  17. Tung, T., Nobuhara, S., Matsuyama, T.: Simultaneous super-resolution and 3d video using graph-cuts. In: CVPR (2008)

    Google Scholar 

  18. Levin, A.: Blind motion deblurring using image statistics. In: NIPS (2006)

    Google Scholar 

  19. Zucchelli, M., Santos-Victor, J., Christensen, H.: Multiple plane segmentation using optical flow. In: BMVC, pp. 313–322 (2002)

    Google Scholar 

  20. Dick, A., Torr, P., Cipolla, R.: Automatic 3d modelling of architecture. In: BMVC, pp. 372–381 (2000)

    Google Scholar 

  21. Bartoli, A.: Piecewise planar segmentation for automatic scene modeling. In: CVPR, pp. 283–289 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yamaguchi, T., Fukuda, H., Furukawa, R., Kawasaki, H., Sturm, P. (2011). Video Deblurring and Super-Resolution Technique for Multiple Moving Objects. In: Kimmel, R., Klette, R., Sugimoto, A. (eds) Computer Vision – ACCV 2010. ACCV 2010. Lecture Notes in Computer Science, vol 6495. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19282-1_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19282-1_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19281-4

  • Online ISBN: 978-3-642-19282-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics