skip to main content
research-article

Motion-invariant photography

Authors Info & Claims
Published:01 August 2008Publication History
Skip Abstract Section

Abstract

Object motion during camera exposure often leads to noticeable blurring artifacts. Proper elimination of this blur is challenging because the blur kernel is unknown, varies over the image as a function of object velocity, and destroys high frequencies. In the case of motions along a 1D direction (e.g. horizontal) we show that these challenges can be addressed using a camera that moves during the exposure. Through the analysis of motion blur as space-time integration, we show that a parabolic integration (corresponding to constant sensor acceleration) leads to motion blur that is invariant to object velocity. Thus, a single deconvolution kernel can be used to remove blur and create sharp images of scenes with objects moving at different speeds, without requiring any segmentation and without knowledge of the object speeds. Apart from motion invariance, we prove that the derived parabolic motion preserves image frequency content nearly optimally. That is, while static objects are degraded relative to their image from a static camera, a reliable reconstruction of all moving objects within a given velocities range is made possible. We have built a prototype camera and present successful deblurring results over a wide variety of human motions.

Skip Supplemental Material Section

Supplemental Material

30.flv

flv

87.2 MB

a71-levin.mov

mov

20.2 MB

References

  1. Bar, L., Berkels, B., Sapiro, G., and Rumpf:, M. 2007. A variational framework for simultaneous motion estimation and restoration of motion-blurred video. In ICCV.Google ScholarGoogle Scholar
  2. Bascle, B., Blake, A., and Zisserman, A. 1996. Motion deblurring and superresolution from an image sequence. In ECCV. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ben-Ezra, M., and Nayar, S. K. 2004. Motion-based motion deblurring. PAMI. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Canon. 2003. EF Lens Work III, The Eyes of EOS. Canon Inc. Lens Product Group.Google ScholarGoogle Scholar
  5. Cathey, W., and Dowski, R. 1995. A new paradigm for imaging systems. Applied Optics 41, 1859--1866.Google ScholarGoogle Scholar
  6. Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 307--318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. T. 2006. Removing camera shake from a single photograph. ACM Transactions on Graphics 25, 3 (July), 787--794. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Horn, B. K. 1986. Robot Vision. McGraw-Hill Higher Education. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297--306. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics 26, 3 (July), 70:1--70:9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Levin, A. 2006. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS).Google ScholarGoogle Scholar
  12. Lucy, L. 1974. Bayesian-based iterative method of image restoration. Journal of Astronomy.Google ScholarGoogle Scholar
  13. Raskar, R., Agrawal, A., and Tumblin, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Transactions on Graphics 25, 3 (July), 795--804. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Rav-Acha, A., and Peleg, S. 2005. Two motion-blurred images are better than one. Pattern Recognition Letters. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Shi, M., and Zheng, J. 2005. A slit scanning depth of route panorama from stationary blur. In Proc. IEEE Conf. Comput. Vision Pattern Recog. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Yuan, L., Sun, J., Quan, L., and Shum, H.-Y. 2007. Image deblurring with blurred/noisy image pairs. ACM Transactions on Graphics 26, 3 (July), 1:1--1:10. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Motion-invariant photography

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader