skip to main content
research-article

Motion-invariant photography

Published: 01 August 2008 Publication History

Abstract

Object motion during camera exposure often leads to noticeable blurring artifacts. Proper elimination of this blur is challenging because the blur kernel is unknown, varies over the image as a function of object velocity, and destroys high frequencies. In the case of motions along a 1D direction (e.g. horizontal) we show that these challenges can be addressed using a camera that moves during the exposure. Through the analysis of motion blur as space-time integration, we show that a parabolic integration (corresponding to constant sensor acceleration) leads to motion blur that is invariant to object velocity. Thus, a single deconvolution kernel can be used to remove blur and create sharp images of scenes with objects moving at different speeds, without requiring any segmentation and without knowledge of the object speeds. Apart from motion invariance, we prove that the derived parabolic motion preserves image frequency content nearly optimally. That is, while static objects are degraded relative to their image from a static camera, a reliable reconstruction of all moving objects within a given velocities range is made possible. We have built a prototype camera and present successful deblurring results over a wide variety of human motions.

Supplementary Material

FLV File (30.flv)
MOV File (a71-levin.mov)

References

[1]
Bar, L., Berkels, B., Sapiro, G., and Rumpf:, M. 2007. A variational framework for simultaneous motion estimation and restoration of motion-blurred video. In ICCV.
[2]
Bascle, B., Blake, A., and Zisserman, A. 1996. Motion deblurring and superresolution from an image sequence. In ECCV.
[3]
Ben-Ezra, M., and Nayar, S. K. 2004. Motion-based motion deblurring. PAMI.
[4]
Canon. 2003. EF Lens Work III, The Eyes of EOS. Canon Inc. Lens Product Group.
[5]
Cathey, W., and Dowski, R. 1995. A new paradigm for imaging systems. Applied Optics 41, 1859--1866.
[6]
Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 307--318.
[7]
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. T. 2006. Removing camera shake from a single photograph. ACM Transactions on Graphics 25, 3 (July), 787--794.
[8]
Horn, B. K. 1986. Robot Vision. McGraw-Hill Higher Education.
[9]
Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297--306.
[10]
Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics 26, 3 (July), 70:1--70:9.
[11]
Levin, A. 2006. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS).
[12]
Lucy, L. 1974. Bayesian-based iterative method of image restoration. Journal of Astronomy.
[13]
Raskar, R., Agrawal, A., and Tumblin, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Transactions on Graphics 25, 3 (July), 795--804.
[14]
Rav-Acha, A., and Peleg, S. 2005. Two motion-blurred images are better than one. Pattern Recognition Letters.
[15]
Shi, M., and Zheng, J. 2005. A slit scanning depth of route panorama from stationary blur. In Proc. IEEE Conf. Comput. Vision Pattern Recog.
[16]
Yuan, L., Sun, J., Quan, L., and Shum, H.-Y. 2007. Image deblurring with blurred/noisy image pairs. ACM Transactions on Graphics 26, 3 (July), 1:1--1:10.

Cited By

View all
  • (2024)Quantifying motion blur by imaging shock front propagation with broadband and narrowband X-ray sourcesScientific Reports10.1038/s41598-024-76444-414:1Online publication date: 26-Oct-2024
  • (2023)Motion Deblurring of RAW Mosaic Image Using Coded Exposure Photography2023 31st European Signal Processing Conference (EUSIPCO)10.23919/EUSIPCO58844.2023.10289732(491-495)Online publication date: 4-Sep-2023
  • (2023)Deep coded exposure: end-to-end co-optimization of flutter shutter and deblurring processing for general motion blur removalPhotonics Research10.1364/PRJ.48998911:10(1678)Online publication date: 27-Sep-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 27, Issue 3
August 2008
844 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/1360612
Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008
Published in TOG Volume 27, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. coded imaging
  2. computational photography
  3. motion deblurring
  4. space-time

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)43
  • Downloads (Last 6 weeks)2
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Quantifying motion blur by imaging shock front propagation with broadband and narrowband X-ray sourcesScientific Reports10.1038/s41598-024-76444-414:1Online publication date: 26-Oct-2024
  • (2023)Motion Deblurring of RAW Mosaic Image Using Coded Exposure Photography2023 31st European Signal Processing Conference (EUSIPCO)10.23919/EUSIPCO58844.2023.10289732(491-495)Online publication date: 4-Sep-2023
  • (2023)Deep coded exposure: end-to-end co-optimization of flutter shutter and deblurring processing for general motion blur removalPhotonics Research10.1364/PRJ.48998911:10(1678)Online publication date: 27-Sep-2023
  • (2023)SoDaCam: Software-defined Cameras via Single-Photon Imaging2023 IEEE/CVF International Conference on Computer Vision (ICCV)10.1109/ICCV51070.2023.00750(8131-8142)Online publication date: 1-Oct-2023
  • (2023)An image restoration method for motion-blurred objectsJournal of Physics: Conference Series10.1088/1742-6596/2478/6/0620042478:6(062004)Online publication date: 1-Jun-2023
  • (2022)Deep Dynamic Scene Deblurring From Optical FlowIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2021.308461632:12(8250-8260)Online publication date: Dec-2022
  • (2022)Burst Imaging for Light-Constrained Structure-From-MotionIEEE Robotics and Automation Letters10.1109/LRA.2021.31375207:2(1040-1047)Online publication date: Apr-2022
  • (2022)Learning Spatially Varying Pixel Exposures for Motion Deblurring2022 IEEE International Conference on Computational Photography (ICCP)10.1109/ICCP54855.2022.9887786(1-11)Online publication date: 1-Aug-2022
  • (2022)Preemptive text warping to prevent appearance of motion blurThe Visual Computer10.1007/s00371-022-02545-838:9-10(3391-3403)Online publication date: 28-Jun-2022
  • (2021)Motion Adaptive Deblurring with Single-Photon Cameras2021 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV48630.2021.00199(1944-1953)Online publication date: Jan-2021
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media