Ramesh Raskar
Abstract
In a conventional single-exposure photograph, moving objects or moving cameras cause motion blur. The exposure time defines a temporal box filter that smears the moving object across the image by convolution. This box filter destroys important high-frequency spatial details so that deblurring via deconvolution becomes an ill-posed problem.Rather than leaving the shutter open for the entire exposure duration, we "flutter" the camera's shutter open and closed during the chosen exposure time with a binary pseudo-random sequence. The flutter changes the box filter to a broad-band filter that preserves high-frequency spatial details in the blurred image and the corresponding deconvolution becomes a well-posed problem. We demonstrate that manually-specified point spread functions are sufficient for several challenging cases of motion-blur removal including extremely large motions, textured backgrounds and partial occluders.
Supplemental Material
- Bascle, B., Blake, A., and Zisserman, A. 1996. Motion deblurring and super-resolution from an image sequence. In ECCV, vol. 2, 573--582. Google Scholar
Digital Library
- Ben-Ezra, M., and Nayar, S. 2004. Motion-based Motion Deblurring. IEEE Trans. on Pattern Analysis and Machine Intelligence 26, 6 (Jun), 689--698. Google ScholarDigital Library
- Black, M. J., and Anandan, P. 1996. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. In Computer Vision and Image Understanding (CVIU), vol. 63, 75--104. Google ScholarDigital Library
- Canon, 2006. What is optical image stabilizer? http://www.canon.com/bctv/faq/optis.html.Google Scholar
- Edgerton, H., 1951-1963. Rapatronic Photographs. http://simplethinking.com/home/rapatronic_photographs.htm.Google Scholar
- Gottesman, S. R., and Fenimore, E. E. 1989. New family of binary arrays for coded aperture imaging. Applied Optics 28, 20 (Oct), 4344--4352.Google ScholarCross Ref
- Hadamard, J. 1923. Lectures on the Cauchy Problem in Linear Partial Differential Equations. Yale University Press, New Haven, CT.Google Scholar
- Jansson, P. 1997. Deconvolution of Image and Spectra, 2nd ed. Academic Press. Google ScholarDigital Library
- Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Bayesian correction of image intensity with spatial consideration. In ECCV, vol. 3, 342--354.Google Scholar
- Kundur, D., and Hatzinakos, D. 1998. A novel blind deconvolution scheme for image restoration using recursive filtering. IEEE Trans. on Signal Processing 46, 2 (Feb), 375--39. Google ScholarDigital Library
- Liu, X., and Gamal, A. 2001. Simultaneous image formation and motion blur restoration via multiple capture. In Proc. Int. Conf. Acoustics, Speech, Signal Processing. Google ScholarDigital Library
- Lucy, L. 1974. An iterative technique for the rectification of observed distributions. Journal of Astronomy 79, 745--754.Google ScholarCross Ref
- Nikon, 2005. Precise camera-shake compensation at every angle. www.nikon.co.jp/main/eng/portfolio/about/technology/nikon_technology/vr_e.Google Scholar
- Pointgrey Research, 2006. PGR IEEE-1394 Digital Camera Register Reference. http://www.ptgrey.com.Google Scholar
- Rat, 2006. Coded-exposure datasets. http://www.merl.com/people/raskar/deblur/.Google Scholar
- Richardson, W. 1972. Bayesian-based iterative method of image restoration. J. Opt. Soc. of Am. 62, 1 (January), 55--59.Google ScholarCross Ref
- Schultz, R. R., and Stevenson, R. L. 1996. Extraction of high-resolution frames from video sequences. In IEEE Trans. on Image Processing, vol. 5, IEEE, 996--1011. Google ScholarDigital Library
- Shechtman, E., Caspi, Y., and Irani, M. 2002. Increasing space-time resolution in video. In ECCV, Springer-Verlag, London, UK, 753--768. Google ScholarDigital Library
- Tikhonov, A. N., and Arsenin, V. I. 1977. Solutions of ill-posed problems {Metody resheniia nekorrektnykh zadach}. Halsted Press, New York.Google Scholar
- Trevor J. Cox, P. D. 2003. Engineering art: the science of concert hall acoustics. Interdisciplinary Science Reviews 28, 2, 119--129.Google ScholarCross Ref
- Tull, D. T., and Katsaggelos, A. K. 1996. Iterative restoration of fast-moving objects in dynamic image sequences. Optical Engineering 35, 12 (Dec), 3460--3469.Google ScholarCross Ref
- Wang, J., and Adelson, E. 1994. Representing moving images with layers. IEEE Trans. Image Processing 3, 5 (Sept), 625--638.Google ScholarDigital Library
- Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. ACM Trans. Graph. 24, 3, 765--776. Google ScholarDigital Library
- Yitzhaky, Y., Mor, I., Lantzman, A., and Kopeika, N. 1998. Direct method for restoration of motion-blurred images. J. Optical Society of America A (Optics, Image Science and Vision) 15, 6 (June), 1512--1519.Google Scholar
Index Terms
- Coded exposure photography: motion deblurring using fluttered shutter
Recommendations
Coded exposure photography: motion deblurring using fluttered shutter
SIGGRAPH '06: ACM SIGGRAPH 2006 PapersIn a conventional single-exposure photograph, moving objects or moving cameras cause motion blur. The exposure time defines a temporal box filter that smears the moving object across the image by convolution. This box filter destroys important high-...
Coded-exposure camera and its circuits design
In the industrial production line, the motion of the target is the main reason for blurred image of the camera monitoring. A coded-exposure devices and circuits are designed to get restored image from this motion blurring. A given binary code sequence ...
Coded exposure HDR light-field video recording
Capturing exposure sequences to compute high dynamic range HDR images causes motion blur in cases of camera movement. This also applies to light-field cameras: frames rendered from multiple blurred HDR light-field perspectives are also blurred. While ...
Comments