Abstract
The visual effects of rain are complex. Rain produces sharp intensity changes in images and videos that can severely impair the performance of outdoor vision systems. In this paper, we provide a comprehensive analysis of the visual effects of rain and the various factors that affect it. Based on this analysis, we develop efficient algorithms for handling rain in computer vision as well as for photorealistic rendering of rain in computer graphics. We first develop a photometric model that describes the intensities produced by individual rain streaks and a dynamic model that captures the spatio-temporal properties of rain. Together, these models describe the complete visual appearance of rain. Using these models, we develop a simple and effective post-processing algorithm for detection and removal of rain from videos. We show that our algorithm can distinguish rain from complex motion of scene objects and other time-varying textures. We then extend our analysis by studying how various factors such as camera parameters, rain properties and scene brightness affect the appearance of rain. We show that the unique physical properties of rain—its small size, high velocity and spatial distribution—makes its visibility depend strongly on camera parameters. This dependence is used to reduce the visibility of rain during image acquisition by judiciously selecting camera parameters. Conversely, camera parameters can also be chosen to enhance the visibility of rain. This ability can be used to develop an inexpensive and portable camera-based rain gauge that provides instantaneous rain-rate measurements. Finally, we develop a rain streak appearance model that accounts for the rapid shape distortions (i.e. oscillations) that a raindrop undergoes as it falls. We show that modeling these distortions allows us to faithfully render the complex intensity patterns that are visible in the case of raindrops that are close to the camera.
Similar content being viewed by others
References
Andsager, K., Beard, K.V., and Laird, N.F. 1999. Laboratory measurements of axis ratios for large raindrops. Journal of the Atmospheric Sciences, 56:2673–2683.
Beard, K.V. and Chuang, C.H. 1987. A new model for the equilibrium shape of raindrops. Journal of Atmospheric Science, 44(11):1509–1524.
Birchfield, S. 2005. KLT: An Implementation of the Kanade-Lucas-Tomasi Feature Tracker.
Borovoy, A.G., Kabanov M.V., and Saveliev, B.A. 1975. Intensity fluctuations of optical radiation in scattering media. Applied Optics, 14(11):2731–2739.
Bradley, S.G., Stow C.D., and Lynch-Blosse, C.A. 2000. Measurements of rainfall properties using long optical path imaging. American Meteorological Society, 17:761–772.
Choi, E. 1995. Numerical modelling of gust effect on wind-driven rain. In 9th International Conference on Wind Engineering, vol. 9, no. 13, pp. 214–215.
Chu, T.S. and Hogg, D.C. 1996. Effects of precipitation on propagation at 0.63, 3.5 and 10.6 microns. Bell System Technical Journal.
Cozman, F. and Krotkov, E. 1997. Depth from scattering. CVPR, 31:801–806.
Deepak, A. and Box, M.A. 1978. Forward scattering corrections for optical extinction measurements in aerosol media. 2: Poly-Dispersions. Applied Optics, 17:3169–3176.
Dorsey, J., Pedersen, H., and Hanrahan, P. 1996. Flow and changes in appearance. In Proceedings of Siggraph, vo. 79, no. 30.
Flori, J.P. 1990. Mouillage et Schage D”une Facade Verticale: Analyse Experimentale. Technical Report EN-CLI 90.2 L, Centre Scientifique et Technique du B,timen, 1990.
Garg, K. and Nayar, S.K. 2006. Photorealistic rendering of rain streaks. ACM Trans. on Graphics (also Proc. of ACM SIGGRAPH), 25:996–1002.
Gunn, R. and Kinzer, G.D. 1949. Terminal velocity for water droplet in stagnant air. Journal of Meterology, 6:243–248.
Habib, E., Krajewski, W.F., and Kruger, A. 2001. Sampling errors of tipping-bucket rain gauge measurements. Journal of Hydrology Engeering, 6:159.
Horn, B.K.P. 1986. Robot Vision. The MIT Press.
Kubesh, R.J. and Beard, K.V. 1993. Laboratory measurements of spontaneous oscillations of moderate size raindrops. Journal of the Atmospheric Sciences, 50:1089–1098.
Langer, M.S., Zhang, L., Klein, A.W., Bhatia, A., Pereira, J., and Rekhi, D. 2004. A spectral-particle hybrid method for rendering falling snow. In Rendering Techniques, pp. 217–226.
Loffler-Mang, M. and Joss, J. 2000. An optical disdrometer for measuring size and velocity of hydrometeors. Journal of Atmospheric and Oceanic Technology, 17:130–139.
Lomas, A. 2005. The Matrix Revolutions. Personal Communication.
Lucas, B.D. and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In International Joint Conference on Artificial Intelligence.
Manning, R.M. 1993. Stochastic Electromagnetic Image Propogation. McGraw-Hill, Inc.
Marshall, J.S. and Palmer, W.M.K. 1948. The distribution of raindrops with sizes. Journal of Meterology, 5:165–166.
McCartney, E.J. 1975. Optics of the Atmosphere: Scattering by molecules and particles. John Wiley and Sons.
Middleton, W.E.K. 1952. Vision Through the Atmosphere. University of Toronto Press.
Mulvin, L., and Lewis, J. 1994. Architectural detailing, weathering and stone decay. Building and Environment, 29(1):113–138.
Narasimhan, S.G. and Nayar, S.K. 2002. Vision and the Atmosphere. IJCV, 48(3):233–254.
Narasimhan, S.G. and Nayar, S.K. 2003. Contrast restoration of weather degraded images. IEEE Trans. on PAMI, 25(6).
Oakley, J.P. and Satherley, B.L. 1998. Improving image quality in poor visibility conditions using a physical model for degradation. IEEE Trans. on Image Processing, 7.
Website: Submitted rain videos. http://www.cs.columbia.edu/CAVE/ project. 2006.
Michael Reed. 2005. Blue sky studios. Personal Communication.
Schechner, Y.Y., Narasimhan, S.G., and Nayar, S.K. 2001. Instant dehazing of images using polarization. CVPR.
Schonhuber, M., Urban, H.E., Baptista, J.P., Randeu, W.L., and Riedl, W. 1994. Measurements of precipitation characteristics of new disdrometer. In Proceedings of Atmospheric Physics and Dynamics in the Analysis and Prognosis of Precipitation Fields.
Starik, K. and Werman, M. 2003. Simulation of rain in videos. Texture Workshop, ICCV.
Tan, K. and Oakley, J.P. 2000. Enhancement of color images in poor visibility conditions. ICIP, 2.
Tokay, A. and Beard, K.V. 1996. A field study of raindrop oscillations. part I. Journal of Applied Meteorology, 35.
Wang, N. and Wade, B. 2004. Rendering falling rain and snow. SIGGRAPH (sketches 0186).
Wang, T. and Clifford, S.F. 1975. Use of rainfall-induced optical scintillations to measure path-averaged rain parameters. Journal of the Optical Society of America, 8:927–937.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Garg, K., Nayar, S.K. Vision and Rain. Int J Comput Vis 75, 3–27 (2007). https://doi.org/10.1007/s11263-006-0028-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11263-006-0028-6