Abstract
Consider situations where the depth at each point in the scene is multi-valued, due to the presence of a virtual image semi-reflected by a transparent surface. The semi-reflected image is linearly superimposed on the image of an object that is behind the transparent surface. A novel approach is proposed for the separation of the superimposed layers. Focusing on either of the layers yields initial separation, but crosstalk remains. The separation is enhanced by mutual blurring of the perturbing components in the images. However, this blurring requires the estimation of the defocus blur kernels. We thus propose a method for self calibration of the blur kernels, given the raw images. The kernels are sought to minimize the mutual information of the recovered layers. Autofocusing and depth estimation in the presence of semi-reflections are also considered. Experimental results are presented.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Abbott, A.L. and Ahuja, N. 1993. Active stereo: Integrating disparity, vergence, focus, aperture and calibration for surface estimation. IEEE Trans. Pattern. Anal. Mach. Intell., 15(10):1007–1029.
Agard, D.A. 1984. Optical sectioning microscopy: Cellular architecture in three dimensions. Ann. Rev. Biophys. Bioeng., 13:191–219.
Agard, D.A. and Sedat, J.W. 1983. Three-dimensional structure of a polytene nucleus. Nature, 302(5910):676–681.
Aghdasi, F. and Ward, R.K. 1996. Reduction of boundary artifacts in image restoration. IEEE Trans. Image Processing, 5(4):611–618.
Aizawa, K., Kodama, K., and Kubota, A. 2000. Producing object-based special effects by fusing multiple differently focused images. IEEE Trans. on Circuits and Systems for Video Technology, 10(2):323–330.
Bergen, J.R., Burt, P.J., Hingorani, R., and Peleg, S. 1992. A three-frame algorithm for estimating two-component image motion. IEEE Trans. Pattern. Anal. Mach. Intell., 14(9):886–895.
Borga, M. and Knutsson, H. 1999. Estimating multiple depths in semi-transparent stereo images. In Proc. Scandinavian Conf. on Image Analysis, Kangerlussuaq, Greenland. Vol. I, pp. 127–133. Published by the Pattern Recognition Society of Denmark, Lyngby, Denmark.
Castleman, K.R. 1979. Digital image processing. Prentice-Hall, New Jersey, pp. 357–360.
Chiu, M.Y., Barrett, H.H., Simpson, R.G., Chou, C., Arendt, J.W., and Gindi, G.R. 1979. Three dimensional radiographic imaging with a restricted view angle. J. Opt. Soc. Am. A, 69(10):1323–1333.
Conchello, J.A. and Hansen E.W. 1990. Enhanced 3-D reconstruction from confocal scanning microscope images. I: Deterministic and maximum likelihood reconstructions. App. Opt., 29(26):3795–3804.
Cover, T.M. and Thomas, J.A. 1991. Elements of information theory. John Wiley & Sons, New York, pp. 12–21.
Darrell, T. and Simoncelli, E. 1993a. Separation of transparent motion into layers using velocity-tuned mechanisms. M.I.T Media Lab., Massachusetts Institute of Technology, Cambridge, MA. Media-Lab TR-244.
Darrell, T. and Simoncelli, E. 1993b. 'Nulling’ filters and the separation of transparent motions. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, pp. 738–739.
Darrell, T. and Wohn K. 1988. Pyramid based depth from focus. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Ann Arbor, MI, pp. 504–509.
Diaspro, A., Sartore M., and Nicolini, C. 1990. 3D representation of biostructures imaged with an optical microscope. Imag. and Vis. Comp., 8(2):130–141.
Engelhardt, K. and Hausler, G. 1988. Acquisition of 3-D data by focus sensing. App. Opt., 27(22):4684–4689.
Erhardt, A., Zinger, G., Komitowski, D., and Bille, J. 1985. Reconstructing 3-D light-microscopic images by digital image processing. App. Opt., 24(2):194–200.
Farid, H. and Adelson, E.H. 1999. Separating reflections from images by use of independent components analysis. J. Opt. Soc. Am. A, 16(9):2136–2145.
Fay, F.S., Fujiwara, K., Rees, D.D., and Fogarty, K.E. 1983. Distribution of actinin in single isolated smooth muscle cells, J. of Cell Biology, 96:783–795.
Fujikake, H., Takizawa, K., Aida, T., Kikuchi, H., Fujii, T., and Kawakita, M. 1998. Electrically-controllable liquid crystal polarizing filter for eliminating reflected light. Optical Review, 5(2):93–98.
Hausler, G. and Korner, E. 1984. Simple focusing criterion. App. Opt, 23(15):2468–2469.
Irani, M., Rousso, B., and Peleg, S. 1994. Computing occluding and transparent motions. Int. J. Comp. Vis., 12(1):5–16.
Itoh, K., Hayashi, A., and Ichioka, Y. 1989. Digitized optical microscopy with extended depth of field. App. Opt., 28(16):3487–3493.
Jansson, P.A., Hunt, R.H., and Plyler, E.K. 1970. Resolution enhancement of spectra. J. Opt. Soc. Am., 60(5):596–599.
Jarvis, R.A. 1983. A perspective on range-finding techniques for computer vision. IEEE Trans. Pattern Anal. Mach. Intell., 5(2):122–139.
Krishnan, A. and Ahuja, N. 1996. Panoramic image acquisition. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, pp. 379–384.
Kubota, A., Kodama, K., and Aizawa, K. 1999. Registration and blur estimation methods for multiple differently focused images. In Proc. International Conference on Image Processing, Kobe, Japan, Vol. 2, pp. 447–451.
Luenberger, D.G. 1989. Linear and Nonlinear Programming, 2nd ed., Adisson-Wesley, London.
Marcias-Garza, F., Bovik, A.C., Diller, K.R., Aggarwal, S.J., and Aggarwal, J.K. 1988. The missing cone problem and low-pass distortion in optical serial sectioning microscopy. In Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing, New York, Vol-II, pp. 890–893.
McNally, J.G., Preza, C., Conchello, J.A., and Thomas, L.J., Jr. 1994. Artifacts in computational optical-sectioning microscopy. J. Opt. Soc. Am. A, 11(3):1056–1067.
Nair, H.N. and Stewart, C.V. 1992. Robust focus ranging. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, pp. 309–314.
Nayar, S.K. 1992. Shape from focus system. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, pp. 302–308.
Nayar, S.K., Watanabe, M., and Nogouchi, M. 1995. Real time focus range sensor. In Proc. IEEE International Conf. on Computer Vision, Cambridge, MA, pp. 995–1001.
Noguchi, M. and Nayar, S.K. 1994. Microscopic shape from focus using active illumination. In Proc. IAPR International Conference on Image Processing, Jerusalem, Israel, Vol-1, pp. 147–152.
Ohnishi, N., Kumaki, K., Yamamura, T., and Tanaka, T. 1996. Separating real and virtual objects from their overlapping images. In Proc. European Conf. on Computer Vision Vol. II, Cambridge, UK. Springer, New York, pp. 636–646. Lecture notes in Computer Science 1065.
Oren M. and Nayar, S.K. 1995. A theory of specular surface geometry. In Proc. IEEE International Conf. on Computer Vision, Cambridge, MA, pp. 740–747.
Preza, C., Miller, M.I., Thomas, L.J., Jr., and McNally, J.G. 1992. Regularized linear method for reconstruction of three-dimensional microscopic objects from optical sections. J. Opt. Soc. Am. A, 9(2):219–228.
Schechner, Y.Y. and Kiryati, N. 1998. Depth from defocus vs. Stereo: How different really are they? In Proc. IEEE Computer Society International Conference on Pattern Recognition, Brisbane, Australia, Vol. 2, pp. 1784–1786. To be published in the Int. J. Computer Vision.
Schechner, Y.Y. and Kiryati, N. 1999. The optimal axial interval in estimating depth from defocus. In Proc. IEEE International Conf. on Computer Vision, Kerkyra, Greece, Vol. II, pp. 843–848.
Schechner, Y.Y., Kiryati, N., and Basri, R. 1998. Separation of transparent layers using focus. In Proc. IEEE International Conf. on Computer Vision, Mumbai, India, pp. 1061–1066.
Schechner, Y.Y., Kiryati, N., and Shamir, J. 1999a. Separation of transparent layers by polarization analysis. In Proc. Scandinavian Conf. on Image Analysis, Kangerlussuaq, Greenland, Vol. I, pp. 235–242. Published by the Pattern Recognition Society of Denmark, Lyngby, Denmark.
Schechner, Y.Y., Shamir, J., and Kiryati, N. 1999b. Vision through semireflecting media: Polarization analysis. Optics Letters, 24(16):1088–1090.
Schechner, Y.Y., Shamir, J., and Kiryati, N., 1999c. Polarization-based decorrelation of transparent layers: The inclination angle of of an invisible surface. In Proc. IEEE International Conf. on Computer Vision, Kerkyra, Greece, Vol. II, pp. 814–819.
Schechner, Y.Y., Kiryati, N., and Shamir, J. 2000a. Blind recovery of transparent and semireflected scenes. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Hilton Head Island, SC, Vol. 1, pp. 38–43.
Schechner, Y.Y., Shamir, J., and Kiryati, N. 2000b. Polarization and statistical analysis of scenes containing a semi-reflector. J. Opt. Soc. Am. A, 17(2):276–284.
Sheppard, C.J.R. and Gu, M. 1991. Three dimensional optical transfer function for an annular lens. Optics Communications, 81(5):276–280.
Shizawa, M. 1992. On visual ambiguities due to transparency in motion and stereo. In Proc. European Conf. on Computer Vision, Santa Margherita Ligure, Italy, Springer-Verlag, New York, pp. 411–419. Lecture notes in Computer Science 588.
Shizawa, M. 1993. Direct estimation of multiple disparities for transparent multiple surfaces in binocular stereo. In Proc. IEEE International Conf. on Computer Vision, Berlin, pp. 447–454.
Shizawa, and Mase, K. 1990. Simultaneous multiple optical flow estimation. In Proc. International Conference on Pattern Recognition, Atlantic City, NJ, Vol. 1, pp. 274–278.
Streibl, N. 1984. Fundamental restrictions for 3-D light distributions. Optik, 66(4):341–354.
Streibl, N. 1985. Three-dimensional imaging by a microscope. J. Opt. Soc. Am. A, 2(2):121–127.
Subbarao, M. and Jenn-Kwei Tyan. 1995. The optimal focus measure for passive autofocusing and depth from focus. In Proc. SPIE 2598–Videometrics VI, Philadelphia, PA, pp. 89–99.
Sugimoto, S.A. and Ichioka, Y. 1985. Digital composition of images with increased depth of focus considering depth information. App. Opt., 24(14):2076–2080.
Sundaram, H. and Nayar, S. 1997. Are textureless scenes recoverable? In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 814–820.
Torroba, P., Cap, N., and Rabal, H. 1994. Defocus detection using a visibility criterion. Journal of Modern Optics, 41(1):111–117.
Thevenaz, P. and Unser, M. 1998. An efficient mutual information optimizer for multiresolution image registration. In Proc. IEEE Computer Society International Conference on Image Processing, Chicago, IL, Vol. I, pp. 833–837.
Viola, P. and Wells, W.M. III, 1997. Alignment by maximization of mutual information. Int. J. of Computer Vision, 24(2):137–154.
Wang, J.Y.A. and Adelson, E.H. 1993. Layered representation for motion analysis. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, pp. 361–365.
Watanabe, M. and Nayar, S.K. 1996. Telecentric optics for computational vision. In Proc. European Conf. on Computer Vision, Cambridge, UK. Springer, New York, Vol. II, pp. 439–451. Lecture notes in Computer Science 1065.
Weinshall, D. 1989. Perception of multiple transparent planes in stereo vision. Nature, 341(6244):737–739.
Xiong, Y. and Shafer, S.A. 1993. Depth from focusing and defocusing. In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York, pp. 68–73.
Yeo, T.T.E., Ong, S.H., Jayasooriah, and Sinniah, R. 1993. Autofocusing for tissue microscopy. Image and Vision Computing, 11(10):629–639.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Schechner, Y.Y., Kiryati, N. & Basri, R. Separation of Transparent Layers using Focus. International Journal of Computer Vision 39, 25–39 (2000). https://doi.org/10.1023/A:1008166017466
Issue Date:
DOI: https://doi.org/10.1023/A:1008166017466