Abstract
This paper presents an optimal method for the separation of reflected and transparent layers from real-world scene images. Whereas past research has been applied to indoor environments and static cameras, our technique can be used for outdoor scenes and motion cameras. The method is based on spatio-temporal analysis, especially using epipolar plane images (EPI). The edge and color information of EPI has been used to segment the areas on EPIs efficiently and separate the reflected and transparent layers. This method can be used for refining building textures by removing reflections from captured images for the purpose of city modeling.
Article PDF
Similar content being viewed by others
References
Bolles R., Baker H., Marimont D. (1987) Epipolar plane image analysis: an approach to determining structure from motion. Int. J. Comput. Vis. 1, 7–55
Bronstein, A.M., Bronstein, M.M., Zibulevsky, M., Zeevi, Y.Y. Blind separation on reflections using sparse ICA. In: 4th International Symposium of Independent Component Analysis and Blind Signal Separation, pp. 227–232 (2003)
Farid H., Adelson E.H. (1999) Separating reflections from images using independent components analysis. J. Opt. Soc. Am. 16, 2136–2145
Hermanto, Barros, A.K., Yamamura, T., Ohnishi, N. Separating virtual and real objects using independent component analysis. IEICE TRANS E84-D (2001)
Irani M., Peleg S. (1993) Motion analysis for image enhancement: resolution, occlusion, and transparency. J. Vis. Commun. Image Rep. 4(4): 324–335
Kawasaki, H., Miyamoto, A., Ohsawa, Y., Ono, S., Ikeuchi, K. Multiple video camera calibration using epi for city modeling. In: ACCV, vol. 2, pp. 569–574 (2004)
Sarel, B., Irani, M. Separating transparent layers through layer information exchange. In: ECCV, vol. 4, pp. 328–341 (2004)
Schechner Y.Y., Kiryati N., Basri R. (2000) Separation of transparent layers using focus. Int. J. Comput. Vis. 39, 25–39
Schechner, Y.Y., Kiryati, N., Shamir, J. Separation of transparent layers by polarization analysis. In: Scandinavian Conference on Image Analysis, vol. 1, pp. 235–242 (1999)
Schechner Y.Y., Kiryati N., Shamir J. (2000) Blind recovery of transparent and semireflected scenes. Comput. Vis. Pattern Recognit. 1, 38–43
Schechner Y.Y., Shamir J. (1999) Vision through semireflecting media: polarization analysis. Opt. Lett. 24, 1088–1090
Schechner, Y.Y., Shamir, J., Kiryati, N. Polarization-based decorrelation of transparent layers: the inclination angle of an invisible surface. In: ICCV, vol. 2, pp. 814–819 (1999)
Swaminathan, R., Kang, S.B., Szeliski, R. On the motion and appearance of specularities in image sequences. In: ECCV, vol. 1, pp. 508–523 (2002)
Szeliski, R., Avidan, S., Anandan, P. Layer extraction from multiple images containing reflections and transparency. In: CVPR, pp. 1246–1253 (2000)
Toro J., Owens J., Medina R. (2003) Using known motion fields for image separation in transparency. Pattern Recognit. Lett. 24, 594–605
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Oo, T., Kawasaki, H., Ohsawa, Y. et al. The separation of reflected and transparent layers from real-world image sequence. Machine Vision and Applications 18, 17–24 (2007). https://doi.org/10.1007/s00138-006-0043-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-006-0043-1