skip to main content
10.1145/2466715.2466731acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmirageConference Proceedingsconference-collections
research-article

Color invariant feature matching for image geometric correction

Published:06 June 2013Publication History

ABSTRACT

The success of matching algorithms relies on the definition of features which are both invariant against the geometric distortions to be considered, and distinctive enough to avoid ambiguities. This paper addresses the problem of color feature points matching under photometric and geometric changes. Considering the popular SURF descriptor, it analyzes its state-of-the-art color versions, and proposes a new extension by using local histogram equalization (LHE). While most existing descriptors stem from color conversions and apply to standard lighting variations acquired by the same device, the proposed feature is device-independent and could fit to very generic changes.

The experimental results show that the proposed color descriptors outperform the existing ones under some types of distortions, and are more precise and invariant to different color variations. The paper considers Projector-based Augmented Reality (PAR) as an application field, where one of the evaluation criteria is homography accuracy between real and estimated distorted images. The results show that the proposed method gives the most stable results over all the other techniques and therefore they justify its use for robust color feature matching and its application to geometric correction.

References

  1. M. Bajura and U. Neumann. Dynamic registration correction in video-based augmented reality systems. IEEE Comp. Graph. and Appli., 15:52--60, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool. Speeded-up robust features (surf). Comput. Vis. Image Underst., 110(3):346--359, June 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. O. Bimber and R. Raskar. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, USA, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. J. Dehos, E. Zeghers, C. Renaud, F. Rousselle, and L. Sarry. Radiometric compensation for a low-cost immersive projection system. In Proc. of ACM symposium on Virtual reality softw. and techno., VRST '08, pages 130--133, New York, NY, USA, 2008. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. G. D. Finlayson, S. D. Hordley, G. Schaefer, and G. Y. Tian. Illuminant and device invariant colour using histogram equalisation. Pattern Recognition, 38:179--190, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  6. M. A. Fischler and R. C. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24(6):381--395, 1981. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. T. Gevers and A. W. M. Smeulders. Colour based object recognition. Pattern Recognition, 32(3):453--464, March 1999.Google ScholarGoogle ScholarCross RefCross Ref
  8. M. Grossberg and S. Nayar. What is the Space of Camera Response Functions? In IEEE CVPR, volume II, pages 602--609, Jun 2003.Google ScholarGoogle ScholarCross RefCross Ref
  9. D. G. Lowe. Object recognition from local scale-invariant features. In ICCV, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. D. G. Lowe. Distinctive image features from scale-invariant keypoints. Int. Jour. Comput. Vision, 60(2):91--110, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. O. G. Luo Juan. A comparison of sift, pca-sift and surf. Inter. Jour. of Im. Proc. (IJIP), 3:143--152, 2009.Google ScholarGoogle Scholar
  12. K. Mikolajczyk and C. Schmid. An affine invariant interest point detector. In 7th ECCV, pages 128--142. Springer, 2002. Copenhagen. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. K. Mikolajczyk and C. Schmid. Scale and affine invariant interest point detectors. Int. Jour. of Comp. Vision, 60(1):63--86, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. K. Mikolajczyk and C. Schmid. A performance evaluation of local descriptors. IEEE Trans. on PAMI, 27(10):1615--1630, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. S. Nayar, H. Peri, M. Grossberg, and P. Belhumeur. A Projection System with Radiometric Compensation for Screen Imperfections. In ICCV Workshop PROCAMS, Oct 2003.Google ScholarGoogle Scholar
  16. H. Park, M.-H. Lee, B.-K. Seo, and J.-I. Park. Undistorted projection onto dynamic surface. In Proc. PSIVT'06, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. H. Park, M.-H. Lee, B.-K. Seo, J.-I. Park, M.-S. Jeong, T.-S. Park, Y. Lee, and S.-R. Kim. Simultaneous geometric and radiometric adaptation to dynamic surfaces with a mobile projector-camera system. IEEE Trans. Cir. and Sys. for Video Technol., 18(1):110--115, Jan. 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. S. A. Shafer. Color. chapter Using color to separate reflection components, pages 43--51. Jones and Bartlett Publishers, Inc., USA, 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. K. E. A. van de Sande, T. Gevers, and C. G. M. Snoek. Evaluating color descriptors for object and scene recognition. IEEE Trans. on PAMI, 32(9):1582--1596, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. A. Verma, S. Banerji, and C. Liu. A new color SIFT descriptor and methods for image category classification. In Int. Cong. on Comp. Appli. and Comput. Sci., pages 819--822, 2010.Google ScholarGoogle Scholar
  21. S. Zollmann, T. Langlotz, and O. Bimber. Passive-active geometric calibration for view-dependent projections onto arbitrary surfaces.Google ScholarGoogle Scholar

Index Terms

  1. Color invariant feature matching for image geometric correction

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Other conferences
                MIRAGE '13: Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
                June 2013
                137 pages
                ISBN:9781450320238
                DOI:10.1145/2466715

                Copyright © 2013 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 6 June 2013

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader