skip to main content
10.1145/2510650.2510660acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

On improving the robustness of variational optical flow against illumination changes

Published: 21 October 2013 Publication History

Abstract

The brightness constancy assumption is the base of estimating the flow fields in most differential optical flow approaches. However, the brightness constancy constraint easily violates with any variation in the lighting conditions in the scene. Thus, this work proposes a robust data term against illumination changes based on a rich descriptor. This descriptor extracts the textures features for each image in the two consecutive images using local edge responses. In addition, a weighted non-local term depending on the intensity similarity, the spatial distance and the occlusion state of pixels is integrated within the adapted duality total variational optical flow algorithm in order to obtain accurate flow fields. The proposed model yields state-of-the-art results on the the KITTI optical flow database and benchmark.

References

[1]
T. Brox, A. Bruhn, N. Papenberg, and J. Weickert. High accuracy optical flow estimation based on a theory for warping. In T. Pajdla and J. Matas, editors, ECCV, volume 3024 of Lecture Notes in Computer Science, pages 25--36. Springer, 2004.
[2]
A. Bruhn and J. Weickert. Towards ultimate motion estimation: Combining highest accuracy with real-time performance. In ICCV, pages 749--755. IEEE Computer Society, 2005.
[3]
B. K. P. Horn and B. G. Schunck. Determining optical flow. Artifical Intelligence, 17(1--3):185--203, 1981.
[4]
T. Jabid, M. Kabir, and O. Chae. Local directional pattern (ldp) for face recognition. In Consumer Electronics (ICCE), 2010 Digest of Technical Papers International Conference on, pages 329--330. IEEE Computer Society, 2010.
[5]
Y.-H. Kim, A. M. Martínez, and A. C. Kak. Robust motion estimation under varying illumination. Image Vision Comput., 23(4):365--375, 2005.
[6]
Y. Mileva, A. Bruhn, and J. Weickert. Illumination-robust variational optical flow with photometric invariants. In F. A. Hamprecht, C. Schnörr, and B. Jähne, editors, DAGM-Symposium, volume 4713 of Lecture Notes in Computer Science, pages 152--162. Springer, 2007.
[7]
J. Molnar, D. Chetverikov, and S. Fazekas. Illumination-robust variational optical flow using cross-correlation. Computer Vision and Image Understanding, 114(10):1104--1114, 2010.
[8]
T. Mueller, C. Rabe, J. Rannacher, U. Franke, and R. Mester. Illumination-robust dense optical flow using census signatures. In R. Mester and M. Felsberg, editors, DAGM-Symposium, volume 6835 of Lecture Notes in Computer Science, pages 236--245. Springer, 2011.
[9]
T. Pock, M. Urschler, C. Zach, R. Beichel, and H. Bischof. A duality based algorithm for tv- l1-optical-flow image registration. In MICCAI, volume 4792 of Lecture Notes in Computer Science, pages 511--518. Springer, 2007.
[10]
A. Ramirez Rivera, J. Rojas Castillo, and O. Chae. Local directional number pattern for face analysis: Face and expression recognition. IEEE Trans Image Process, 2012.
[11]
P. Sand and S. J. Teller. Particle video: Long-range motion estimation using point trajectories. International Journal of Computer Vision, 80(1):72--91, 2008.
[12]
D. Sun, S. Roth, and M. J. Black. Secrets of optical flow estimation and their principles. In CVPR, pages 2432--2439. IEEE, 2010.
[13]
M. Werlberger, T. Pock, and H. Bischof. Motion estimation with non-local total variation regularization. In CVPR, pages 2464--2471. IEEE, 2010.
[14]
C. Zach, T. Pock, and H. Bischof. A duality based approach for realtime tv- l1 optical flow. In DAGM, pages 214--223, 2007.
[15]
H. Zimmer, A. Bruhn, and J. Weickert. Optic flow in harmony. International Journal of Computer Vision, 93(3):368--388, 2011.

Cited By

View all
  • (2023)PcCLCg is involved in the accumulation of Cl− in shoots for osmotic adjustment and salinity resistance in the Cl−-tolerant xerophyte Pugionium cornutumPlant and Soil10.1007/s11104-023-05926-7487:1-2(283-298)Online publication date: 13-Feb-2023
  • (2022)SLAH1 is involved in the long-distance transport of Cl− from roots into shoots in the Cl−-tolerant xerophyte Pugionium cornutum under salt stressPlant and Soil10.1007/s11104-022-05551-w479:1-2(631-648)Online publication date: 20-Jun-2022
  • (2019)Robust Optical Flow Estimation Using the Monocular Epipolar GeometryComputer Vision Systems10.1007/978-3-030-34995-0_47(521-530)Online publication date: 23-Nov-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ARTEMIS '13: Proceedings of the 4th ACM/IEEE international workshop on Analysis and retrieval of tracked events and motion in imagery stream
October 2013
94 pages
ISBN:9781450323932
DOI:10.1145/2510650
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. illumination changes
  2. large displacement
  3. motion estimation
  4. optical flow
  5. total variational

Qualifiers

  • Research-article

Conference

MM '13
Sponsor:
MM '13: ACM Multimedia Conference
October 21, 2013
Barcelona, Spain

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 23 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)PcCLCg is involved in the accumulation of Cl− in shoots for osmotic adjustment and salinity resistance in the Cl−-tolerant xerophyte Pugionium cornutumPlant and Soil10.1007/s11104-023-05926-7487:1-2(283-298)Online publication date: 13-Feb-2023
  • (2022)SLAH1 is involved in the long-distance transport of Cl− from roots into shoots in the Cl−-tolerant xerophyte Pugionium cornutum under salt stressPlant and Soil10.1007/s11104-022-05551-w479:1-2(631-648)Online publication date: 20-Jun-2022
  • (2019)Robust Optical Flow Estimation Using the Monocular Epipolar GeometryComputer Vision Systems10.1007/978-3-030-34995-0_47(521-530)Online publication date: 23-Nov-2019
  • (2017)Monocular Epipolar Constraint for Optical Flow EstimationComputer Vision Systems10.1007/978-3-319-68345-4_6(62-71)Online publication date: 11-Oct-2017
  • (2015)Differential Optical Flow Estimation Under Monocular Epipolar Line ConstraintProceedings of the 10th International Conference on Computer Vision Systems - Volume 916310.1007/978-3-319-20904-3_32(354-363)Online publication date: 6-Jul-2015
  • (2014)Illumination-Robust Optical Flow Using a Local Directional PatternIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2014.230862824:9(1499-1508)Online publication date: Sep-2014
  • (2014)Real-time moving objects tracking for mobile-robots using motion information2014 IEEE International Symposium on Safety, Security, and Rescue Robotics (2014)10.1109/SSRR.2014.7017674(1-6)Online publication date: Oct-2014

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media