Skip to main content
SpringerLink
Log in

Photo Sequencing

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

A group of people taking pictures of a dynamic event with their mobile phones is a popular sight. The set of still images obtained this way is rich in dynamic content but lacks accurate temporal information. We propose a method for photo-sequencing—temporally ordering a set of still images taken asynchronously by a set of uncalibrated cameras. Photo-sequencing is an essential tool in analyzing (or visualizing) a dynamic scene captured by still images. The first step of the method detects sets of corresponding static and dynamic feature points across images. The static features are used to determine the epipolar geometry between pairs of images, and each dynamic feature votes for the temporal order of the images in which it appears. The partial orders provided by the dynamic features are not necessarily consistent, and we use rank aggregation to combine them into a globally consistent temporal order of images. We demonstrate successful photo-sequencing on several challenging collections of images taken using a number of mobile phones.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  • Avidan, S., & Shashua, A. (2000). Trajectory triangulation: 3d reconstruction of moving points from a monocular image sequence. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(4), 348–357.

    Article  Google Scholar 

  • Ballan, L., Brostow, G. J., Puwein, J., & Pollefeys, M. (2010). Unstructured video-based rendering: Interactive exploration of casually captured videos. ACM Transactions on Graphics (TOG), 29(4), 115–122.

    Article  Google Scholar 

  • Bartoli, A., Gay-Bellile, V., Castellani, U., Peyras, J., Olsen, S., and Sayd, P. (2008). Coarse-to-fine low-rank structure-from-motion. In Proceeding IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

  • Caspi, Y., & Irani, M. (2002). Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(11), 1409–1424.

    Article  Google Scholar 

  • Dekel (Basha), T., Moses, Y., and Avidan, S. (2012). Photo sequencing. In Proceeding European Conference of Computer Vision (ECCV).

  • Dexter, E., Pe’rez, P., and Laptev, I. (2009). Multi-view synchronization of human actions and dynamic scenes. In Proceeding British Machine Vision Conference (BMVC).

  • Dwork, C., Kumar, R., Naor, M., and Sivakumar, D. (2001). Rank aggregation methods for the web. In International Conference on World Wide Web.

  • Elena, R. M. and Straccia, U. (2003). Web metasearch: rank vs. score based rank aggregation methods. In Proceedings of the 2003 ACM Symposium on Applied, Computing.

  • Goshen, L. and Shimshoni, I. (2006). Balanced exploration and exploitation model search for efficient epipolar geometry estimation. In Proceeding European Conference of Computer Vision (ECCV).

  • HaCohen, Y., Shechtman, E., & Goldman, D. B., Lischinski. D. (2011). Non-rigid dense correspondence with applications for image enhancement. ACM Transactions on Graphics (SIGGRAPH).

  • Jegou, H., Schmid, C., Harzallah, H., & Verbeek, J. (2010). Accurate image search using the contextual dissimilarity measure. IEEE Transactions on: Pattern Analysis and Machine Intelligence, 32(1), 2–11.

    Google Scholar 

  • Kaminski, J. Y., & Teicher, M. (2004). A general framework for trajectory triangulation. Journal of Mathematical Imaging and Vision, 21(1), 27–41.

    Article  MathSciNet  Google Scholar 

  • Lei, C., & Yang, Y. (2006). Tri-focal tensor-based multiple video synchronization with subframe optimization. IEEE Transactions on Image Processing, 15(9), 2473–2480.

    Article  Google Scholar 

  • Llado, X., Del Bue, A., and Agapito, L. (2005). Non-rigid 3d factorization for projective reconstruction. In Proceeding British Machine Vision Conference (BMVC).

  • Meyer, B., Stich, T., Magnor, M., and Pollefeys, M. (2008). Subframe temporal alignment of non-stationary cameras. In Proceeding British Machine Vision Conference (BMVC), pages 103–112.

  • Pádua, F. L. C., Carceroni, R. L., Santos, G. A. M. R., & Kutulakos, K. N. (2010). Linear sequence-to-sequence alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(2), 304–320.

    Article  Google Scholar 

  • Park, H., Shiratori, T., Matthews, I., and Sheikh, Y. (2010). 3d reconstruction of a moving point from a series of 2d projections. In Proceeding European Conference of Computer Vision (ECCV).

  • Pedronette, D.C.G., and Torres, R.S. (2011). Exploiting contextual information for rank aggregation. In Image Processing (ICIP), 2011 18th IEEE International Conference on.

  • Pundik, D. and Moses, Y. (2010). Video synchronization using temporal signals from epipolar lines. In Proceeding European Conference of Computer Vision (ECCV).

  • Sand, P., & Teller, S. (2004). Video matching. In ACM Transactions on Graphics (TOG), 23(3), 592–599.

    Article  Google Scholar 

  • Schalekamp, F. and van Zuylen, A. (2009). Rank aggregation: Together were strong.In Proceeding of 11th ALENEX.

  • Schindler, G., and Dellaert, F. (2010). Probabilistic temporal inference on reconstructed 3d scenes. In Proceeding IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1410–1417. IEEE.

  • Shashua, A. and Wolf, L. (2000). Homography tensors: On algebraic entities that represent three views of static or moving planar points. In Proceeding European Conference of Computer Vision (ECCV).

  • Shili, L. (2010). Rank aggregation methods. Wiley Interdisciplinary Reviews: Computational Statistics.

  • Snavely, N., Simon, I., Goesele, M., Szeliski, R., & Seitz, S. M. (2010). Scene reconstruction and visualization from community photo collections. IEEE Special Issue on Internet Vision: Proc.

  • Torresani, L., Hertzmann, A., & Bregler, C. (2008). Nonrigid structure-from-motion: Estimating shape and motion with hierarchical priors. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(5), 878–892.

    Google Scholar 

  • Tresadern, P., & Reid, I. (2003). Synchronizing image sequences of non-rigid objects. Proc. British Machine Vision Conference (BMVC), 2, 629–638.

  • Whitehead, A., Laganiere, R., and Bose, P. (2005). Temporal synchronization of video sequences in theory and in practice. In WMVC.

  • Wolf, L., & Zomet, A. (2002). Correspondence-free synchronization and reconstruction in a non-rigid scene. In Proceeding Workshop Vision and Modeling of Dynamic Scenes

  • Yan, J., and Pollefeys, M. (2004). Video synchronization via space-time interest point distribution. In ACIVS.

  • Young, H. P., & Levenglick, A. (1978). A consistent extension of condorcet’s election principle. SIAM Journal on Applied Mathematics, 35(2), 285–300.

    Article  MATH  MathSciNet  Google Scholar 

  • Young, H. P. (1988). Condorcet’s theory of voting. The American Political Science Review, 82, 1231–1244.

    Article  Google Scholar 

  • Zelnik-Manor, L., and Irani, M. (2003). Degeneracies, dependencies and their implications in multi-body and multi-sequence factorizations. In Proceeding IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

Download references

Acknowledgments

This work was supported in part by Israel Science Foundation Grant No. 1556/10 and 930/12, and European Community Grant PIRG05-GA-2009-248527.

Author information

Authors and Affiliations

  1. School of Electrical Engineering, Tel Aviv University, 69978, Tel Aviv, Israel

    Tali Dekel (Basha) & Shai Avidan

  2. Efi Arazi School of Computer Science, The Interdisciplinary Center, 46150,  Herzliya, Israel

    Yael Moses

Authors
  1. Tali Dekel (Basha)
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yael Moses
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shai Avidan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tali Dekel (Basha).

Additional information

Communicated by Carlo Colombo.

An earlier version of part of this work was published in ECCV 2012 Dekel (Basha) et al. (2012).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dekel (Basha), T., Moses, Y. & Avidan, S. Photo Sequencing. Int J Comput Vis 110, 275–289 (2014). https://doi.org/10.1007/s11263-014-0712-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11263-014-0712-x

Keywords

Search

Navigation