Skip to main content

Shape from Motion Revisited

  • Conference paper
Active Media Technology (AMT 2014)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8610))

Included in the following conference series:

Abstract

This brief tutorial paper on Shape from Motion (SfM), the profound 3D object modeling method, focuses on mathematical background for the batch scenario. Error bounds for pixels with respect to depth change are derived to analyze the applicability of orthographic projection versus perspective projection. Key geometric properties, used for SfM algorithms design and analysis, are stated and proved. Moreover, the case of measurement matrix with rank two, for non planar shapes is fully characterized and its role in shape ambiguity explored. Other sources of SfM ambiguity are presented what justifies the definition of ambiguous error function used for nonlinear optimization of rotation coefficients. Experiments refer to head pose identification and 3D face animation and show the good visual accuracy of SfM approach for digital 3D face projects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Tomasi, C., Kanade, T.: Shape and Motion from Image Streams under Orthography. International Journal of Computer Vision (IJCV) 9, 137–154 (1992)

    Article  Google Scholar 

  2. Akhter, I., Sheikh, Y., Khan, S., Kanade, T.: Trajectory Space: A Dual Representation for Nonrigid Structure from Motion. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(7), 1442–1456 (2011)

    Article  Google Scholar 

  3. Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: IEEE Conf. on Computer Vision and Pattern Recognition, Hilton Head, North Carolina (CVPR), vol. 2, pp. 690–696 (2000)

    Google Scholar 

  4. Xiao, J., Chai, J., Kanade, T.: A closed form solution to non-rigid shape and motion recovery. International Journal of Computer Vision (IJCV) 67, 233–246 (2006)

    Article  Google Scholar 

  5. Hartley, R.I., Vidal, R.: Perspective Nonrigid Shape and Motion Recovery. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 276–289. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. Xiao, J., Moriyama, T., Kanade, T., Cohn, J.F.: Robust Full-Motion Recovery of Head by Dynamic Templates and Re-registration Techniques. International Journal of Imaging Systems and Technology 13(1), 85–94 (2003)

    Article  Google Scholar 

  7. Jang, J.S., Kanade, T.: Robust 3D Head Tracking by Online Feature Registration. In: The IEEE International Conference on Automatic Face and Gesture Recognition (2008)

    Google Scholar 

  8. Yan, J., Lei, Z., Yi, D., Li, S.Z.: Learn to Combine Multiple Hypotheses for Accurate Face Alignment. In: IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 392–396 (2013)

    Google Scholar 

  9. Ryan, K., Balzano, L., Wright, S.J., Taylor, C.J.: Online Algorithms for Factorization-Based Structure from Motion. In: IEEE Winter Conference on Applications of Computer Vision (WACV) (2014)

    Google Scholar 

  10. Tzimiropoulos, G., Alabort-i-Medina, J., Zafeiriou, S., Pantic, M.: Generic Active Appearance Models Revisited. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part III. LNCS, vol. 7726, pp. 650–663. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  11. Kowalski, M., Naruniec, J.: Evaluation of active appearance models in varying background conditions (Conference Proceedings). In: Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments (2013)

    Google Scholar 

  12. Cootes, T., Edwards, G., Taylor, C.: Active Appearance Models. IEEE Transactions on Pattern Analysis and Machine Intelligence (1998)

    Google Scholar 

  13. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge (2004)

    Google Scholar 

  14. Ma, Y., Soatto, S., Kosecka, J., Sastry, S.: An Invitation to 3D Vision: From Images to Geometric Models. Springer (2003)

    Google Scholar 

  15. Mahamud, S., Hebert, M., Omori, Y., Ponce, J.: Provably-convergent iterative methods for projective structure from motion. In: Conference on Computer Vision and Pattern Recognition, vol. I, pp. 1018–1025 (2001)

    Google Scholar 

  16. Aanaes, H., Kahl, F.: Estimation of deformable structure and motion. In: ECCV Workshop on Vision and Modelling of Dynamic Scenes (2002)

    Google Scholar 

  17. Torresani, L., Bregler, C.: Space-time tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part I. LNCS, vol. 2350, pp. 801–812. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  18. Xiao, J., Kanade, T.: Non-rigid shape and motion recovery: Degenerate deformations. In: Conference on Computer Vision and Pattern Recognition, pp. 668–675 (2004)

    Google Scholar 

  19. Hartley, R.I., Schaffalitzky, F.: Reconstruction from projections using Grassmann tensors. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 363–375. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  20. Xiao, J., Kanade, T.: Uncalibrated perspective reconstruction of deformable structures. In: IEEE International Conference on Computer Vision, pp. 1075–1082 (2005)

    Google Scholar 

  21. Vidal, R., Abretske, D.: Nonrigid shape and motion from multiple perspective views. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 205–218. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  22. Oliensis, J., Hartley, R.: Iterative extensions of the Sturm/Triggs algorithm: convergence and nonconvergence. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Skarbek, W. (2014). Shape from Motion Revisited. In: Ślȩzak, D., Schaefer, G., Vuong, S.T., Kim, YS. (eds) Active Media Technology. AMT 2014. Lecture Notes in Computer Science, vol 8610. Springer, Cham. https://doi.org/10.1007/978-3-319-09912-5_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-09912-5_32

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-09911-8

  • Online ISBN: 978-3-319-09912-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics