Abstract
This brief tutorial paper on Shape from Motion (SfM), the profound 3D object modeling method, focuses on mathematical background for the batch scenario. Error bounds for pixels with respect to depth change are derived to analyze the applicability of orthographic projection versus perspective projection. Key geometric properties, used for SfM algorithms design and analysis, are stated and proved. Moreover, the case of measurement matrix with rank two, for non planar shapes is fully characterized and its role in shape ambiguity explored. Other sources of SfM ambiguity are presented what justifies the definition of ambiguous error function used for nonlinear optimization of rotation coefficients. Experiments refer to head pose identification and 3D face animation and show the good visual accuracy of SfM approach for digital 3D face projects.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tomasi, C., Kanade, T.: Shape and Motion from Image Streams under Orthography. International Journal of Computer Vision (IJCV) 9, 137–154 (1992)
Akhter, I., Sheikh, Y., Khan, S., Kanade, T.: Trajectory Space: A Dual Representation for Nonrigid Structure from Motion. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(7), 1442–1456 (2011)
Bregler, C., Hertzmann, A., Biermann, H.: Recovering non-rigid 3D shape from image streams. In: IEEE Conf. on Computer Vision and Pattern Recognition, Hilton Head, North Carolina (CVPR), vol. 2, pp. 690–696 (2000)
Xiao, J., Chai, J., Kanade, T.: A closed form solution to non-rigid shape and motion recovery. International Journal of Computer Vision (IJCV) 67, 233–246 (2006)
Hartley, R.I., Vidal, R.: Perspective Nonrigid Shape and Motion Recovery. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 276–289. Springer, Heidelberg (2008)
Xiao, J., Moriyama, T., Kanade, T., Cohn, J.F.: Robust Full-Motion Recovery of Head by Dynamic Templates and Re-registration Techniques. International Journal of Imaging Systems and Technology 13(1), 85–94 (2003)
Jang, J.S., Kanade, T.: Robust 3D Head Tracking by Online Feature Registration. In: The IEEE International Conference on Automatic Face and Gesture Recognition (2008)
Yan, J., Lei, Z., Yi, D., Li, S.Z.: Learn to Combine Multiple Hypotheses for Accurate Face Alignment. In: IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 392–396 (2013)
Ryan, K., Balzano, L., Wright, S.J., Taylor, C.J.: Online Algorithms for Factorization-Based Structure from Motion. In: IEEE Winter Conference on Applications of Computer Vision (WACV) (2014)
Tzimiropoulos, G., Alabort-i-Medina, J., Zafeiriou, S., Pantic, M.: Generic Active Appearance Models Revisited. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part III. LNCS, vol. 7726, pp. 650–663. Springer, Heidelberg (2013)
Kowalski, M., Naruniec, J.: Evaluation of active appearance models in varying background conditions (Conference Proceedings). In: Photonics Applications in Astronomy, Communications, Industry, and High-Energy Physics Experiments (2013)
Cootes, T., Edwards, G., Taylor, C.: Active Appearance Models. IEEE Transactions on Pattern Analysis and Machine Intelligence (1998)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge (2004)
Ma, Y., Soatto, S., Kosecka, J., Sastry, S.: An Invitation to 3D Vision: From Images to Geometric Models. Springer (2003)
Mahamud, S., Hebert, M., Omori, Y., Ponce, J.: Provably-convergent iterative methods for projective structure from motion. In: Conference on Computer Vision and Pattern Recognition, vol. I, pp. 1018–1025 (2001)
Aanaes, H., Kahl, F.: Estimation of deformable structure and motion. In: ECCV Workshop on Vision and Modelling of Dynamic Scenes (2002)
Torresani, L., Bregler, C.: Space-time tracking. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part I. LNCS, vol. 2350, pp. 801–812. Springer, Heidelberg (2002)
Xiao, J., Kanade, T.: Non-rigid shape and motion recovery: Degenerate deformations. In: Conference on Computer Vision and Pattern Recognition, pp. 668–675 (2004)
Hartley, R.I., Schaffalitzky, F.: Reconstruction from projections using Grassmann tensors. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3021, pp. 363–375. Springer, Heidelberg (2004)
Xiao, J., Kanade, T.: Uncalibrated perspective reconstruction of deformable structures. In: IEEE International Conference on Computer Vision, pp. 1075–1082 (2005)
Vidal, R., Abretske, D.: Nonrigid shape and motion from multiple perspective views. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 205–218. Springer, Heidelberg (2006)
Oliensis, J., Hartley, R.: Iterative extensions of the Sturm/Triggs algorithm: convergence and nonconvergence. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Skarbek, W. (2014). Shape from Motion Revisited. In: Ślȩzak, D., Schaefer, G., Vuong, S.T., Kim, YS. (eds) Active Media Technology. AMT 2014. Lecture Notes in Computer Science, vol 8610. Springer, Cham. https://doi.org/10.1007/978-3-319-09912-5_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-09912-5_32
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09911-8
Online ISBN: 978-3-319-09912-5
eBook Packages: Computer ScienceComputer Science (R0)