Abstract
This paper presents a method for accurately determining the pose of Lambertian rigid objects present in an image. An initial pose estimate computed with the aid of local point features is ameliorated by considering all visible object texture. This is achieved by combining a textured mesh model of the object with a graphics renderer to synthesize an image of the object as would be captured by the camera at a particular pose. A rendered image is compared against the acquired one with the aid of a visual dissimilarity score involving cross-correlation. Population-based stochastic optimization is used to efficiently search the pose space and minimize the dissimilarity between rendered images corresponding to candidate poses and the acquired image. The method is demonstrated with the aid of real and synthetic images.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Angeline, P.: Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences. In: Porto, V.W., Waagen, D. (eds.) EP 1998. LNCS, vol. 1447, pp. 601–610. Springer, Heidelberg (1998)
Brox, T., Rosenhahn, B., Cremers, D., Seidel, H.-P.: High accuracy optical flow serves 3-D pose tracking: Exploiting contour and flow based constraints. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 98–111. Springer, Heidelberg (2006)
Brox, T., Rosenhahn, B., Gall, J., Cremers, D.: Combined Region and Motion-Based 3D Tracking of Rigid and Articulated Objects. PAMI 32(3), 402–415 (2010)
Eberhart, R., Shi, Y., Kennedy, J.: Swarm Intelligence. Morgan Kaufmann (2001)
Fischler, M., Bolles, R.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. CACM 24, 381–395 (1981)
Gall, J., Rosenhahn, B., Seidel, H.P.: Robust Pose Estimation with 3D Textured Models. In: Chang, L.-W., Lie, W.-N. (eds.) PSIVT 2006. LNCS, vol. 4319, pp. 84–95. Springer, Heidelberg (2006)
Gall, J., Rosenhahn, B., Seidel, H.P.: Drift-Free Tracking of Rigid and Articulated Objects. In: Proc. of CVPR 2008, pp. 1–8 (2008)
Gordon, I., Lowe, D.G.: What and Where: 3D Object Recognition with Accurate Pose. In: Ponce, J., Hebert, M., Schmid, C., Zisserman, A. (eds.) Toward Category-Level Object Recognition. LNCS, vol. 4170, pp. 67–82. Springer, Heidelberg (2006)
Ivekovič, S., Trucco, E., Petillot, Y.: Human Body Pose Estimation with Particle Swarm Optimisation. Evolutionary Computation 16(4), 509–528 (2008)
Lepetit, V., Fua, P.: Monocular Model-Based 3D Tracking of Rigid Objects. Found. Trends. Comput. Graph. Vis. 1(1), 1–89 (2005)
Lourakis, M., Zabulis, X.: Accurate Scale Factor Estimation in 3D Reconstruction. In: Wilson, R., Hancock, E., Bors, A., Smith, W. (eds.) CAIP 2013, Part I. LNCS, vol. 8047, pp. 498–506. Springer, Heidelberg (2013)
Lourakis, M., Zabulis, X.: Model-Based Pose Estimation for Rigid Objects. In: Chen, M., Leibe, B., Neumann, B. (eds.) ICVS 2013. LNCS, vol. 7963, pp. 83–92. Springer, Heidelberg (2013)
Lowe, D.: Three-Dimensional Object Recognition from Single Two-Dimensional Images. Artificial Intelligence 31(3), 355–395 (1987)
Lowe, D.: Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Özuysal, M., Lepetit, V., Fleuret, F., Fua, P.: Feature Harvesting for Tracking-by-Detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 592–605. Springer, Heidelberg (2006)
Padeleris, P., Zabulis, X., Argyros, A.: Head Pose Estimation on Depth Data Based on Particle Swarm Optimization. In: CVPR Workshops, pp. 42–49 (2012)
Prisacariu, V., Reid, I.: PWP3D: Real-Time Segmentation and Tracking of 3D Objects. Int. J. Comput. Vis., 1–20 (2012)
Romea, A., Berenson, D., Srinivasa, S., Ferguson, D.: Object recognition and full pose registration from a single image for robotic manipulation. In: ICRA (2009)
Rothganger, F., Lazebnik, S., Schmid, C., Ponce, J.: 3D Object Modeling and Recognition Using Local Affine-Invariant Image Descriptors and Multi-View Spatial Constraints. Int. J. Comput. Vis. 66(3), 231–259 (2006)
Schmaltz, C., Rosenhahn, B., Brox, T., Weickert, J.: Region-Based Pose Tracking with Occlusions Using 3D Models. Mach. Vision Appl. 23(3), 557–577 (2012)
Snavely, N., Seitz, S., Szeliski, R.: Photo Tourism: Exploring Photo Collections in 3D. ACM Trans. Graph. 25(3), 835–846 (2006)
Vacchetti, L., Lepetit, V., Fua, P.: Stable Real-Time 3D Tracking Using Online and Offline Information. PAMI 26(10), 1385–1391 (2004)
Vergauwen, M., Gool, L.V.: Web-based 3D Reconstruction Service. Mach. Vision Appl. 17(6), 411–426 (2006)
Zhang, X., Hu, W., Maybank, S., Li, X., Zhu, M.: Sequential Particle Swarm Optimization for Visual Tracking. In: CVPR, pp. 1–8 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Zabulis, X., Lourakis, M.I.A., Stefanou, S.S. (2014). 3D Pose Refinement Using Rendering and Texture-Based Matching. In: Chmielewski, L.J., Kozera, R., Shin, BS., Wojciechowski, K. (eds) Computer Vision and Graphics. ICCVG 2014. Lecture Notes in Computer Science, vol 8671. Springer, Cham. https://doi.org/10.1007/978-3-319-11331-9_80
Download citation
DOI: https://doi.org/10.1007/978-3-319-11331-9_80
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11330-2
Online ISBN: 978-3-319-11331-9
eBook Packages: Computer ScienceComputer Science (R0)