Skip to main content
SpringerLink
Log in

Pose normalization of 3D models via reflective symmetry on panoramic views

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

A novel pose normalization method, based on reflective symmetry computed on panoramic views, is presented. Qualitative and experimental investigation in 3D data-sets has led us to the observation that most objects possess a single plane of symmetry. Our approach is thus guided by this observation. Initially, through an iterative procedure, the symmetry plane of a 3D model is estimated, thus computing the first axis of the model. This is achieved by rotating the 3D model and computing reflective symmetry scores on panoramic view images. The other principal axes of the 3D model are estimated by computing the variance of the 3D model’s panoramic views. The proposed method is incorporated in a hybrid scheme, that serves as the pose normalization method in a state-of-the-art 3D object retrieval system. The effectiveness of this system, using the hybrid pose normalization scheme, is evaluated in terms of retrieval accuracy and the results clearly show improved performance against current approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Alizadeh, F., Sutherland, A.: 3D model retrieval using the 2D poisson equation. In: Lambert, P. (ed.) CBMI, pp. 1–6. IEEE (2012). doi:10.1109/CBMI.2012.6269797

  2. Axenopoulos, A., Litos, G., Daras, P.: 3D model retrieval using accurate pose estimation and view-based similarity. In: Natale, F.G.B.D., Bimbo, A.D., Hanjalic, A., Manjunath, B.S., Satoh, S. (eds.) ICMR, p. 41. ACM (2011). doi:10.1145/1991996.1992037

  3. Chaouch, M., Verroust-Blondet, A.: 3D model retrieval based on depth line descriptor. In: ICME, pp. 599–602. IEEE (2007). doi:10.1109/ICME.2007.4284721

  4. Chaouch, M., Verroust-Blondet, A.: Alignment of 3D models. Graph. Models 71(2), 63–76 (2009). doi:10.1016/j.gmod.2008.12.006

    Google Scholar 

  5. yun Chen, D., Ouhyoung, M.: A 3D model alignment and retrieval system. In: Proceedings of International Computer Symposium, Workshop on Multimedia Technologies (dec 2002, pp. 1436–1443 (2002)

  6. Chen, D.Y., Tian, X.P., Shen, Y.T., Ouhyoung, M.: On visual similarity based 3D model retrieval. Comput. Graph. Forum 22(3), 223–232 (2003). doi:10.1111/1467-8659.00669

    Article  Google Scholar 

  7. Elad, M., Tal, A., Ar, S.: Content based retrieval of VRML objects: an iterative and interactive approach. In: Proceedings of the 6th Eurographics workshop on Multimedia 2001, pp. 107–118. Springer, New York (2002)

  8. Fang, R., Godil, A., Li, X., Wagan, A.: A new shape benchmark for 3D object retrieval. In: Bebis, G., Boyle, R.D., Parvin, B., Koracin, D., Remagnino, P., Porikli, F.M., Peters, J., Klosowski, J.T., Arns, L.L., Chun, Y.K., Rhyne, T.M., Monroe, L. (eds.) ISVC (1), Lecture Notes in Computer Science, vol. 5358, pp. 381–392. Springer, Berlin (2008). doi:10.1007/978-3-540-89639-5_37

  9. Furuya, T., Ohbuchi, R.: Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features. In: Marchand-Maillet, S., Kompatsiaris, Y. (eds.) CIVR. ACM (2009). doi:10.1145/1646396.1646430

  10. Geurts, P., Ernst, D., Wehenkel, L.: Extremely randomized trees. Mach. Learn. 63(1), 3–42 (2006). doi:10.1007/s10994-006-6226-1

    Google Scholar 

  11. Gorelick, L., Galun, M., Sharon, E., Basri, R., Brandt, A.: Shape representation and classification using the poisson equation. Pattern Anal. Mach. Intell. IEEE Trans. 28(12), 1991–2005 (2006). doi:10.1109/TPAMI.2006.253

    Article  Google Scholar 

  12. Jayanti, S., Kalyanaraman, Y., Iyer, N., Ramani, K.: Developing an engineering shape benchmark for CAD models. Comput. Aided Des. 38(9), 939–953 (2006). doi:10.1016/j.cad.2006.06.007

    Article  Google Scholar 

  13. Kazhdan, M.M.: An approximate and efficient method for optimal rotation alignment of 3D models. IEEE Trans. Pattern Anal. Mach. Intell. 29(7), 1221–1229 (2007). doi:10.1109/TPAMI.2007.1032

    Article  MathSciNet  Google Scholar 

  14. Kazhdan, M.M., Chazelle, B., Dobkin, D.P., Finkelstein, A., Funkhouser, T.A.: A reflective symmetry descriptor. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV (2), Lecture Notes in Computer Science, vol. 2351, pp. 642–656. Springer, Berlin (2002). doi:10.1007/3-540-47967-8_43

  15. Kazhdan, M.M., Funkhouser, T.A., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3D shape descriptors. In: Kobbelt, L., Schröder, P., Hoppe, H. (eds.) Symposium on Geometry Processing, ACM International Conference Proceeding Series, vol. 43, pp. 156–164. Eurographics Association (2003)

  16. Kazhdan, M.M., Funkhouser, T.A., Rusinkiewicz, S.: Symmetry descriptors and 3D shape matching. In: Boissonnat, J.D., Alliez, P. (eds.) Symposium on Geometry Processing, ACM International Conference Proceeding Series, vol. 71, pp. 115–123. Eurographics Association (2004). doi:10.1145/1057432.1057448

  17. Kim, D.H., Park, I.K., Yun, I.D., Lee, S.U.: A new MPEG-7 standard: Perceptual 3D shape descriptor. In: Aizawa, K., Nakamura, Y., Satoh, S. (eds.) PCM (2), Lecture Notes in Computer Science, vol. 3332, pp. 238–245. Springer, Berlin (2004)

  18. Li, B., Godil, A., Aono, M., Bai, X., Furuya, T., Li, L., López-Sastre, R., Johan, H., Ohbuchi, R., Redondo-Cabrera, C., et al.: Shrec’12 track: generic 3d shape retrieval. In: Proceedings of the 5th Eurographics conference on 3D Object Retrieval, pp. 119–126. Eurographics Association (2012)

  19. Li, B., Johan, H.: 3d model retrieval using hybrid features and class information. Multimed. Tools Appl. 62(3), 821–846 (2013). doi:10.1007/s11042-011-0873-3

    Article  Google Scholar 

  20. Lian, Z., Rosin, P.L., Sun, X.: Rectilinearity of 3D meshes. Int. J. Comput. Vis. 89(2–3), 130–151 (2010). doi:10.1007/s11263-009-0295-0

    Article  Google Scholar 

  21. Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp.1150–1157 (1999). doi:10.1109/ICCV.1999.790410

  22. Lv, D., Sun, J.F., Li, Q., Wang, Q.: 3D pose estimation of ground rigid target based on ladar range image. Appl. Opt. 52(33), 8073–8081 (2013)

    Article  Google Scholar 

  23. Martinet, A., Soler, C., Holzschuch, N., Sillion, F.X.: Accurate detection of symmetries in 3D shapes. ACM Trans. Graph. 25(2), 439–464 (2006). doi:10.1145/1138450.1138462

    Article  Google Scholar 

  24. Mitra, N.J., Guibas, L.J., Pauly, M.: Partial and approximate symmetry detection for 3D geometry. ACM Trans. Graph. 25(3), 560–568 (2006). doi:10.1145/1141911.1141924

    Article  Google Scholar 

  25. Ohbuchi, R., Furuya, T.: Scale-weighted dense bag of visual features for 3D model retrieval from a partial view 3D model. In: Computer Vision Workshops (ICCV Workshops), 2009 IEEE 12th International Conference on, pp. 63–70 (2009). doi:10.1109/ICCVW.2009.5457716

  26. Ohbuchi, R., Osada, K., Furuya, T., Banno, T.: Salient local visual features for shape-based 3D model retrieval. In: Shape Modeling International, pp. 93–102. IEEE (2008). doi:10.1109/SMI.2008.4547955

  27. Osada, R., Funkhouser, T.A., Chazelle, B., Dobkin, D.P.: Shape distributions. ACM Trans. Graph. 21(4), 807–832 (2002). doi:10.1145/571647.571648

    Article  Google Scholar 

  28. Papadakis, P., Pirri, F.: Consistent pose normalization of non-rigid shapes using one-class support vector machines. In: Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on, pp. 23–30 (2011). doi:10.1109/CVPRW.2011.5981714

  29. Papadakis, P., Pratikakis, I., Perantonis, S.J., Theoharis, T.: Efficient 3D shape matching and retrieval using a concrete radialized spherical projection representation. Pattern Recognit. 40(9), 2437–2452 (2007). doi:10.1016/j.patcog.2006.12.026

    Article  MATH  Google Scholar 

  30. Papadakis, P., Pratikakis, I., Theoharis, T., Passalis, G., Perantonis, S.J.: 3D object retrieval using an efficient and compact hybrid shape descriptor. In: Perantonis, S.J., Sapidis, N.S., Spagnuolo, M., Thalmann, D. (eds.) 3DOR, pp. 9–16. Eurographics Association (2008). doi:10.2312/3DOR/3DOR08/009-016

  31. Papadakis, P., Pratikakis, I., Theoharis, T., Perantonis, S.J.: Panorama: a 3d shape descriptor based on panoramic views for unsupervised 3d object retrieval. Int. J. Comput. Vis. 89(2–3), 177–192 (2010). doi:10.1007/s11263-009-0281-6

    Google Scholar 

  32. Paquet, E., Rioux, M., Murching, A.M., Naveen, T., Tabatabai, A.J.: Description of shape information for 2D and 3D objects. Signal Proc. Image Commun. 16(1–2), 103–122 (2000). doi:10.1016/S0923-5965(00)00020-5

    Article  Google Scholar 

  33. Podolak, J., Shilane, P., Golovinskiy, A., Rusinkiewicz, S., Funkhouser, T.A.: A planar-reflective symmetry transform for 3D shapes. ACM Trans. Graph. 25(3), 549–559 (2006). doi:10.1145/1141911.1141923

    Google Scholar 

  34. Rustamov, R.M.: Augmented symmetry transforms. In: Shape Modeling International, pp. 13–20. IEEE Computer Society (2007). doi:10.1109/SMI.2007.6

  35. Sfikas, K., Pratikakis, I., Theoharis, T.: Sympan: 3d model pose normalization via panoramic views and reflective symmetry. In: Castellani, U., Schreck, T., Biasotti, S., Pratikakis, I., Godil, A., Veltkamp, R.C. (eds.) 3DOR, pp. 41–48. Eurographics Association (2013)

  36. Sfikas, K., Theoharis, T., Pratikakis, I.: ROSy+: 3D object pose normalization based on PCA andreflective object symmetry with application in 3D object retrieval. Int. J. Comput. Vis. 91(3), 262–279 (2011). doi:10.1007/s11263-010-0395-x

    Article  Google Scholar 

  37. Shilane, P., Min, P., Kazhdan, M.M., Funkhouser, T.A.: The princeton shape benchmark. In: SMI, pp. 167–178. IEEE Computer Society (2004). doi:10.1109/SMI.2004.63

  38. Tatsuma, A., Aono, M.: Multi-fourier spectra descriptor and augmentation with spectral clustering for 3d shape retrieval. Vis. Comput. 25(8), 785–804 (2009). doi:10.1007/s00371-008-0304-2

    Article  Google Scholar 

  39. Theodoridis, S., Koutroumbas, K.: Pattern recognition. 3rd edn. Academic Press, Inc., Orlando, FL (2006). ISBN 0123695317

  40. Vranic, D.V.: 3D model retrieval. Ph.D. thesis (2004)

  41. Vranic, D.V.: DESIRE: a composite 3D-shape descriptor. In: ICME, pp. 962–965. IEEE (2005). doi:10.1109/ICME.2005.1521584

  42. Vranić, D.V., Saupe, D., Richter, J.: Tools for 3D-object retrieval: Karhunen-loeve transform and spherical harmonics. IEEE MMSP 2001, 293–298 (2001)

    Google Scholar 

  43. Yuan, H., Pang, M., Lu, Z.P.: Pose normalization based on rotation transformation. Key Eng. Mater. 464, 453–456 (2011)

    Article  Google Scholar 

  44. Zaharia, T., Preteux, F.J.: 3D-shape-based retrieval within the MPEG-7 framework. pp. 133–145. SPIE (2001). doi:10.1117/12.424969

  45. Zaharia, T.B., Prêteux, F.J.: 3D versus 2D/3D shape descriptors: a comparative study. In: Dougherty, E.R., Astola, J., Egiazarian, K.O. (eds.) Image Processing: Algorithms and Systems, SPIE Proceedings, vol. 5289, pp. 47–58. SPIE (2004). doi:10.1117/12.533092

  46. Zhang, J., Huebner, K.: Using symmetry as a feature in panoramic images for mobile robot applications In : Proceedings of Robotik 2002, VDI-Berichte, vol. 1679, pp. 263–268. Ludwigsburg (2002). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.72.1017

Download references

Acknowledgments

This research has been co-financed by the European Union (European Social Fund—ESF) and Greek national funds through the Operational Program “Education and Lifelong Learning” of the National Strategic Reference Framework (NSRF)-Research Funding Program: THALES-3DOR (MIS 379516). Investing in knowledge society through the European Social Fund.

Author information

Authors and Affiliations

  1. Computer Graphics Laboratory, Department of Informatics and Telecommunications, University of Athens, Athens, Greece

    Konstantinos Sfikas & Theoharis Theoharis

  2. IDI, NTNU, Trondheim, Norway

    Theoharis Theoharis

  3. Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 , Xanthi, Greece

    Ioannis Pratikakis

Authors
  1. Konstantinos Sfikas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Theoharis Theoharis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ioannis Pratikakis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Konstantinos Sfikas.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sfikas, K., Theoharis, T. & Pratikakis, I. Pose normalization of 3D models via reflective symmetry on panoramic views. Vis Comput 30, 1261–1274 (2014). https://doi.org/10.1007/s00371-014-0935-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-014-0935-4

Keywords

Search

Navigation