Skip to main content
SpringerLink
Log in

Eigenspace compression: dynamic 3D mesh compression by restoring fine geometry to deformed coarse models

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Dynamic 3D mesh compression is of great practical important issues in computer graphics and multimedia applications. In this paper, an efficient compression algorithm is proposed to represent animated mesh sequences in a compact way, so that the storage and transmission of dynamic 3D meshes can be accomplished efficiently. The focus of this paper is on the animated mesh sequences with shared connectivity. The proposed method first computes coarse models (low frequency modes) of the animated sequence using the graph Laplacian matrix. Obtained coordinate weights are used at the decoder to reconstruct the coarse models of the sequence. Then, a novel approach is proposed to extract fixed details (high frequency modes or finer features) of the animated mesh. Finally, a details restoration process is applied at the decoder to add details back to the coarse models of the reconstructed sequence. The superiority of the proposed method to the current state of the arts is demonstrated in terms of low data rates for a given degree of perceived distortion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  1. Ahn J, Kim C, Kuo C, Ho Y (2001) Motion-compensated compression of 3D animation models. Electron Lett 37(24):1445–1446

    Article  Google Scholar 

  2. Alexa M, Muller W (2000) Representing animations by principal components. Computer Graphics Forum 19(3):411–418

    Article  Google Scholar 

  3. Amjoun R (2009) Compression of static and dynamic three-dimensional meshes. PhD thesis, Eberhard Karls University of Tübingen

  4. Amjoun R, Straßer W (2007) Efficient compression of 3-D dynamic mesh sequences. Journal of the WSCG 15(1–3):32–46

    Google Scholar 

  5. Amjoun R, Straßer W (2008) Predictive-DCT coding for 3D mesh sequences compression. J Virtual Real Broadcast 5(6)

  6. Amjoun R, Straßer W (2009) Single-rate near lossless compression of animated geometry. Comput Aided Des 41(10):711–718

    Article  Google Scholar 

  7. Amjoun R, Sondershaus R, Straßer W (2006) Compression of Complex Animated Meshes. In: Nishita T, Peng Q, Seidel HP (eds) Advances in Computer Graphics. Lecture Notes in Computer Science, vol 4035. Springer, Berlin, Heidelberg, p 606–613

  8. Belkin M, Sun J, Wang Y (2008) Discrete laplace operator on meshed surfaces. In: Proceedings of the twenty-fourth annual symposium on Computational geometry pp 278–287

  9. Ben-Chen M, Gotsman C (2005) On the optimality of spectral compression of mesh data. ACM Trans Graph 24(1):60–80

    Article  Google Scholar 

  10. Blender. Open source 3D graphics modeling, animation, creation software: http://www.blender.org

  11. Boulfani-Cuisinaud Y, Antonini M (2007) Motion-based geometry compensation for dwt compression of 3D mesh sequence. In: IEEE International Conference in Image Processing, pp 217–220

  12. Briceno H, Sander P, McMillan L, Gortler S, Hoppe H (2003) Geometry videos: a new representation for 3D animations. In: Proceedings of ACM Symposium on Computer Animation pp 136–146

  13. Dey TK, Ranjan P, Wang Y (2012) Eigen Deformation of 3D Models. Vis Comput 28(6):585–595

    Article  Google Scholar 

  14. Dhibi N, Elkefi A, Bellil W, Amar CB (2017) Multi-layer compression algorithm for 3D deformed mesh based on multi library wavelet neural network architecture. Multimed Tools Appl 76(20):20869–20887. https://doi.org/10.1007/s11042-016-3996-8

    Article  Google Scholar 

  15. Fragkiadaki M, Salas M, Arbelaez P, Malik J (2014) Grouping-based low-rank trajectory completion and 3D reconstruction. Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS 2014) pp 55–63

  16. Guskov I, Khodakovsky A (2004) Wavelet compression of parametrically coherent mesh sequences. In: SCA ‘04: Proceedings of the 2004 ACM SIGGRAPH/ Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, pp 183–192

  17. Hajizadeh MA, Ebrahimnezhad H (2016) Predictive compression of animated 3D models by optimized weighted blending of key-frames. Computer Animation and Virtual Worlds 27(6):556–576

    Article  Google Scholar 

  18. He Y, Lu H, Xie H (2014) Semi- supervised non-negative matrix factorization for image clustering with graph laplacian. Multimed Tools Appl 72(2):1441–1463

    Article  Google Scholar 

  19. Heu J, Kim C, Lee S (2009) SNR and temporal scalable coding of 3-D mesh sequences using singular value decomposition. J Vis Commun Image Represent 20(7):439–449

    Article  Google Scholar 

  20. Hildebrandt K, Polthier K (2011) On approximation of the laplace-beltrami operator and the willmore energy of surfaces. Comput Graphics Forum 30(5):1513–1520

    Article  Google Scholar 

  21. Ibarria L, Rossignac J (2003) Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation pp 126–135

  22. James DL, Twigg CD (2005) Skinning mesh animations. ACM Trans Graph 24(3):399–407

    Article  Google Scholar 

  23. Karni Z, Gotsman C (2000) Spectral compression of mesh geometry. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2000) pp 279–286

  24. Karni Z, Gotsman C (2004) Compression of soft-body animation sequences. Comput Graph 28(1):25–34

    Article  Google Scholar 

  25. Kennedy R, Balzano L, Wright SJ, Taylor CJ (2016) Online algorithms for factorization- based structure from motion. Comput Vis Image Underst 150:139–152

    Article  Google Scholar 

  26. Lengyel JE (1999) Compression of time-dependent geometry. In: Proceedings of the 1999 Symposium on Interactive 3D Graphics pp 89–95

  27. Levy B (2006) Laplace-beltrami eigenfunctions: towards an algorithm that understands geometry. In: IEEE International Conference on Shape Modeling, Invited Talk

  28. Lin Y, Yang L, Lin Z, Lin T, Zha H (2017) Factorization for projective and metric reconstruction via truncated nuclear norm. International Joint Conference on Neural Networks (IJCNN 2017)

  29. Lu M, Zheng B, Takamatsu J, Nishino K, Ikeuchi K (2010) 3D shape restoration via matrix recovery. Asian conference on computer vision (ACCV 2010) pp 306–315

  30. Maglo A, Lavoue G, Dupont F, Hudelot C (2015) 3D mesh compression: survey, comparisons and emerging trends. ACM Comput Surv 47(3):1–40

    Article  Google Scholar 

  31. Alliez P, Gotsman C (2003) Recent advances in compression of 3D meshes. In: Proceedings Symposium on Multiresolution in Geometric Modeling

  32. Mamou K, Zaharia T, Prêteux F (2006) A skinning approach for dynamic 3D mesh compression. Comput Anim Virtual Worlds 17(3–4):337–346

    Article  Google Scholar 

  33. Mamou K, Zaharia T, Prêteux F (2006) Multi-chart geometry video: a compact representation for 3D animations. In: Third International Symposium on 3D Data Processing, Visualization, and Transmission pp 711–718

  34. Mansouri S, Ebrahimnezhad H (2016) Efficient axial symmetry aware mesh approximation with application to 3D pottery models. Multimed Tools Appl 75(14):8347–8379

    Article  Google Scholar 

  35. Marpe D, Schwarz H, Wiegand T (2003) Context-based adaptive binary arithmetic coding in the H. 264/AVC video compression standard. IEEE Trans Circuits Syst Video Technol 13(7):620–636

    Article  Google Scholar 

  36. Muller K, Smolic A, Kautzner M, Eisert P, Wiegand T (2005) Predictive compression of dynamic 3D meshes. In: 2005 I.E. International Conference on Image Processing pp 621–624

  37. Müller K, Smolic A, Kautzner M, Eisert P, Wiegand T (2006) Rate-distortionoptimized predictive compression of dynamic 3D mesh sequences. Signal Process Image Commun 21(9):812–828

    Article  Google Scholar 

  38. Oguz Bici M, Bozdagi AG (2011) Improved prediction methods for scalable predictive animated mesh compression. J Vis Commun Image Represent 22(7):577–589

    Article  Google Scholar 

  39. Payan F, Antonini M (2005) Wavelet-based compression of 3D mesh sequences. In: Proceedings of IEEE ACIDCA-ICMI

  40. Payan F, Antonini M (2007) Temporal wavelet-based compression for 3D animated models. Comput Graph 31(1):77–88

    Article  Google Scholar 

  41. Peng J, Kim CS, Kuo CCJ (2005) Technologies for 3D mesh compression: a survey. J Vis Commun Image Represent 16:688–733

    Article  Google Scholar 

  42. Reuter M, Wolter FE, Peinecke N (2006) Laplace-beltrami spectra as “shape-DNA” of surfaces and solids. Comput Aided Des 38(4):342–366

    Article  Google Scholar 

  43. Rossignac J (1999) Edgebreaker: connectivity compression for triangle meshes. IEEE Trans Vis Comput Graph 5(1):47–61

    Article  MathSciNet  Google Scholar 

  44. Sattler M, Sarlette R, Klein R (2005) Simple and efficient compression of animation sequences. In: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp 209–217

  45. Shi Y, Ding W, Qi N, Yin B (2014) Prediction-based realistic 3D model compression. Multimed Tools Appl 70(3):2125–2137

    Article  Google Scholar 

  46. Stanford 3D Scanning Repository. http://graphics.stanford.edu/data/3Dscanrep/

  47. Stefanoski N, Ostermann J (2006) Connectivity-guided predictive compression of dynamic 3D meshes. In: 2006 I.E. International Conference on Image Processing pp 2973–2976

  48. Stefanoski N, Ostermann J (2008) Spatially and temporally scalable compression of animated 3D meshes with MPEG-4/FAMC. In: Proceedings of the IEEE International Conference on Image Processing pp 2696–2699

  49. Stefanoski N, Ostermann J (2010) SPC: fast and efficient scalable predictive coding of animated meshes. Comput Graphics Forum 29:101–116

    Article  Google Scholar 

  50. Stefanoski N, Liu X, Klie P, Ostermann J (2007) Scalable linear predictive coding of time-consistent 3D mesh sequences. 3DTV-Conference The True Vision – Capture, Transmission and Display of 3D Video pp 1–4

  51. Váša L, Coddyac SV (2007) Connectivity driven dynamic mesh compression. In: 3DTV-Conference The True Vision – Capture, Transmission and Display of 3D Video pp 1–4

  52. Váša L, Skala V (2009) Combined compression and simplification of dynamic 3D meshes. Comput Anim Virtual Worlds 20(4):447–456

    Article  Google Scholar 

  53. Váša L, Skala V (2009) COBRA: compression of the basis for PCA represented animations. Comput Graphics Forum 28:1529–1540

    Article  Google Scholar 

  54. Váša L, Skala V (2010) Geometry-driven local neighbourhood based predictors for dynamic mesh compression. Comput Graphics Forum 29:1921–1933

    Article  Google Scholar 

  55. Váša L, Skala V (2011) A perception correlated comparison method for dynamic meshes. IEEE Trans Vis Comput Graph 17(2):220–230

    Article  Google Scholar 

  56. Váša L, Marras S, Hormann K, Brunnett G (2014) Compressing dynamic meshes with geometric Laplacians. Comput Graphics Forum 33(2):145–154

    Article  Google Scholar 

  57. Vlasic D, Baran I, Matusik W, Popovic J (2008) Articulated mesh animation from multi-view silhouettes. ACM Trans Graph 27(3):1–9

    Article  Google Scholar 

  58. Wang M, Li K, Wu F, Lai U-K, Yang J (2016) 3D motion recovery via low rank matrix analysis. IEEE International Conference on Visual Communications and Image Processing (VCIP 2016)

  59. Wright J, Ganesh A, Rao S, Peng Y, Ma Y (2009) Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. In: Advances in Neural Information Processing Systems 22. MIT Press

  60. Yan Y, Tan M, Tsang I, Yang Y, Zhang C, Shi Q (2015) Scalable maximum margin matrix factorization by active riemannian subspace search. Proceedings of the 24th International Conference on Artificial Intelligence (IJCAI 2015) pp 3988–3994

  61. Yang J, Kim C, Lee S (2002) Compression of 3-D triangle mesh sequences based on vertex-wise motion vector prediction. IEEE Trans Circuits Syst Video Technol 12(12):1178–1184

    Article  Google Scholar 

  62. Zhang J, Owen C (2004) Octree-based animated geometry compression. In: Proceedings of the Data Compression Conference pp 508–517

  63. Zhang J, Owen C (2007) Octree-based animated geometry compression. Comput Graph 31(3):463–479

    Article  Google Scholar 

  64. Zhang H, Kaick O, Dyer R (2010) Spectral mesh processing. Comput Graphics Forum 29(6):1865–1894

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Vision Research Laboratory, Department of Electrical Engineering, Sahand University of Technology, Tabriz, Iran

    Mohammadali Hajizadeh & Hossein Ebrahimnezhad

Authors
  1. Mohammadali Hajizadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hossein Ebrahimnezhad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hossein Ebrahimnezhad.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hajizadeh, M., Ebrahimnezhad, H. Eigenspace compression: dynamic 3D mesh compression by restoring fine geometry to deformed coarse models. Multimed Tools Appl 77, 19347–19375 (2018). https://doi.org/10.1007/s11042-017-5394-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5394-2

Keywords

Search

Navigation