Skip to main content
SpringerLink
Log in

Shape correspondence based on Kendall shape space and RAG for 2D animation

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We introduce a 2D vectorized shape correspondence method based on Kendall shape space and region adjacency graph. We regard shape correspondence in 2D animation as a weighted bipartite graph matching problem and optimize it by means of various weights, including geometric attribute, local topological information, and global topological information in 2D animation drawing. The measuring method in Kendall shape space is introduced to determine similarity between two regions and a local adjacent region matching method is presented to associate the vicinity of the corresponding region by utilizing local topology information. Ultimately, we propose a globally optimal shape matching method, which exploits the global topological information to get the final result of the shape correspondence. Our approach can efficiently match associated regions that have exaggerated deformation and unstable topology between two shapes in 2D animation. It is also robust to the similarity transformation of shapes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Bezerra, H., Feijó, B., Velho, L.: A computer-assisted colorization algorithm based on topological difference. In: 2006 19th Brazilian Symposium on Computer Graphics and Image Processing, pp. 71–77. IEEE (2006)

  2. Cai, J., Lin, F., Lee, Y.T., Qian, K., Seah, H.S.: Modeling and dynamics simulation for deformable objects of orthotropic materials. Vis. Comput. 33(10), 1307–1318 (2017)

    Article  Google Scholar 

  3. Chang, C.W., Lee, S.Y.: Automatic cel painting in computer-assisted cartoon production using similarity recognition. J. Vis. Comput. Animat. 8(3), 165–185 (1997)

    Article  Google Scholar 

  4. Kanamori, Y.: Region matching with proxy ellipses for coloring hand-drawn animations. In: SIGGRAPH Asia 2012 Technical Briefs, p. 4. ACM (2012)

  5. Kanamori, Y.: A comparative study of region matching based on shape descriptors for coloring hand-drawn animation. In: 2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013), pp. 483–488. IEEE (2013)

  6. Kendall, D.G.: Shape manifolds, procrustean metrics, and complex projective spaces. Bull. Lond. Math. Soc. 16(2), 81–121 (1984)

    Article  MathSciNet  Google Scholar 

  7. Lladós, J., Martí, E., Villanueva, J.J.: Symbol recognition by error-tolerant subgraph matching between region adjacency graphs. IEEE Trans. Pattern Anal. Mach. Intell. 23(10), 1137–1143 (2001)

    Article  Google Scholar 

  8. Lv, C., Wu, Z., Wang, X., Zhou, M.: 3D facial expression modeling based on facial landmarks in single image. Neurocomputing 355, 155–167 (2019)

    Article  Google Scholar 

  9. Lv, C., Wu, Z., Wang, X., Zhou, M., Toh, K.A.: Nasal similarity measure of 3D faces based on curve shape space. Pattern Recognit. 88, 458–469 (2019)

    Article  Google Scholar 

  10. Madeira, J.S., Stork, A., Groß, M.H.: An approach to computer-supported cartooning. Vis. Comput. 12(1), 1–17 (1996)

    Article  Google Scholar 

  11. Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math. 5(1), 32–38 (1957)

    Article  MathSciNet  Google Scholar 

  12. Qiu, J., Seah, H.S., Tian, F., Chen, Q., Melikhov, K.: Computer-assisted auto coloring by region matching. In: Proceedings of 11th Pacific Conference on Computer Graphics and Applications, 2003, pp. 175–184. IEEE (2003)

  13. Qiu, J., Seah, H.S., Tian, F., Chen, Q., Wu, Z., Melikhov, K.: Auto coloring with enhanced character registration. Int. J. Comput. Games Technol. 2008, 2 (2008)

    Article  Google Scholar 

  14. Qiu, J., Soon Seah, H., Tian, F., Chen, Q., Wu, Z.: Enhanced auto coloring with hierarchical region matching. Comput. Animat. Virtual Worlds 16(3–4), 463–473 (2005)

    Article  Google Scholar 

  15. Stegmann, M.B., Gomez, D.D.: A brief introduction to statistical shape analysis. Inform. Math. Model. Tech. Univ. Den. DTU 15(11), 1–15 (2002)

    Google Scholar 

  16. Sỳkora, D., Buriánek, J., Žára, J.: Unsupervised colorization of black-and-white cartoons. In: Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, pp. 121–127. ACM (2004)

  17. Trémeau, A., Colantoni, P.: Regions adjacency graph applied to color image segmentation. IEEE Trans. Image Process. 9(4), 735–744 (2000)

    Article  Google Scholar 

  18. Trigo, P.G., Johan, H., Imagire, T., Nishita, T.: Interactive region matching for 2D animation coloring based on feature’s variation. IEICE Trans. Inf. Syst. 92(6), 1289–1295 (2009)

    Article  Google Scholar 

  19. Valencia, C.E., Vargas, M.C.: Optimum matchings in weighted bipartite graphs. Boletín de la Sociedad Matemática Mexicana 22(1), 1–12 (2016)

    Article  MathSciNet  Google Scholar 

  20. Wang, C., Abe, K.: Region correspondence by inexact attributed planar graph matching. In: Proceedings of IEEE International Conference on Computer Vision, pp. 440–447. IEEE (1995)

  21. Zhang, S.H., Chen, T., Zhang, Y.F., Hu, S.M., Martin, R.R.: Vectorizing cartoon animations. IEEE Trans. Vis. Comput. Graph. 15(4), 618–629 (2009)

    Article  Google Scholar 

  22. Zhu, H., Liu, X., Wong, T.T., Heng, P.A.: Globally optimal toon tracking. ACM Trans. Graph. (TOG) 35(4), 75 (2016)

    Article  Google Scholar 

Download references

Acknowledgements

The authors want to thank the anonymous reviewers for their constructive comments. This research was partially supported by the National Key R&D Program of China (No. 2017YFB1002604, No. 2017YFB1402105), the National Key Cooperation between the BRICS of China (No. 2017YFE0100500), the National Nature Science Foundation of China(No. 61972041), and the China Scholarship Council (No. 201806040084). Additionally, many thanks to Jiang jie, Liew Hongze and Wang Yanchao for their instructive advice and useful suggestions.

Author information

Authors and Affiliations

  1. Beijing Normal University, Beijing, China

    Shaolong Liu, Xingce Wang & Zhongke Wu

  2. School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore, Singapore

    Hock Soon Seah

Authors
  1. Shaolong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xingce Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhongke Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hock Soon Seah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhongke Wu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, S., Wang, X., Wu, Z. et al. Shape correspondence based on Kendall shape space and RAG for 2D animation. Vis Comput 36, 2457–2469 (2020). https://doi.org/10.1007/s00371-020-01958-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-020-01958-7

Keywords

Search

Navigation