Skip to main content
SpringerLink
Log in

A robot calligraphy writing method based on style transferring algorithm and similarity evaluation

  • Original Research Paper
  • Published:
Intelligent Service Robotics Aims and scope Submit manuscript

Abstract

This paper proposes a robot calligraphy writing method based on style transfer algorithm, which can transfer the art style of Chinese font and maintain the imitation accuracy of the calligraphy. A prototypical similarity evaluation approach is also presented to analyze the calligraphy writing effect, including the similarity ratio of balance, inclination and writing intensity. The robot writing system mainly consists of a six-DOF robot, manipulator, Chinese brush and PC controller. Firstly, input character images are transformed into target style font through training and style transferring process based on generative adversarial networks method. Then, the description parameters of the character images with target style are extracted to control the robot calligraphy writing process precisely. Experimental results show that the minimum similarity between the styles of robot writing characters and target characters is larger than 0.75. The proposed method shows good calligraphy writing effect, which can be used for various calligraphy training processes and trajectory planning applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Yao FH, Shao GF (2006) Modeling of ancient-style Chinese character and its application to CCC robot. In: IEEE international conference on networking, sensing and control, pp 72–77

  2. Yao FH, Shao GF, Yi JQ (2004) Trajectory generation of the writing-brush for a robot arm to inherit block-style Chinese character calligraphy techniques. Adv Robot 18(3):331–356

    Article  Google Scholar 

  3. Bogue R (2017) Recent developments in robotic tactile perception. Ind Robot 44(5):565–570

    Article  Google Scholar 

  4. Lam JHM, Yam Y (2009) Stroke trajectory generation experiment for a robotic Chinese calligrapher using a geometric brush footprint model. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, St. Louis, MO, pp 2315–2320

  5. Matsui A, Katsura SA (2013) Method of motion reproduction for calligraphy education. In: 2013 IEEE international conference on proceedings of mechatronics (ICM), IEEE, pp 452–457

  6. Kim SK, Jo J, Oh Y (2014) Robotic handwriting: multi-contact manipulation based on reactional internal contact hypothesis. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems (IROS 2014), Chicago, IL, pp 877–884

  7. Sun YD, Xu YS (2013) A calligraphy robot—callibot: design, analysis and applications. In: Proceedings of international conference on robotics and biomimetics, pp 185–190

  8. Filiatrault S, Cretu A. M (2014) Human arm motion imitation by a humanoid robot. In: Proceedings of IEEE international symposium on robotic and sensors environments (ROSE), Timisoara, pp 31–36

  9. Man YK, Bian CY, Zhao HB (2010) A kind of calligraphy robot. In: 2010 3rd International Conference on proceedings of information sciences and interaction sciences (ICIS), IEEE, pp 635–638

  10. Droniou A, Ivaldi S, Sigaud O (2014) Learning a repertoire of actions with deep neural networks. In: Proceedings of IEEE international conferences on development and learning and epigenetic robotics (ICDL-Epirob), Genoa, pp 229–234

  11. Chao F, Huang YX, Zhang X, Shang CJ, Yang LZ, Hu HS, Lin CM (2017) A robot calligraphy system: from simple to complex writing by human gestures. Eng Appl Artif Intell 59:1–14

    Article  Google Scholar 

  12. Wang J, Pi YG, Liu MY (2009) Detection of the contour corner of character image based on the freeman chain code. Tech Autom Appl 28(1):88–92

    Google Scholar 

  13. Zhe M, Su J (2017) Aesthetics evaluation for robotic chinese calligraphy. IEEE Trans Cognit Dev Syst 9(1):80–90

    Article  MathSciNet  Google Scholar 

  14. Phang SK, Lai S, Fei W, Lan M, Chen BM (2015) Systems design and implementation with jerk-optimized trajectory generation for UAV calligraphy. Mechatronics 30:65–75

    Article  Google Scholar 

  15. Morikawa A, Tsuda N, Nomura Y, Kato N (2017) Self-training system of calligraphy brushwork. In: Companion of the ACM/IEEE international conference on human–robot interaction

  16. Hossain D, Genci Capi, Mitsuru Jindai, Kaneko SI (2017) Pick-place of dynamic objects by robot manipulator based on deep learning and easy user interface teaching systems. Ind Robot 44(1):11–20

    Article  Google Scholar 

  17. Sünderhauf N, Brock O, Scheirer W, Hadsell R, Fox D, Leitner J et al (2018) The limits and potentials of deep learning for robotics. Int J Robot Res 37(4):405–420

    Article  Google Scholar 

  18. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Proceedings of advances in neural information processing systems, Curran Associates, Red Hook, pp 1097–1105

  19. Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S et al (2014) Generative adversarial networks. Adv Neural Inf Process Syst 3:2672–2680

    Google Scholar 

  20. Chen X, Xu C, Yang X, Song L, Tao D (2019) Gated-gan: adversarial gated networks for multi-collection style transfer. IEEE Trans Image Process 28(2):546–560

    Article  MathSciNet  Google Scholar 

  21. Huang T, Jiang Y (2004) A quick thinning algorithm for handwritten chinese. Comput Eng 30(19):121–128

    Google Scholar 

  22. Chang Y, Lee J, Rijal O, Bakar S (2010) Efficient online handwritten chinese character recognition system using a two-dimensional functional relationship model. Int J Appl Math Comput Sci 20(4):727–738

    Article  Google Scholar 

  23. Rahmani A, Ghanbari A (2016) Application of neural network training in forward kinematics simulation for a novel modular hybrid manipulator with experimental validation. Intel Serv Robot 9(1):1–13

    Article  Google Scholar 

  24. Connolly C (2009) Technology and applications of ABB RobotStudio. Ind Robot 36(6):540–545

    Article  Google Scholar 

  25. Zhang X, Zhao Q, Xue H, Dong J (2011) Interactive creation of Chinese calligraphy with the application in calligraphy education. Transactions on edutainment, vol V. Springer, Berlin

    Google Scholar 

Download references

Acknowledgements

This research is supported by the National Natural Science Foundation of China (51805280), the Natural Science Foundation of Zhejiang province (LQ18E050005), the Ningbo Technology Innovation 2025 Project (2018B10005), Zhejiang Province Public Welfare Technology Application Research Project (2017C31094) and the K. C. Wong Magna Fund in Ningbo University.

Author information

Authors and Affiliations

  1. Faculty of Mechanical Engineering and Mechanics, Ningbo University, No. 818 Fenghua Road, Jiangbei District, Ningbo City, Zhejiang Province, China

    Dong-tai Liang, Dan Liang, Shu-min Xing, Ping Li & Xiao-cheng Wu

Authors
  1. Dong-tai Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dan Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shu-min Xing
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ping Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiao-cheng Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dong-tai Liang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liang, Dt., Liang, D., Xing, Sm. et al. A robot calligraphy writing method based on style transferring algorithm and similarity evaluation. Intel Serv Robotics 13, 137–146 (2020). https://doi.org/10.1007/s11370-019-00298-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11370-019-00298-3

Keywords

Search

Navigation