Skip to main content
SpringerLink
Log in

Discovering calligraphy style relationships by Supervised Learning Weighted Random Walk Model

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

Chinese calligraphy is an important part of Chinese traditional culture. More and more calligraphy works are digitized, preserved and exhibited in digital libraries. Users may want to appreciate the style-similar works simultaneously. However, currently available services such as metadata-based browsing and searching can not satisfy such kind of requirement. To allow users to appreciate the style-similar works conveniently, we propose a Supervised Learning Weighted Random Walk Model to discover calligraphy style relationships. In the model, we consider the heterogeneity of both edges and nodes, and then use some preference pairs to learn the weights of different types of edges in the graph. After the weight learning, the style relationships can be discovered by random walk on the heterogeneous graphs. In order to solve the out-of-graph node problem, we pre-compute the personalized vector for each character or visual word, then utilize the Linearity Theory for vector addition to approximate the relationships between the new node and other nodes in graph. Then we demonstrate several applications which prove the effectiveness and efficiency of our proposed model and a user study for benefit verification. Finally, we explore some strategies to enhance the performance with the explicit or implicit user interaction including feedback, clickthrough data tracking.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Agarwal, A., Chakrabarti, S.: Learning random walks to rank nodes in graphs. In: ICML’07: Proceedings of the 24th International Conference on Machine learning, pp. 9–16. ACM, New York (2007)

  2. Agarwal, A., Chakrabarti, S., Aggarwal, S.: Learning to rank networked entities. In: KDD’06: Proceedings of the 12th ACM SIGKDD international Conference on Knowledge discovery and data mining, pp. 14–23. ACM, New York (2006)

  3. Chakrabarti, S., Agarwal, A.: Learning parameters in entity relationship graphs from ranking preferences. In: PKDD. Lecture Notes in Computer Science, vol. 4213, pp. 91–102. Springer, Berlin (2006)

  4. Diligenti, M., Gori, M., Maggini, M.: Learning web page scores by error back-propagation. In: IJCAI, pp. 684–689. Professional Book Center (2005)

  5. Minkov, E., Cohen, W.W.: Learning to rank typed graph walks: local and global approaches. In: WebKDD/SNA-KDD’07: Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 Workshop on Web Mining And Social Network Analysis, pp. 1–8. ACM, New York (2007)

  6. Nie, Z., Zhang, Y., Wen, J.-R., Ma, W.-Y.: Object-level ranking: bringing order to web objects. In: WWW’05: Proceedings of the 14th International Conference on World Wide Web, pp. 567–574. ACM, New York (2005)

  7. Jeh, G., Widom, J.: Scaling personalized web search. In: WWW’03: Proceedings of the 12th International Conference on World Wide Web, pp. 271–279. ACM, New York (2003)

  8. Mao G., Zhang J., Yu J., Ye X.: Denoising of Chinese calligraphy tablet images based on run-length statistics and structure characteristic of character strokes. J. Zhejiang Univ. Sci. A 7(7), 1178–1186 (2006)

    Article  MATH  Google Scholar 

  9. Wang, S.-Z., Lee, H.-J.: Dual-binarization and anisotropic diffusion of Chinese characters in calligraphy documents. In: Proceedings of the Sixth International Conference on Document Analysis and Recognition, pp. 271–275 (2001)

  10. Wong, S.T.S., Leung, H., Ip, H.H.S.: Brush writing style classification from individual Chinese characters. In: ICPR’06: Proceedings of the 18th International Conference on Pattern Recognition, pp. 884–887. IEEE Computer Society, Washington, DC (2006)

  11. Lu, W., Zhuang, Y., Zhang, X., Wu, F.: Web-based Chinese calligraphy retrieval and learning system. In: ICWL, pp. 186–196 (2005)

  12. Zhuang Y., Zhuang Y., Li Q., Chen L.: Interactive high-dimensional index for large Chinese calligraphic character databases. ACM Trans. Asian Lang. Inf. Process. (TALIP) 6(2), 8 (2007)

    Article  Google Scholar 

  13. Wu, Y., Zhuang, Y., Pan, Y., Wu, J.: Web based Chinese calligraphy learning with 3-d visualization method. In: IEEE International Conference on Multimedia and Expo, pp. 2073–2076 (2006)

  14. Wong S.T.S., Leung H., Ip H.H.S.: Model-based analysis of Chinese calligraphy images. Comput. Vis. Image Understand. 109(1), 69–85 (2008)

    Article  Google Scholar 

  15. Xu S., Lau F.C.M., Cheung W.K., Pan Y.: Automatic generation of artistic Chinese calligraphy. IEEE Intell. Syst. 20(3), 32–39 (2005)

    Article  Google Scholar 

  16. Yu J., Peng Q.: Realistic synthesis of cao shu of Chinese calligraphy. Comput. Graph. 29(1), 145–153 (2005)

    Article  Google Scholar 

  17. Chou, C.-H., Wu, C.-S., Han, C.-C.: An interactive grading and learning system for Chinese calligraphy. In: IEEE International Conference on Electro Information Technology, p. 6, 22–25 May (2005)

  18. Lau, F.C.M., Xu, S., Jiang, H., Pan, Y.: An intelligent system for Chinese calligraphy. In: AAAI’07: Proceedings of the 22nd AAAI Conference on Artificial Intelligence, p. 1578. AAAI Press, Menlo Park (2007)

  19. Zhuang, Y., Zhang, X.: Visual verification of historical Chinese calligraphy works. In: MMM’07: Proceedings of the 13th International MultiMedia Modeling Conference, 2007

  20. Pan, J.-Y., Yang, H.-J., Faloutsos, C., Duygulu, P.: Automatic multimedia cross-modal correlation discovery. In: KDD’04: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge discovery and Data Mining, pp. 653–658. ACM, New York (2004)

  21. Zhu, X., Goldberg, A., Van Gael, J., Andrzejewski, D.: Improving diversity in ranking using absorbing random walks. In: Proceedings of the North American Chapter of the Association for Computational Linguistics, Human Language Technologies, pp. 97–104. Association for Computational Linguistics, 2007

  22. Baluja, S., Seth, R., Sivakumar, D., Jing, Y., Yagnik, J., Kumar, S., Ravichandran, D., Aly, M.: Video suggestion and discovery for youtube: taking random walks through the view graph. In: WWW’08: Proceeding of the 17th International Conference on World Wide Web, pp. 895–904. ACM, New York (2008)

  23. Cheng, H., Tan, P.-N., Sticklen, J., Punch, W.F.: Recommendation via query centered random walk on k-partite graph. Data Mining, 2007. ICDM 2007. Seventh IEEE International Conference on, pp. 457–462, 28–31 (2007)

  24. Fouss, F., Renders, J.-M.: Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19(3), 355–369, 2007. Member-Alain Pirotte and Member-Marco Saerens

  25. Pucci, A., Gori, M.: Itemrank: a random-walk based scoring algorithm for recommender engines. In: IJCAI’07: International Joint Conference on Artificial Intelligence, p. 2766 (2007)

  26. Minkov, E., Cohen, W.W., Ng, A.Y.: Contextual search and name disambiguation in email using graphs. In: SIGIR’06: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 27–34. ACM, New York (2006)

  27. Zaiane, O.R., Chen, J., Goebel, R.: Dbconnect: mining research community on dblp data. In: WebKDD/SNA-KDD’07: Proceedings of the 9th WebKDD and 1st SNA-KDD 2007 Workshop on Web Mining and Social Network Analysis, pp. 74–81. ACM, New York (2007)

  28. Craswell, N., Szummer, M.: Random walks on the click graph. In: SIGIR’07: Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 239–246. ACM, New York (2007)

  29. Liu, J., Li, M., Ma, W.-Y., Liu, Q., Lu, H.: An adaptive graph model for automatic image annotation. In: MIR’06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 61–70. ACM, New York (2006)

  30. Wang, C., Jing, F., Zhang, L., Zhang, H.-J.: Image annotation refinement using random walk with restarts. In: MULTIMEDIA’06: Proceedings of the 14th Annual ACM International Conference on Multimedia, pp. 647–650. ACM, New York (2006)

  31. Cheng, T., Yan, X., Chang, K.C.-C.: Entityrank: searching entities directly and holistically. In: VLDB’07: Proceedings of the 33rd International Conference on Very large data bases, pp. 387–398. VLDB Endowment (2007)

  32. Hughes, T., Ramage, D.: Lexical semantic relatedness with random graph walk. In: Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 581–589 (2007)

  33. Mihalcea, R.: Unsupervised large-vocabulary word sense disambiguation with graph-based algorithms for sequence data labeling. In: HLT’05: Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, pp. 411–418. Association for Computational Linguistics, Morristown (2005)

  34. Harabagiu, S., Lacatusu, F., Hickl, A.: Answering complex questions with random walk models. In: SIGIR’06: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 220–227. ACM, New York (2006)

  35. Serdyukov, P., Rode, H., Hiemstra, D.: Modeling expert finding as an absorbing random walk. In: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 797–798. ACM, New York (2008)

  36. Fuxman, A., Tsaparas, P., Achan, K., Agrawal, R.: Using the wisdom of the crowds for keyword generation. In: WWW’08: Proceeding of the 17th International Conference on World Wide Web, pp. 61–70. ACM, New York (2008)

  37. He, J., Li, M., Zhang, H.-J., Tong, H., Zhang, C.: Manifold-ranking based image retrieval. In: MULTIMEDIA’04: Proceedings of the 12th Annual ACM International Conference on Multimedia, pp. 9–16. ACM, New York (2004)

  38. Tong, H., He, J., Li, M., Ma, W.-Y., Zhang, H.-J., Zhang, C.: Manifold-ranking-based keyword propagation for image retrieval. EURASIP J. Appl. Signal Process. 2006(1), 190–190 (2006)

    Google Scholar 

  39. Yuan, X., Hua, X.-S., Wang, M., Wu, X.-Q.: Manifold-ranking based video concept detection on large database and feature pool. In: MULTIMEDIA’06: Proceedings of the 14th annual ACM International Conference on Multimedia, pp. 623–626. ACM, New York (2006)

  40. Zhou, D., Weston, J., Gretton, A., Bousquet, O., Schölkopf, B.: Ranking on data manifolds. In: Advances in Neural Information Processing Systems, vol. 16. MIT Press, Cambridge (2004)

  41. Cilibrasi R.L., Vitanyi P.M.B.: The Google similarity distance. IEEE Trans. Knowl. Data Eng. 19(3), 370–383 (2007)

    Article  Google Scholar 

  42. Zhai C., Lafferty J.: A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inf. Syst. 22(2), 179–214 (2004)

    Article  Google Scholar 

  43. Cao B.: Chinese Calligraphy History—Song Liao Jin. Jiangsu Education Publishing Press, China (1999)

    Google Scholar 

  44. Liu Z.: Chinese Calligraphy Collections—Dong Qichang. Rong Bao Zai Publishing Press, China (1992)

    Google Scholar 

  45. Tao, D., Li, X., Maybank, S.J.: Negative samples analysis in relevance feedback. IEEE Trans. Knowl. Data Eng., pp. 568–580 (2007)

  46. Tao D., Tang X., Li X., Rui Y.: Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm. IEEE Trans. Multimedia 8(4), 716–727 (2006)

    Article  Google Scholar 

  47. Tao, D., Tang, X., Li, X., Wu, X.: Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans. Pattern Anal. Mach. Intell., pp. 1088–1099 (2006)

  48. He X., King O., Ma W.Y., Li M., Zhang H.J.: Learning a semantic space from user’s relevance feedback for image retrieval. IEEE Trans. Circuits Syst. Video Technol. 13(1), 39–48 (2003)

    Article  Google Scholar 

  49. He, X., Ma, W.Y., Zhang, H.J.: Learning an image manifold for retrieval. In: Proceedings of the 12th annual ACM International Conference on Multimedia, pp. 17–23. ACM, New York (2004)

  50. Li M., Chen Z., Zhang H.J.: Statistical correlation analysis in image retrieval. Pattern Recognit. 35(12), 2687–2693 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  51. Yang J., Li Q., Zhuang Y.: Towards data-adaptive and user-adaptive image retrieval by peer indexing. Int. J. Comput. Vis. 56(1), 47–63 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, China

    Weiming Lu, Yueting Zhuang & Jiangqin Wu

Authors
  1. Weiming Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yueting Zhuang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiangqin Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weiming Lu.

Additional information

Communicated by Changsheng Xu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lu, W., Zhuang, Y. & Wu, J. Discovering calligraphy style relationships by Supervised Learning Weighted Random Walk Model. Multimedia Systems 15, 221–242 (2009). https://doi.org/10.1007/s00530-008-0151-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-008-0151-z

Keywords

Search

Navigation