Abstract
Most Chinese poetry generation methods only accept texts or user-specified words as input, which contradicts with the fact that ancient Chinese wrote poems inspired by visions, hearings and feelings. This paper proposes a method to generate sentimental Chinese classical poetry automatically from images based on convolutional neural networks and the language model. First, our method extracts visual information from the image and maps it to initial keywords by two parallel image classification models, then filters and extends these keywords to form a keywords set which is finally input into the poetry generation model to generate poems of different genres. A bi-directional generation algorithm and two fluency checkers are proposed to ensure the diversity and quality of generated poems, respectively. Besides, we constrain the range of optional keywords and define three sentiment-related keywords dictionary to avoid modern words that lead to incoherent content as well as ensure the emotional consistency with given images. Both human and automatic evaluation results demonstrate that our method can reach a better performance on quality and diversity of generated poems.
The work is supported by National Key R&D Program of China (2018YFD1100302), National Natural Science Foundation of China (No. 61972082, No. 72001213), and All-Army Common Information System Equipment Pre-Research Project (No. 31511110310, No. 31514020501, No. 31514020503).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chen, H., Yi, X., Sun, M., Yang, C., Li, W., Guo, Z.: Sentiment-controllable Chinese poetry generation. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, China (2019)
Cheng, W., Wu, C., Song, R., Fu, J., Xie, X., Nie, J.: Image inspired poetry generation in Xiaoice. arXiv Artificial Intelligence (2018)
Danglauser, E.S., Scherer, K.R.: The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance. Behav. Res. Methods 43(2), 468–477 (2011). https://doi.org/10.3758/s13428-011-0064-1
Gervas, P.: An expert system for the composition of formal Spanish poetry. Knowl. Based Syst. 14(3/4), 181–188 (2001)
Liao, Y., Wang, Y., Liu, Q., Jiang, X.: GPT-based generation for classical Chinese poetry. arXiv Computation and Language (2019)
Liu, B., Fu, J., Kato, M.P., Yoshikawa, M.: Beyond narrative description: generating poetry from images by multi-adversarial training. In: ACM Multimedia (2018)
Madnani, N.: iBLEU: interactively debugging and scoring statistical machine translation systems. In: IEEE International Conference Semantic Computing (2011)
Manurung, H.M.: An evolutionary algorithm approach to poetry generation. Ph.D. thesis, University of Edinburgh (2003)
Mikolov, T., Chen, K., Corrado, G.S., Dean, J.: Efficient estimation of word representations in vector space. In: International Conference on Learning Representations (2013)
Papineni, K., Roukos, S., Ward, T., Zhu, W.: BLEU: a method for automatic evaluation of machine translation. In: Meeting of the Association for Computational Linguistics (2002)
Rong, X.: Word2vec parameter learning explained. arXiv Computation and Language (2014)
Xu, L., Jiang, L., Qin, C., Wang, Z., Du, D.: How images inspire poems: generating classical Chinese poetry from images with memory networks. In: National Conference on Artificial Intelligence (2018)
Yi, X., Sun, M., Li, R., Yang, Z.: Chinese poetry generation with a working memory model. In: International Joint Conference on Artificial Intelligence (2018)
Zhang, X., Lapata, M.: Chinese poetry generation with recurrent neural networks. In: Empirical Methods in Natural Language Processing (2014)
Zhipeng, G., Yi, X., Sun, M., Li, W., Li, R.: Jiuge: a human-machine collaborative Chinese classical poetry generation system. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, H., Zhu, J., Cao, S., Li, X., Zeng, J., Wang, P. (2021). Poetic Expression Through Scenery: Sentimental Chinese Classical Poetry Generation from Images. In: Jensen, C.S., et al. Database Systems for Advanced Applications. DASFAA 2021. Lecture Notes in Computer Science(), vol 12682. Springer, Cham. https://doi.org/10.1007/978-3-030-73197-7_43
Download citation
DOI: https://doi.org/10.1007/978-3-030-73197-7_43
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-73196-0
Online ISBN: 978-3-030-73197-7
eBook Packages: Computer ScienceComputer Science (R0)