Abstract
In this paper, we analyze the mutual relationship between social media text and tags and explore how to integrate sematic information for tag recommendation. Our key motivation is to jointly map all words, tags and posts to vectors in a same hidden sematic space by modeling the syntagmatic and paradigmatic information simultaneously. We propose two novel distributed representation learning models for tagged documents: Tag Representation Learning (TRL) and Tag and Word Representation Learning (TWRL). The first models the immediate relationship between tags and words. The second one adds a skip-gram output layer to the first model, in order to enhance the semantic relationship among words. Extensive experiments are conducted on large scale datasets crawled from Twitter and Sina Weibo. By simulating two typical recommendation tasks, we discover that both models mentioned above outperform other competitive baselines remarkably.
W.Chen—Independent Researcher.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhao, X., Zheng, X., Yang, X., Liu, X., Tang, J.: Jointly learning to recommend and advertise. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 3319–3327 (2020)
Xu, S., Zhou, A.: Hashtag homophily in twitter network: examining a controversial cause-related marketing campaign. Comput. Hum. Behav. 102, 87–96 (2020)
Singh, L.G., Anil, A., Singh, S.R.: She: sentiment hashtag embedding through multitask learning. IEEE Trans. Comput. Soc. Sys. 7(2), 417–424 (2020)
Baldwin, T., Cook, P., Lui, M., MacKinlay, A., Wang, L.: How noisy social media text, how diffrnt social media sources? In: Proceedings of the Sixth International Joint Conference on Natural Language Processing, pp. 356–364 (2013)
Blei, D.M.: Probabilistic topic models. Commun. ACM 55(4), 77–84 (2012)
Chen, X., Liu, Z., Sun, M.: Estimating translation probabilities for social tag suggestion. Expert Sys. Appl. 42(4), 1950–1959 (2015)
Cunha, E., et al.: Analyzing the dynamic evolution of hashtags on twitter: a language-based approach. In: Proceedings of the Workshop on Languages in Social Media, pp. 58–65. Association for Computational Linguistics (2011)
Dey, K., Shrivastava, R., Kaushik, S., Subramaniam, L.V.: Emtagger: a word embedding based novel method for hashtag recommendation on twitter. In: 2017 IEEE International Conference on Data Mining Workshops (ICDMW), pp. 1025–1032. IEEE (2017)
Ding, Z., Qiu, X., Zhang, Q., Huang, X.: Learning topical translation model for microblog hashtag suggestion. In: Twenty-third International Joint Conference on Artificial Intelligence (2013)
Harvey, M., Crestani, F.: Long time, no tweets! time-aware personalised hashtag suggestion. In: Hanbury, A., Kazai, G., Rauber, A., Fuhr, N. (eds.) ECIR 2015. LNCS, vol. 9022, pp. 581–592. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16354-3_65
Koehn, P.: Statistical Machine Translation. Cambridge University Press, Cambridge (2009)
Kou, F.F., et al.: Hashtag recommendation based on multi-features of microblogs. J. Comput. Sci. Technol. 33(4), 711–726 (2018)
Lapesa, G., Evert, S., Im Walde, S.S.: Contrasting syntagmatic and paradigmatic relations: insights from distributional semantic models. In: Proceedings of the Third Joint Conference on Lexical and Computational Semantics (* SEM 2014), pp. 160–170 (2014)
Liu, Z., Chen, X., Sun, M.: A simple word trigger method for social tag suggestion. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, EMNLP 2011, Stroudsburg, PA, USA, pp. 1577–1588. Association for Computational Linguistics (2011)
Ma, Z., Sun, A., Yuan, Q., Cong, G.: Tagging your tweets: a probabilistic modeling of hashtag annotation in twitter. In: Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, pp. 999–1008 (2014)
Mikolov, T., Deoras, A., Povey, D., Burget, L., Černockỳ, J.: Strategies for training large scale neural network language models. In: Automatic Speech Recognition and Understanding (ASRU), 2011 IEEE Workshop on, pp. 196–201. IEEE (2011)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held 5–8, December 2013, Lake Tahoe, Nevada, United States, pp. 3111–3119 (2013)
Ramage, D., Heymann, P., Manning, C.D., Garcia-Molina, H.: Clustering the tagged web. In: Proceedings of the Second ACM International Conference on Web Search and Data Mining, pp. 54–63. ACM (2009)
Si, X., Sun, M.: Tag-lda for scalable real-time tag recommendation. J. Comput. Inf. Sys. 6(1), 23–31 (2009)
Sun, F., Guo, J., Lan, Y., Xu, J., Cheng, X.: Learning word representations by jointly modeling syntagmatic and paradigmatic relations. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics (2015)
Tran, V.C., Hwang, D., Jung, J.J.: Semi-supervised approach based on co-occurrence coefficient for named entity recognition on twitter. In: Information and Computer Science (NICS), 2015 2nd National Foundation for Science and Technology Development Conference, pp. 141–146. IEEE (2015)
Van Der Maaten, L.: Accelerating t-sne using tree-based algorithms. J. Mach. Learn. Res. 15(1), 3221–3245 (2014)
Zangerle, E., Gassler, W., Specht, G.: Recommending#-tags in twitter. In: Proceedings of the Workshop on Semantic Adaptive Social Web (SASWeb 2011). CEUR Workshop Proceedings, vol. 730, pp. 67–78 (2011)
Acknowledgments
This work is supported by Fundamental Research Funds for the Central Universities [2019RC045]. We thank the anonymous reviewers for their comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, X., Chen, W. (2021). A Joint Representation Learning Approach for Social Media Tag Recommendation. In: Mantoro, T., Lee, M., Ayu, M.A., Wong, K.W., Hidayanto, A.N. (eds) Neural Information Processing. ICONIP 2021. Lecture Notes in Computer Science(), vol 13111. Springer, Cham. https://doi.org/10.1007/978-3-030-92273-3_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-92273-3_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-92272-6
Online ISBN: 978-3-030-92273-3
eBook Packages: Computer ScienceComputer Science (R0)