Abstract
Sentiment analysis is a hot topic and has various application scenarios. The polarity recognition of implied sentiment in a sentence can be achieved by the way of statistic and prediction. However, the polarity of sentiment is influenced by funny, humorous, and ironic Internet cultures, therefore it is hard to be verified. In this paper, we use a deep memory network with the auxiliary sequence to obtain the text feature vectors. Then the Emoji set and the special word set from the internet are imported, which are combined with the formal text feature vectors to form the classification feature vectors. At last a binary classifier is designed to get the final polarity prediction. Besides, an incremental online learning method with feedback adjustment is introduced to update the Emoji set and the special word set. Experiment results show that, on the IMDB datasets the prediction accuracy is about 85% and on the Chinese implied sentiment evaluation datasets the prediction accuracy is about 96%, which prove the effectiveness of the model.
Supported by the National Natural Science Foundation of China (No. 61802004, 61802005), Natural Science Foundation of Beijing (No. 4184085), Startup Foundation of North China University of Technology, Scientific Foundation for Yuyou Talents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson, T.: The Theory and Practice of Online Learning. Athabasca University Press, Edmonton (2008)
Chikersal, P., Poria, S., Cambria, E.: SeNTU: sentiment analysis of tweets by combining a rule-based classifier with supervised learning. In: Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), pp. 647–651 (2015)
Cho, K., et al.: Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)
Dou, Z.Y.: Capturing user and product information for document level sentiment analysis with deep memory network. In: Conference on Empirical Methods in Natural Language Processing, pp. 511–520 (2017)
Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res. 12(Jul), 2121–2159 (2011)
Felbo, B., Mislove, A., Søgaard, A., Rahwan, I., Lehmann, S.: Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm. arXiv preprint arXiv:1708.00524 (2017)
Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189–1232 (2001)
Graves, A., Wayne, G., Danihelka, I.: Neural turing machines. Comput. Sci. (2014)
Joshi, A., Sharma, V., Bhattacharyya, P.: Harnessing context incongruity for sarcasm detection. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers). vol. 2, pp. 757–762 (2015)
Khan, A.Z., Atique, M., Thakare, V.: Combining lexicon-based and learning-based methods for Twitter sentiment analysis. Int. J. Electron. Commun. Soft Comput. Sci. Eng. (IJECSCSE) 89 (2015)
Kumar, A., et al.: Ask me anything: dynamic memory networks for natural language processing, pp. 1378–1387 (2015)
LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)
Salton, G., Fox, E.A., Wu, H.: Extended Boolean information retrieval. Commun. ACM 26(11), 1022–1036 (1983)
Sukhbaatar, S., Szlam, A., Weston, J., Fergus, R.: End-to-end memory networks. Comput. Sci. (2015)
Tang, D., Qin, B., Liu, T.: Aspect level sentiment classification with deep memory network, pp. 214–224 (2016)
Weston, J., Chopra, S., Bordes, A.: Memory networks. Eprint Arxiv (2014)
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., Hovy, E.: Hierarchical attention networks for document classification. In: Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1480–1489 (2017)
Zhang, L., Ghosh, R., Dekhil, M., Hsu, M., Liu, B.: Combining lexicon-based and learning-based methods for twitter sentiment analysis. Hp Laboratories Technical Report (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, C., He, Y., Sun, L., Pang, C., Li, J. (2019). Deep Memory Network with Auxiliary Sequences for Chinese Implied Sentiment Analysis. In: Guo, S., Liu, K., Chen, C., Huang, H. (eds) Wireless Sensor Networks. CWSN 2019. Communications in Computer and Information Science, vol 1101. Springer, Singapore. https://doi.org/10.1007/978-981-15-1785-3_15
Download citation
DOI: https://doi.org/10.1007/978-981-15-1785-3_15
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-1784-6
Online ISBN: 978-981-15-1785-3
eBook Packages: Computer ScienceComputer Science (R0)
