Abstract
Aspect-level sentiment classification is a crucial branch for sentiment classification. Most of the existing work focuses on how to model the semantic relationship between the aspect and the sentence, while the relationships among the multiple aspects in the sentence is ignored. To address this problem, we propose a joint learning (Joint) model for aspect-level sentiment classification, which models the relationships among the aspects of the sentence and predicts the sentiment polarities of all aspects simultaneously. In particular, we first obtain the augmented aspect representation via an aspect modeling (AM) method. Then, we design a relationship modeling (RM) approach which transforms sentiment classification into a sequence labeling problem to model the potential relationships among each aspect in a sentence and predict the sentiment polarities of all aspects simultaneously. Extensive experiments on four benchmark datasets show that our approach can effectively improve the performance of aspect-level sentiment classification compared with the state-of-the-art approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Available at: http://alt.qcri.org/semeval2014/task4/.
- 2.
Available at: http://alt.qcri.org/semeval2015/task12/.
- 3.
Available at: http://alt.qcri.org/semeval2016/task5/.
- 4.
- 5.
Available at: https://github.com/ruidan/Aspect-level-sentiment.
- 6.
Available at: https://www.yelp.com/dataset/challenge.
- 7.
Available at: http://jmcauley.ucsd.edu/data/amazon/.
References
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)
Chen, P., Sun, Z., Bing, L., Yang, W.: Recurrent attention network on memory for aspect sentiment analysis. In: Proceedings of EMNLP, pp. 452–461 (2017)
Chen, T., Xu, R., He, Y., Wang, X.: Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN. Expert Syst. Appl. 72, 221–230 (2017)
Cheng, J., Zhao, S., Zhang, J., King, I., Zhang, X., Wang, H.: Aspect-level sentiment classification with heat (hierarchical attention) network. In: Proceedings of CIKM, pp. 97–106. ACM (2017)
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (almost) from scratch. J. Mach. Learn. Res. 12(Aug), 2493–2537 (2011)
Du, J., Gui, L., He, Y., Xu, R., Wang, X.: Convolution-based neural attention with applications to sentiment classification. IEEE Access 7, 27983–27992 (2019)
Fan, C., Gao, Q., Du, J., Gui, L., Xu, R., Wong, K.F.: Convolution-based memory network for aspect-based sentiment analysis. In: Proceedings of SIGIR, pp. 1161–1164. ACM (2018)
Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5–6), 602–610 (2005)
Gu, S., Zhang, L., Hou, Y., Song, Y.: A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceedings of COLING, pp. 774–784 (2018)
He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: Effective attention modeling for aspect-level sentiment classification. In: Proceedings of COLING, pp. 1121–1131 (2018)
He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: Exploiting document knowledge for aspect-level sentiment classification. In: Proceedings of ACL, pp. 579–585 (2018)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)
Huang, B., Ou, Y., Carley, K.M.: Aspect level sentiment classification with attention-over-attention neural networks. In: Thomson, R., Dancy, C., Hyder, A., Bisgin, H. (eds.) SBP-BRiMS 2018. LNCS, vol. 10899, pp. 197–206. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93372-6_22
Jiang, L., Yu, M., Zhou, M., Liu, X., Zhao, T.: Target-dependent Twitter sentiment classification. In: Proceedings of ACL, pp. 151–160 (2011)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of ICLR, vol. 5 (2015)
Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.: NRC-Canada-2014: detecting aspects and sentiment in customer reviews. In: Proceedings of SemEval, pp. 437–442 (2014)
Li, X., Bing, L., Lam, W., Shi, B.: Transformation networks for target-oriented sentiment classification. In: Proceedings of ACL, pp. 946–956 (2018)
Li, X., Lam, W.: Deep multi-task learning for aspect term extraction with memory interaction. In: Proceedings of EMNLP, pp. 2886–2892 (2017)
Li, Z., Wei, Y., Zhang, Y., Zhang, X., Li, X., Yang, Q.: Exploiting coarse-to-fine task transfer for aspect-level sentiment classification. In: Proceedings of AAAI (2019)
Lin, C., He, Y.: Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 375–384. ACM (2009)
Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)
Liu, J., Zhang, Y.: Attention modeling for targeted sentiment. In: Proceedings of ACL, vol. 2, pp. 572–577 (2017)
Liu, Q., Zhang, H., Zeng, Y., Huang, Z., Wu, Z.: Content attention model for aspect based sentiment analysis. In: Proceedings of WWW, pp. 1023–1032. International World Wide Web Conferences Steering Committee (2018)
Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. In: Proceedings of IJCAI, pp. 4068–4074 (2017)
Ma, Y., Peng, H., Cambria, E.: Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In: Proceedings of AAAI, pp. 5876–5883 (2018)
Manandhar, S.: Semeval-2014 task 4: aspect based sentiment analysis. In: Proceedings of SemEval (2014)
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of EMNLP, pp. 79–86 (2002)
Pang, B., Lee, L., et al.: Opinion mining and sentiment analysis. Found. Trends® Inf. Retrieval 2(1–2), 1–135 (2008)
Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of EMNLP, pp. 1532–1543 (2014)
Pontiki, M., et al.: Semeval-2016 task 5: aspect based sentiment analysis. In: Proceedings of SemEval, pp. 19–30 (2016)
Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I.: Semeval-2015 task 12: aspect based sentiment analysis. In: Proceedings of SemEval, pp. 486–495 (2015)
Ruder, S., Ghaffari, P., Breslin, J.G.: A hierarchical model of reviews for aspect-based sentiment analysis. In: Proceedings of EMNLP, pp. 999–1005 (2016)
Saeidi, M., Bouchard, G., Liakata, M., Riedel, S.: Sentihood: targeted aspect based sentiment analysis dataset for urban neighbourhoods. In: Proceedings of COLING, pp. 1546–1556 (2016)
Schmitt, M., Steinheber, S., Schreiber, K., Roth, B.: Joint aspect and polarity classification for aspect-based sentiment analysis with end-to-end neural networks. In: Proceedings of EMNLP, pp. 1109–1114 (2018)
Schouten, K., Frasincar, F.: Survey on aspect-level sentiment analysis. Proc. IEEE TKDE 28(3), 813–830 (2016)
Sukhbaatar, S., Weston, J., Fergus, R., et al.: End-to-end memory networks. In: Proceedings of NIPS, pp. 2440–2448 (2015)
Sun, C., Huang, L., Qiu, X.: Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence. In: Proceedings of NAACL (2019)
Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMs for target-dependent sentiment classification. In: Proceedings of COLING, pp. 3298–3307 (2016)
Tang, D., Qin, B., Liu, T.: Aspect level sentiment classification with deep memory network. In: Proceedings of EMNLP, pp. 214–224 (2016)
Tay, Y., Luu, A.T., Hui, S.C.: Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: Proceedings of AAAI, pp. 5956–5963 (2018)
Tay, Y., Tuan, L.A., Hui, S.C.: Dyadic memory networks for aspect-based sentiment analysis. In: Proceedings of CIKM, pp. 107–116. ACM (2017)
Vo, D.T., Zhang, Y.: Target-dependent twitter sentiment classification with rich automatic features. In: Proceedings of IJCAI, pp. 1347–1353 (2015)
Wagner, J., et al.: DCU: aspect-based polarity classification for SemEval task 4. In: Proceedings of SemEval, pp. 223–229 (2014)
Wang, B., Liakata, M., Zubiaga, A., Procter, R.: TDParse: multi-target-specific sentiment recognition on Twitter. In: Proceedings of ACL, vol. 1, pp. 483–493 (2017)
Wang, J., et al.: Aspect sentiment classification with both word-level and clause-level attention networks. In: Proceedings of IJCAI, pp. 4439–4445 (2018)
Wang, S., Mazumder, S., Liu, B., Zhou, M., Chang, Y.: Target-sensitive memory networks for aspect sentiment classification. In: Proceedings of ACL, vol. 1, pp. 957–967 (2018)
Wang, Y., Huang, M., Zhao, L., et al.: Attention-based LSTM for aspect-level sentiment classification. In: Proceedings of EMNLP, pp. 606–615 (2016)
Xu, H., Liu, B., Shu, L., Yu, P.S.: Bert post-training for review reading comprehension and aspect-based sentiment analysis. In: Proceedings of NAACL (2019)
Xu, X., Tan, S., Liu, Y., Cheng, X., Lin, Z.: Towards jointly extracting aspects and aspect-specific sentiment knowledge. In: Proceedings of CIKM, pp. 1895–1899. ACM (2012)
Xue, W., Li, T.: Aspect based sentiment analysis with gated convolutional networks. In: Proceedings of ACL, pp. 2514–2523 (2018)
Zeng, D., Liu, K., Lai, S., Zhou, G., Zhao, J.: Relation classification via convolutional deep neural network. In: Proceedings of COLING, pp. 2335–2344 (2014)
Zhang, M., Zhang, Y., Vo, D.T.: Gated neural networks for targeted sentiment analysis. In: Proceedings of AAAI, pp. 3087–3093 (2016)
Zhou, J., Chen, Q., Huang, J.X., Hu, Q.V., He, L.: Position-aware hierarchical transfer model for aspect-level sentiment classification. Inf. Sci. 513, 1–16 (2020)
Zhou, J., Huang, J.X., Chen, Q., Hu, Q.V., Wang, T., He, L.: Deep learning for aspect-level sentiment classification: survey, vision and challenges. IEEE Access 7, 78454–78483 (2019)
Zhu, P., Qian, T.: Enhanced aspect level sentiment classification with auxiliary memory. In: Proceedings of COLING, pp. 1077–1087 (2018)
Acknowledgments
We greatly appreciate anonymous reviewers and the associate editor for their valuable and high quality comments that greatly helped to improve the quality of this article. This research is funded by the Science and Technology Commission of Shanghai Municipality (19511120200). This research is also supported by the Natural Sciences and Engineering Research Council (NSERC) of Canada, an NSERC CREATE award in ADERSIM (http://www.yorku.ca/adersim), the York Research Chairs (YRC) program and an ORF-RE (Ontario Research Fund-Research Excellence) award in BRAIN Alliance (http://brainalliance.ca).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhou, J., Huang, J.X., Hu, Q.V., He, L. (2020). Modeling Multi-aspect Relationship with Joint Learning for Aspect-Level Sentiment Classification. In: Nah, Y., Cui, B., Lee, SW., Yu, J.X., Moon, YS., Whang, S.E. (eds) Database Systems for Advanced Applications. DASFAA 2020. Lecture Notes in Computer Science(), vol 12112. Springer, Cham. https://doi.org/10.1007/978-3-030-59410-7_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-59410-7_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59409-1
Online ISBN: 978-3-030-59410-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)