Skip to main content

Position-aware Hybrid Attention Network for Aspect-Level Sentiment Analysis

  • Conference paper
  • First Online:
Information Retrieval (CCIR 2020)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12285))

Included in the following conference series:

Abstract

Aspect-level sentiment analysis aims to predict the sentiment polarity of a given target in a review sentence. Most of the previous methods focus on capturing the context information of words across the sentence related to the target, ignoring the importance of the independent relationship between the opinion words and the target. To address this limitation, we propose a position-aware hybrid attention network model for aspect-level sentiment analysis, which incorporates not only the context information of words related to the target, but also the independent relationship between the opinion words related to the target. We conduct several comparable experiments on public laptop and restaurant datasets. The experimental results show that our proposed model achieves a more effective performance than the baseline models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://sentiment.christopherpotts.net/lexicons.html.

  2. 2.

    http://alt.qcri.org/semeval2014/task4/.

  3. 3.

    https://nlp.stanford.edu/projects/glove/.

  4. 4.

    https://stanfordnlp.github.io/CoreNLP/.

References

  1. Zeng, J., Ma, X., Zhou, K.: Enhancing attention-based LSTM with position context for aspect-level sentiment classification. IEEE Access 7, 20462–20471 (2019)

    Article  Google Scholar 

  2. Tang, D., Qin, B., Feng, X., Liu, T.: Effective LSTMs for target-dependent sentiment classification. In: COLING 2016, pp. 3298–3307 (2016)

    Google Scholar 

  3. Wang, Y., Huang, M., Zhao, L., Zhu, X.: Attention-based LSTM for aspect-level sentiment classification. In: EMNLP 2016, pp. 606–615 (2016)

    Google Scholar 

  4. Kiritchenko, S., Zhu, X., Cherry, C., Mohammad, S.M.: Detecting aspects and sentiment in customer reviews. In: SemEval@COLING 2014, pp. 437–442 (2014)

    Google Scholar 

  5. Wagner, J., Arora, P., Cortes, S., Barman, U., Bogdanova, D., Foster, J., Tounsi, L.: Aspect-based polarity classification for SemEval task 4. In: SemEval@COLING 2014, pp. 223–229 (2014)

    Google Scholar 

  6. Vo, D.-T., Zhang, Y.: Target-dependent twitter sentiment classification with rich automatic features. In: IJCAI 2015, pp. 1347–1353 (2015)

    Google Scholar 

  7. Tang, D., Qin, B., Liu, T.: Aspect level sentiment classification with deep memory network. In: EMNLP 2016, pp. 214–224 (2016)

    Google Scholar 

  8. Ma, D., Li, S., Zhang, X., Wang, H.: Interactive attention networks for aspect-level sentiment classification. In: IJCAI 2017, pp. 4068–4074 (2017)

    Google Scholar 

  9. Chen, P., Sun, Z., Bing, L., Yang, W.: Recurrent attention network on memory for aspect sentiment analysis. In: EMNLP 2017, pp. 452–461 (2017)

    Google Scholar 

  10. Vaswani, A., et al.: Attention is all you need. In: NIPS 2017, pp. 5998–6008 (2017)

    Google Scholar 

  11. Zheng, S., Xia, R.: Left-center-right separated neural network for aspect-based sentiment analysis with rotatory attention. CoRR abs/1802.00892 (2018)

    Google Scholar 

  12. Tay, Y., Tuan, L.A., Hui, S.C.: Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis. In: AAAI 2018, pp. 5956–5963 (2018)

    Google Scholar 

  13. Huang, B., Ou, Y., Carley, K.M.: Aspect level sentiment classification with attention-over-attention neural networks. In: SBP-BRiMS 2018, pp. 197–206 (2018)

    Google Scholar 

  14. Xue W, Li T.: Aspect Based Sentiment Analysis with Gated Convolutional Networks.. In: ACL 2018. Association for Computational Linguistics, vol. 1, pp. 2514–2523 (2018)

    Google Scholar 

  15. Liu, F., Cohn, T., Baldwin, T.: Recurrent entity networks with delayed memory update for targeted aspect-based sentiment analysis. In: NAACL-HLT 2018, vol. 2, pp. 278–283 (2018)

    Google Scholar 

  16. Majumder, N., Poria, S., Gelbukh, A., Akhtar, S., Cambria, E., Ekbal, A.: IARM: inter-aspect relation modeling with memory networks in aspect-based sentiment analysis. In: EMNLP 2018, pp. 3402–3411 (2018)

    Google Scholar 

  17. Wu, S., Xu, Y., Wu, F., Yuan, Z., Huang, Y., Li, X.: Aspect-based sentiment analysis via fusing multiple sources of textual knowledge. Knowl. Based Syst. 183, 104868 (2019)

    Article  Google Scholar 

  18. Liang, B., Du, J., Xu, R., Li, B., Huang, H.: Context-aware embedding for targeted aspect-based sentiment analysis. In: ACL 2019, vol. 1, pp. 4678–4683 (2019)

    Google Scholar 

  19. Bao, L., Lambert, P., Badia, T.: Attention and lexicon regularized LSTM for aspect-based sentiment analysis. In: ACL 2019, vol. 2, pp. 253–259 (2019)

    Google Scholar 

  20. He, R., Lee, W.S., Ng, H.T., Dahlmeier, D.: An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. In: ACL 2019, vol.1, pp. 504–515 (2019)

    Google Scholar 

  21. Wang, X., Xu, G., Zhang, J., Sun, X., Wang, L., Huang, T.: Syntax-directed hybrid attention network for aspect-level sentiment analysis. IEEE Access 7, 5014–5025 (2019)

    Article  Google Scholar 

  22. Li, L., Liu, Y., Zhou, A.: Hierarchical attention based position-aware network for aspect-level sentiment analysis. In: CoNLL 2018, pp. 181–189 (2018)

    Google Scholar 

  23. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: KDD 2004, pp. 168–177 (2004)

    Google Scholar 

  24. Pennington, J., Socher, R., Manning, C.D.: GloVe: global vectors for word representation. In: EMNLP 2014, pp. 1532–1543 (2014)

    Google Scholar 

  25. Mikolov, T., Chen, K., Corrado, G., Dean, J.: Distributed representations of words and phrases and their compositionality. In: NIPS 2013, pp. 3111–3119 (2013)

    Google Scholar 

  26. Hochreiter, S., Urgen Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by National Nature Science Foundation of China (61976062), the Science and Technology Program of Guangzhou, China (No. 201904010303 and No. 202002030227) and the Special Funds for the Cultivation of Guangdong College Students’ Scientific and Technological Innovation (“Climbing Program” Special Funds, grant number: pdjh2019b0173).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xia Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zheng, Y., Li, X., Su, G., Ma, J., Ning, C. (2020). Position-aware Hybrid Attention Network for Aspect-Level Sentiment Analysis. In: Dou, Z., Miao, Q., Lu, W., Mao, J., Jia, G. (eds) Information Retrieval. CCIR 2020. Lecture Notes in Computer Science(), vol 12285. Springer, Cham. https://doi.org/10.1007/978-3-030-56725-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-56725-5_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-56724-8

  • Online ISBN: 978-3-030-56725-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics