Skip to main content

AOPSS: A Joint Learning Framework for Aspect-Opinion Pair Extraction as Semantic Segmentation

  • Conference paper
  • First Online:
Web and Big Data (APWeb-WAIM 2022)

Abstract

Aspect-opinion pair extraction (AOPE) task, aiming at extracting aspect terms and their corresponding opinion terms in pairs, has caused widespread attention in recent years. Most studies focus on incorporating external knowledge, such as syntactic information. However, they are limited by the inadequate ability to capture long-distance information, and the utilization of external knowledge is more costly. In this paper, we propose AOPSS, a joint learning framework, to explore the AOPE task as semantic segmentation. As in most prior studies, we divide the AOPE task into two subtasks: entity recognition and relation detection. Specifically, AOPSS can synchronously capture task-invariant and task-specific features for the two subtasks without integrating any additional knowledge. Furthermore, we consider the interaction between entity and relation feature representations, which can improve the mutual heuristic effect for the two subtasks. Experimental results illustrate that our method achieves state-of-the-art performance on four public datasets, and we take further analysis to demonstrate the effectiveness of our approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    BCELoss\((x, y) = -(ylogx + (1 - y)log(1 - x))\).

  2. 2.

    https://github.com/google-research/bert.

  3. 3.

    https://nlp.stanford.edu/projects/glove.

References

  1. Chen, S., Liu, J., Wang, Y., Zhang, W., Chi, Z.: Synchronous double-channel recurrent network for aspect-opinion pair extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 6515–6524 (2020)

    Google Scholar 

  2. Dai, H., Song, Y.: Neural aspect and opinion term extraction with mined rules as weak supervision. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5268–5277 (2019)

    Google Scholar 

  3. Fan, Z., Wu, Z., Dai, X.Y., Huang, S., Chen, J.: Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 2509–2518 (2019)

    Google Scholar 

  4. Gao, L., Wang, Y., Liu, T., Wang, J., Zhang, L., Liao, J.: Question-driven span labeling model for aspect-opinion pair extraction. In: Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, pp. 12875–12883 (2021)

    Google Scholar 

  5. Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177 (2004)

    Google Scholar 

  6. Klinger, R., Cimiano, P.: Bi-directional inter-dependencies of subjective expressions and targets and their value for a joint model. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pp. 848–854 (2013)

    Google Scholar 

  7. Lafferty, J.D., McCallum, A., Pereira, F.C.N.: Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 282–289 (2001)

    Google Scholar 

  8. Liu, Q., Chen, B., Lou, J.G., Zhou, B., Zhang, D.: Incomplete utterance rewriting as semantic segmentation. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp. 2846–2857 (2020)

    Google Scholar 

  9. Pontiki, M., et al.: SemEval-2016 task 5: Aspect based sentiment analysis. In: Proceedings of the 10th International Workshop on Semantic Evaluation, pp. 19–30 (2016)

    Google Scholar 

  10. Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., Androutsopoulos, I.: SemEval-2015 task 12: Aspect based sentiment analysis. In: Proceedings of the 9th International Workshop on Semantic Evaluation, pp. 486–495 (2015)

    Google Scholar 

  11. Pontiki, M., Galanis, D., Pavlopoulos, J., Papageorgiou, H., Androutsopoulos, I., Manandhar, S.: SemEval-2014 task 4: Aspect based sentiment analysis. In: Proceedings of the 8th International Workshop on Semantic Evaluation, pp. 27–35 (2014)

    Google Scholar 

  12. Popescu, A.M., Etzioni, O.: Extracting product features and opinions from reviews. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, pp. 339–346 (2005)

    Google Scholar 

  13. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention, pp. 234–241 (2015)

    Google Scholar 

  14. Wang, W., Pan, S.J., Dahlmeier, D., Xiao, X.: Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 3316–3322 (2017)

    Google Scholar 

  15. Wang, Y., Chen, W., Pi, D., Yue, L.: Adaptive multi-hop reading on memory neural network with selective coverage mechanism for medication recommendation. Acta Electron. Sin. 50(4), 943–953 (2022)

    Google Scholar 

  16. Wang, Y., Chen, W., Pi, D., Yue, L., Xu, M., Li, X.: Multi-Hop Reading on Memory Neural Network with Selective Coverage for Medication Recommendation, In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 2020–2029 (2021)

    Google Scholar 

  17. Wu, S., Fei, H., Ren, Y., Ji, D., Li, J.: Learn from syntax: Improving pair-wise aspect and opinion terms extraction with rich syntactic knowledge. In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, pp. 3957–3963 (2021)

    Google Scholar 

  18. Wu, S., Fei, H., Ren, Y., Li, B., Li, F., Ji, D.: High-order pair-wise aspect and opinion terms extraction with edge-enhanced syntactic graph convolution. IEEE/ACM Trans. Audio Speech Lang. Process. 29, 2396–2406 (2021)

    Article  Google Scholar 

  19. Wu, Z., Ying, C., Zhao, F., Fan, Z., Dai, X., Xia, R.: Grid tagging scheme for aspect-oriented fine-grained opinion extraction. In: Findings of the Association for Computational Linguistics: EMNLP 2020, pp. 2576–2585 (2020)

    Google Scholar 

  20. Xu, H., Liu, B., Shu, L., Yu, P.S.: Double embeddings and CNN-based sequence labeling for aspect extraction. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 592–598 (2018)

    Google Scholar 

  21. Yang, B., Cardie, C.: Joint inference for fine-grained opinion extraction. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, pp. 1640–1649 (2013)

    Google Scholar 

  22. Yin, Y., Wei, F., Dong, L., Xu, K., Zhang, M., Zhou, M.: Unsupervised word and dependency path embeddings for aspect term extraction. In: Proceedings of the 25th International Joint Conference on Artificial Intelligence, pp. 2979–2985 (2016)

    Google Scholar 

  23. Yue, L., Shi, Z., Han, J., Wang, S., Chen, W., Zuo, W.: Multi-factors based sentence ordering for cross-document fusion from multimodal content. Neurocomputing 253, 6–14 (2017)

    Article  Google Scholar 

  24. Yue, L., Tian, D., Chen, W., Han, X., Yin, M.: Deep learning for heterogeneous medical data analysis. World Wide Web 23(5), 2715–2737 (2020)

    Article  Google Scholar 

  25. Yue, L., Zhao, H., Yang, Y., Tian, D., Zhao, X., Yin, M.: A mimic learning method for disease risk prediction with incomplete initial data. In: International Conference on Database Systems for Advanced Applications, pp. 392–396 (2019)

    Google Scholar 

  26. Zhang, C., et al.: Towards better generalization for neural network-based sat solvers. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 199–210 (2022)

    Google Scholar 

  27. Zhang, N., et al.: Document-level relation extraction as semantic segmentation. In: Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, pp. 3999–4006 (2021)

    Google Scholar 

  28. Zhang, Y., Peng, T., Han, R., Han, J., Yue, L., Liu, L.: Synchronously tracking entities and relations in a syntax-aware parallel architecture for aspect-opinion pair extraction. Appli. Intell. 1–16 (2022)

    Google Scholar 

  29. Zhao, H., Huang, L., Zhang, R., Lu, Q., Xue, H.: SpanMlt: A span-based multi-task learning framework for pair-wise aspect and opinion terms extraction. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3239–3248 (2020)

    Google Scholar 

  30. Zhou, Y., et al.: Graph convolutional networks for target-oriented opinion words extraction with adversarial training. In: 2020 International Joint Conference on Neural Networks, pp. 1–7 (2020)

    Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under grant No. 61872163 and 61806084, Jilin Province Key Scientific and Technological Research and Development Project under grant No. 20210201131GX, and Jilin Provincial Education Department project under grant No. JJKH20190160KJ.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tao Peng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, C., Peng, T., Zhang, Y., Yue, L., Liu, L. (2023). AOPSS: A Joint Learning Framework for Aspect-Opinion Pair Extraction as Semantic Segmentation. In: Li, B., Yue, L., Tao, C., Han, X., Calvanese, D., Amagasa, T. (eds) Web and Big Data. APWeb-WAIM 2022. Lecture Notes in Computer Science, vol 13422. Springer, Cham. https://doi.org/10.1007/978-3-031-25198-6_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-25198-6_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-25197-9

  • Online ISBN: 978-3-031-25198-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics