Abstract
In aspect-based sentiment analysis, target-oriented opinion words extraction (TOWE) aims to extract opinion words based on aspect terms. Most current methods used in TOWE tasks only focus on explicit aspects and tend to overlook the implicit aspects, leading to a bias in the sample selection process and incomplete modeling of the TOWE tasks. Therefore, it is essential to consider both explicit and implicit aspects simultaneously in the modeling process of TOWE tasks. This paper proposes an aspect-opinion joint extraction (AOJE) model composed of an aspect term extraction unit (ATEU) and a target-oriented opinion words extraction unit (TOWEU). ATEU first is responsible for extracting aspect terms and converting them into prompt templates. TOWEU uses these templates to obtain opinion words for specific targets. This model is trained and evaluated on global space, including explicit and implicit aspects. This approach effectively addresses the issue of sample selection bias. The proposed AOJE method performs better than existing methods by an average of 4.06% on the Macro-F1 score on the SemEval 14-16 datasets. In particular, the AOJE model shows significant improvements compared to the IOG (Inward-Outward LSTM+Global context) model, with Macro-F1 scores increasing by 9.00%, 8.48%, 7.41%, and 9.21% on the Laptop 14, Restaurant 14, Restaurant 15, and Restaurant 16 datasets, respectively. These experimental results indicate that the AOJE model trained on global space significantly enhances the performance of TOWE and improves generalization capabilities.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The datasets generated during and analyzed during the current study are available from the corresponding author upon reasonable request.
References
Poria S, Hazarika D, Majumder N, Mihalcea R (2020) Beneath the tip of the iceberg: Current challenges and new directions in sentiment analysis research. IEEE Trans Affect Comput 2005(357):1–30
Zhang W, Li X, Deng Y, Bing L, Lam W (2023) A survey on aspect-based sentiment analysis: Tasks, methods, and challenges. IEEE Trans Knowl Data Eng 35(11):11019–11038
Fan Z, Wu Z, Dai X, Huang S, Chen J (2019) Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, Vol 1
Li X, Bing L, Li P, Lam W (2019) A unified model for opinion target extraction and target sentiment prediction. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 6714–6721
Zhang Y, Peng T, Han R, Han J, Yue L, Liu L (2022) Synchronously tracking entities and relations in a syntax-aware parallel architecture for aspect-opinion pair extraction. Appl Intell 52(13):15210–15225
Jiang J, Wang A, Aizawa A (2021) Attention-based relational graph convolutional network for target-oriented opinion words extraction. In: Paper presented at the 16th conference of the european chapter of the association for computational linguistics: main volume, EACL 2021, Online, April 19-23, 2021
Wu Z, Zhao F, Dai X, Huang S, Chen J (2020) Latent opinions transfer network for target-oriented opinion words extraction. In: The thirty-fourth AAAI conference on artificial intelligence, AAAI 2020, the thirty-second innovative applications of artificial intelligence conference, IAAI 2020, the tenth AAAI symposium on educational advances in artificial intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020, pp 9298–9305
Zhang J, Li F, Zhang Z, Xu G, Wang Y, Wang X, Zhang Y (2021) Integrate syntax information for target-oriented opinion words extraction with target-specific graph convolutional network. Neurocomputing 440:321–335
Shang W, Chai J, Cao J, Lei X, Zhu H, Fan Y, Ding W (2024) Aspect-level sentiment analysis based on aspect-sentence graph convolution network. Inf Fusion 104:102143
Zhang M, Palade V, Wang Y, Ji Z (2021) Attention-based word embeddings using artificial bee colony algorithm for aspect-level sentiment classification. Inf Sci 545:713–738
Zhang J, Zhang Z, Guo Z, Jin L, Liu K, Liu Q (2021) Enhancement of target-oriented opinion words extraction with multiview-trained machine reading comprehension model. Comput Intell Neurosci 2021(6645871):1–13
Zhao M, Yang J, Qu L (2023) A multi-task learning model with graph convolutional networks for aspect term extraction and polarity classification. Appl Intell 53(6):6585–6603
Liu B, Lin T, Li M (2023) Improving aspect term extraction via span-level tag data augmentation. Appl Intell 53(3):3207–3220
Haffar R, Sánchez D, Domingo-Ferrer J (2023) Explaining predictions and attacks in federated learning via random forests. Appl Intell 53(1):169–185
Lohith C, Chandramouli H, Balasingam U, Kumar SA (2023) Aspect oriented sentiment analysis on customer reviews on restaurant using the LDA and BERT method. SN Comput Sci 4(4):399
Özyurt B, Akcayol MA (2021) A new topic modeling based approach for aspect extraction in aspect based sentiment analysis: SS-LDA. Expert Syst Appl 168:114231
Liu P, Joty SR, Meng HM (2015) Fine-grained opinion mining with recurrent neural networks and word embeddings. In: Proceedings of the 2015 conference on empirical methods in natural language processing, EMNLP 2015, Lisbon, Portugal, September 17-21, 2015, pp 1433–1443
Pota M, Marulli F, Esposito M, Pietro GD, Fujita H (2019) Multilingual POS tagging by a composite deep architecture based on character-level features and on-the-fly enriched word embeddings. Knowl Based Syst 164:309–323
Venugopalan M, Gupta D (2022) An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis. Knowl Based Syst 246:108668
Chen Y, Lin M, He Z, Polat K, Alhudhaif A, Alenezi F (2023) Consistency- and dependence-guided knowledge distillation for object detection in remote sensing images. Expert Syst Appl 229:120519
Chen H, Lin M, Liu J, Yang H, Zhang C, Xu Z (2024) NT-DPTC: A non-negative temporal dimension preserved tensor completion model for missing traffic data imputation. Inf Sci 653:119797
Zhong M, Lin M, He Z (2023) Dynamic multi-scale topological representation for enhancing network intrusion detection. Comput Secur 135:103516
Xu X, Lin M, Luo X, Xu Z (2023) Hrst-lr: A hessian regularization spatio-temporal low rank algorithm for traffic data imputation. IEEE Trans Intell Transp Syst 24(10):11001–11017
Bensoltane R, Zaki T (2023) Combining BERT with tcn-bigru for enhancing arabic aspect category detection. J Intell Fuzzy Syst 44(3):4123–4136
Wei Y, Zhang H, Fang J, Wen J, Ma J, Zhang G (2021) Joint aspect terms extraction and aspect categories detection via multi-task learning. Expert Syst Appl 174:114688
Gu S, Zhang L, Hou Y, Song Y (2018) A position-aware bidirectional attention network for aspect-level sentiment analysis. In: Proceedings of the 27th international conference on computational linguistics, COLING 2018, Santa Fe, New Mexico, USA, August 20-26, 2018
Hu M, Liu B (2004) Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, Washington, USA, August 22-25, 2004, pp 168–177
Diwali A, Dashtipour K, Saeedi K, Gogate M, Cambria E, Hussain A (2022) Arabic sentiment analysis using dependency-based rules and deep neural networks. Appl Soft Comput 127:109377
Li W, Yin S, Pu T (2022) Lexical attention and aspect-oriented graph convolutional networks for aspect-based sentiment analysis. J Intell Fuzzy Syst 42(3):1643–1654
Edara DC, Sistla V, Kolli VKK (2022) Deep finesse network model with multichannel syntactic and contextual features for target-specific sentiment classification. Appl Intell 52(8):8664–8684
Aslam A, Sargano AB, Habib Z (2023) Attention-based multimodal sentiment analysis and emotion recognition using deep neural networks. Appl Soft Comput 144:110494
Tiwari P, Zhang L, Qu Z, Muhammad G (2024) Quantum fuzzy neural network for multimodal sentiment and sarcasm detection. Inf Fusion 103:102085
Jabbour CJC, Janeiro RC, Sousa Jabbour ABL, Junior JAG, Salgado MH, Jugend D (2020) Social aspects of sustainable supply chains: unveiling potential relationships in the brazilian context. Ann Oper Res 290(1):327–341
Dai H, Song Y (2019) Neural aspect and opinion term extraction with mined rules as weak supervision. In: The 57th conference of the association for computational linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Vol 1
Dai Y, Wang P, Zhu X (2022) Reasoning over multiplex heterogeneous graph for target-oriented opinion words extraction. Knowl Based Syst 236:107723
Dai C, Shen B, Yan F (2023) A joint model for target-oriented opinion words extraction and sentiment classification. J Inf Knowl Manag 22(3):2250097–1225009716
Wasi NA, Abulaish M (2024) SKEDS - an external knowledge supported logistic regression approach for document-level sentiment classification. Expert Syst Appl 238(Part E):121987
Lei Y, Li Y (2023) A novel scheme of domain transfer in document-level cross-domain sentiment classification. J Inf Sci 49(3):567–581
Venugopalan M, Gupta D (2022) An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis. Knowl Based Syst 246:108668
Zhang Q, Shi L, Liu P, Zhu Z, Xu L (2023) Retraction note: ICDN: integrating consistency and difference networks by transformer for multimodal sentiment analysis. Appl Intell 53(16):19808
Ma S, Zhang T, Zhao Y, Kang Y, Bai P (2023) TCLN: A transformer-based Conv-LSTM network for multivariate time series forecasting. Appl Intell 53(23):28401–28417
Li Y, Wang F, Zhong S-H (2022) Training entire-space models for target-oriented opinion words extraction. In: SIGIR ’22: The 45th international ACM SIGIR conference on research and development in information retrieval, Madrid, Spain, July 11 - 15, 2022
Zhuang L, Jing F, Zhu X (2006) Movie review mining and summarization. In: The Proceedings of the 2006 ACM CIKM International Conference on Information and Knowledge Management, Arlington, Virginia, USA, November 6-11, 2006
Zhao Q, Mo Z, Fan M (2023) POS-ATAEPE-BiLSTM: an aspect-based sentiment analysis algorithm considering part-of-speech embedding. Appl Intell 53(22):27440–27458
Tang D, Qin B, Feng X, Liu T (2016) Effective LSTMs for target-dependent sentiment classification. In: The 26th International Conference on Computational Linguistics, December 11-16, 2016, Osaka, Japan
Ying C, Wu Z, Dai X, Huang S, Chen J (2020) Opinion transmission network for jointly improving aspect-oriented opinion words extraction and sentiment classification. In: The natural language processing and chinese computing - 9th CCF international conference, NLPCC 2020, Zhengzhou, China, October 14-18, 2020, Proceedings, Part I
Veyseh APB, Nouri N, Dernoncourt F, Dou D, Nguyen TH (2020) Introducing syntactic structures into target opinion word extraction with deep learning. In: The 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020
Acknowledgements
The authors thank the reviewers’ and editors’ helpful comments and valuable suggestions, which have improved the quality of our manuscript. This work is partially supported by the Sichuan Science and Technology Program (Nos. 2022YFG0378, 2023YFS0424, 2023YFQ0044, and 2023YFH0058), Yibin Science and Technology Program (2023SF004), and the Engineering Research Center for ICH Digitalization and Multi-source Information Fusion (Fujian Polytechnic Normal University), Fujian Province University (G3-KF2022).
Author information
Authors and Affiliations
Contributions
Jiamin Huang: Methodology, Software, Data curation, Writing-original, Writing-review & editing, draft. Xianyong Li: Supervision, Writing-review & editing, Funding acquisition, Formal analysis. Yajun Du: Funding acquisition, Investigation, Validation. Yongquan Fan: Formal analysis, Software. Dong Huang: Formal analysis, Software. Xiaoliang Chen: Funding acquisition, Formal analysis. All authors contributed to the manuscript revision and read and approved the submitted version.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Ethical and informed consent for data used
All sources of funding are our research projects. There are no potential conflicts of interest. Human Participants and Animals do not involve in this research. Informed consent for data used has been included in this study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Huang, J., Li, X., Du, Y. et al. An aspect-opinion joint extraction model for target-oriented opinion words extraction on global space. Appl Intell 55, 23 (2025). https://doi.org/10.1007/s10489-024-05865-5
Accepted:
Published:
DOI: https://doi.org/10.1007/s10489-024-05865-5