LGLFF: A Lightweight Aspect-Level Sentiment Analysis Model Based on Local-Global Features
Authors: 
Hao Liang, Xiaopeng Cao, Kaili WangAuthors Info & Claims
Hao Liang, Xiaopeng Cao, Kaili WangAuthors Info & ClaimsPages 160 - 166
Abstract
Aspect-level sentiment analysis is highly dependent on local context. However, most models are overly concerned with global context and external semantic knowledge. This approach increases the training time of the models. We propose the LGLFF (Lightweight Global and Local Feature Fusion) model. Firstly, we introduce a Distilroberta pretrained model in the LGLFF to encode the global context. Secondly, we use the SRU++ (Simple Recurrent Unit) network to extract global features. Then we adjust the SRD (Semantic-Relative Distance) threshold size by different datasets, and use SRD to mask the global context to get the local context. Finally, we use the multi-head attention mechanism to learn the global and local context features. We do some experiments on three datasets: Twitter, Laptop, and Restaurant. The results show that our model performs better than other benchmark models.
References
[1]
Zhou J, Huang J X, Chen Q, Deep Learning for Aspect-Level Sentiment Classification: Survey, Vision, and Challenges[J]. Ieee Access, 2019, 7(99): 78454-78483.
[2]
Zeng B Q, Yang H, Xu R Y, LCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification[J]. Applied Sciences-Basel, 2019, 9(16): 3389.
[3]
Peters M, Neumann M, Iyyer M, Deep Contextualized Word Representations[C]. Proceeding of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018: 2227-2237.
[4]
Hoang M, Bihorac O A, Rouces J. Aspect-based sentiment analysis using BERT[C]. Proceedings of the 22nd nordic conference on computational linguistics, 2019: 187-196.
[5]
Gao Z J, Feng A, Song X Y, Target-Dependent Sentiment Classification With BERT[J]. Ieee Access, 2019, 7: 154290-154299.
[6]
Song Y, Wang J, Tao J, Attentional Encoder Network for Targeted Sentiment Classification[J]. CoRR, 2019, abs/1902.09314.
[7]
Li X, Fu X, Xu G, Enhancing BERT Representation With Context-Aware Embedding for Aspect-Based Sentiment Analysis[J]. IEEE Access, 2020, 8(99): 46868-46876.
[8]
Tang D, Qin B, Feng X, Effective LSTMs for Target-Dependent Sentiment Classification[J]. Computer Science, 2015.
[9]
Wang Y, Huang M, Zhu X, Attention-based LSTM for Aspect-level Sentiment Classification[C]. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016.
[10]
Ma D, Li S, Zhang X, Interactive Attention Networks for Aspect-Level Sentiment Classification[C]. Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017: 4068–4074.
[11]
Sanh V, Debut L, Chaumond J, DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter[J]. CoRR, 2019, abs/1910.01108.
[12]
Lei T. When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute[J], 2021.
[13]
Xu H, Liu B, Shu L, BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis[J]. CoRR, 2019, abs/1904.02232.
[14]
Phan M H, Ogunbona P O. Modelling Context and Syntactical Features for Aspect-based Sentiment Analysis[C]. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020.
[15]
Alaa Hamouda, Mahmoud Marei, and Mohamed Rohaim, "Building Machine Learning Based Senti-word Lexicon for Sentiment Analysis," Journal of Advances in Information Technology, Vol. 2, No. 4, pp. 199-203, November, 2011.
[16]
Dahai Guo, "Tracking Student Sentiment from Social Media," Vol. 6, No. 2, pp. 80-83, May, 2015.
[17]
Xiaoyi Zhao and Yukio Ohsawa, "Sentiment Analysis on the Online Reviews Based on Hidden Markov Model," Vol. 9, No. 2, pp. 33-38, May 2018.
[18]
H K Darshan, Aditya R Shankar, B S Harish, and Keerthi Kumar H M, "Exploiting RLPI for Sentiment Analysis on Movie Reviews," Journal of Advances in Information Technology, Vol. 10, No. 1, pp. 14-19, February 2019.
[19]
Mohammad Darwich, Shahrul Azman Mohd Noah, Nazlia Omar, Nurul Aida Osman, and Ibrahim Said Ahmad, "Quantifying the Natural Sentiment Strength of Polar Term Senses Using Semantic Gloss Information and Degree Adverbs," Journal of Advances in Information Technology, Vol. 11, No. 3, pp. 109-118, August 2020.
[20]
Sirisha Velampalli, Chandrashekar Muniyappa, and Ashutosh Saxena, "Performance Evaluation of Sentiment Analysis on Text and Emoji Data Using End-to-End, Transfer Learning, Distributed and Explainable AI Models," Journal of Advances in Information Technology, Vol. 13, No. 2, pp. 167-172, April 2022.
[21]
LI R, CHEN H, FENG F, Dual Graph Convolutional Networks for Aspect-based Sentiment Analysis[C]//Pro- ceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Online, Aug 1-6, 2021: 6319-6329.
Index Terms
- LGLFF: A Lightweight Aspect-Level Sentiment Analysis Model Based on Local-Global Features
Recommendations
MFF: Aspect-level sentiment analysis model based on Muti-Feature Fusion
AIPR '23: Proceedings of the 2023 6th International Conference on Artificial Intelligence and Pattern RecognitionSentiment analysis in conversation is an important method for human-computer interaction systems. Aspect-level sentiment analysis is an important research direction in sentiment analysis. Current sentiment analysis models ignore multi-feature fusion, ...
Towards jointly extracting aspects and aspect-specific sentiment knowledge
CIKM '12: Proceedings of the 21st ACM international conference on Information and knowledge managementIn this paper, we aim to jointly extract aspects and aspect-specific sentiment knowledge from online reviews, where the sentiment knowledge refers to the aspect-specific opinion words along with their aspect-aware sentiment polarities. To this end, we ...
Aspect-level sentiment analysis with aspect-specific context position information
AbstractIn recent years, an increasing number of researchers have focused on the aspect-level sentiment analysis in the field of natural language processing. A coarse-grained sentiment analysis at the document level and a sentiment analysis at ...
Comments
Information & Contributors
Information
Published In
September 2022
1221 pages
ISBN:9781450396899
DOI:10.1145/3573942
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 May 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- Key Research and Development Program of Shaanxi Province
Conference
AIPR 2022
AIPR 2022: 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
September 23 - 25, 2022
Xiamen, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 31Total Downloads
- Downloads (Last 12 months)12
- Downloads (Last 6 weeks)2
Reflects downloads up to 01 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format