Guojun Lu
ABSTRACT
Aspect-level sentiment classification is a most pronounced approach, which is defined as an automated technique to extract significant information from a large number of texts. However, current research still has limitations in ALSC tasks (e.g. accuracy of dependency parsing and overlook of commonsense knowledge). In this work, we propose a syntactic knowledge and commonsense knowledge adapter based network, which deals with the position information, syntactic structure and external knowledge, respectively. The performance of our model is evaluated on the three benchmark datasets. Experimental results demonstrate that our model is a best alternative in ALSC tasks compared with the state-of-the-art methods.
- Erik Cambria, Soujanya Poria, Rajiv Bajpai, and Bjoern Schuller. 2016. SenticNet 4: A Semantic Resource for Sentiment Analysis Based on Conceptual Primitives. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee, Osaka, Japan, 2666–2677.Google Scholar
- Chenhua Chen, Zhiyang Teng, and Yue Zhang. 2020. Inducing Target-Specific Latent Structures for Aspect Sentiment Classification. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 5596–5607. https://doi.org/10.18653/v1/2020.emnlp-main.451Google ScholarCross Ref
- Danqi Chen and Christopher D Manning. 2014. A fast and accurate dependency parser using neural networks. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 740–750. https://doi.org/10.3115/v1/D14-1082Google ScholarCross Ref
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171–4186. https://doi.org/10.18653/v1/N19-1242Google Scholar
- Li Dong, Furu Wei, Chuanqi Tan, Duyu Tang, Ming Zhou, and Ke Xu. 2014. Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics, Baltimore, Maryland, 49–54. https://doi.org/10.3115/v1/P14-2009Google ScholarCross Ref
- Li Dong, Furu Wei, Chuanqi Tan, Duyu Tang, Ming Zhou, and Ke Xu. 2014. Adaptive recursive neural network for target-dependent twitter sentiment classification. In Proceedings of the 52nd annual meeting of the association for computational linguistics (volume 2: Short papers). 49–54. https://doi.org/10.3115/v1/P14-2009Google ScholarCross Ref
- Timothy Dozat and Christopher D Manning. 2016. Deep biaffine attention for neural dependency parsing. arXiv preprint arXiv:1611.01734(2016).Google Scholar
- A Graves and J Schmidhuber. 2005. Framewise phoneme classification with bidirectional LSTM and other neural network architectures.Neural Networks: the Official Journal of the International Neural Network Society 18, 5-6 (2005), 602–610.Google ScholarDigital Library
- Binxuan Huang and Kathleen M Carley. 2019. Syntax-aware aspect level sentiment classification with graph attention networks. arXiv preprint arXiv:1909.02606(2019). https://doi.org/10.18653/v1/D19-1549Google Scholar
- Binxuan Huang, Yanglan Ou, and Kathleen M Carley. 2018. Aspect level sentiment classification with attention-over-attention neural networks. In International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation. Springer, 197–206. https://doi.org/10.1007/978-3-319-93372-6_22Google ScholarCross Ref
- D. Kingma and J. Ba. 2014. Adam: A Method for Stochastic Optimization. Computer Science (2014).Google Scholar
- Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In International Conference on Learning Representations (ICLR).Google Scholar
- Yukun Ma, Haiyun Peng, and Erik Cambria. 2018. Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM. In Thirty-second AAAI conference on artificial intelligence.Google Scholar
- Jinjie Ni, Tom Young, Vlad Pandelea, Fuzhao Xue, Vinay Adiga, and Erik Cambria. 2021. Recent Advances in Deep Learning-based Dialogue Systems. arXiv preprint arXiv:2105.04387(2021).Google Scholar
- Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532–1543.Google ScholarCross Ref
- Maria Pontiki, Dimitris Galanis, John Pavlopoulos, Harris Papageorgiou, and Suresh Manandhar. 2014. SemEval-2014 Task 4: Aspect Based Sentiment Analysis. Proceedings of International Workshop on Semantic Evaluation at (2014). https://doi.org/10.3115/v1/S14-2004Google ScholarCross Ref
- Kim Schouten and Flavius Frasincar. 2015. Survey on aspect-level sentiment analysis. IEEE Transactions on Knowledge and Data Engineering 28, 3(2015), 813–830. https://doi.org/10.1109/TKDE.2015.2485209Google ScholarDigital Library
- Kai Sun, Richong Zhang, Samuel Mensah, Yongyi Mao, and Xudong Liu. 2019. Aspect-level sentiment analysis via convolution over dependency tree. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 5679–5688. https://doi.org/10.18653/v1/D19-1569Google ScholarCross Ref
- Duyu Tang, Bing Qin, and Ting Liu. 2016. Aspect Level Sentiment Classification with Deep Memory Network. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Austin, Texas, 214–224. https://doi.org/10.18653/v1/D16-1021Google ScholarCross Ref
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 6000–6010.Google Scholar
- Kai Wang, Weizhou Shen, Yunyi Yang, Xiaojun Quan, and Rui Wang. 2020. Relational Graph Attention Network for Aspect-based Sentiment Analysis. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 3229–3238. https://doi.org/10.18653/v1/2020.acl-main.295Google ScholarCross Ref
- Ruize Wang, Duyu Tang, Nan Duan, Zhongyu Wei, Xuanjing Huang, Guihong Cao, Daxin Jiang, Ming Zhou, 2020. K-adapter: Infusing knowledge into pre-trained models with adapters. arXiv preprint arXiv:2002.01808(2020).Google Scholar
- Jiangfeng Zeng, Xiao Ma, and Ke Zhou. 2019. Enhancing attention-based LSTM with position context for aspect-level sentiment classification. IEEE Access 7(2019), 20462–20471. https://doi.org/10.1109/ACCESS.2019.2893806Google ScholarCross Ref
- Chen Zhang, Qiuchi Li, and Dawei Song. 2019. Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 4568–4578. https://doi.org/10.18653/v1/D19-1464Google Scholar
- Mi Zhang and Tieyun Qian. 2020. Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 3540–3549. https://doi.org/10.18653/v1/2020.emnlp-main.286Google ScholarCross Ref
- Ningyu Zhang, Shumin Deng, Zhanlin Sun, Guanying Wang, Xi Chen, Wei Zhang, and Huajun Chen. 2019. Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 3016–3025. https://doi.org/10.18653/v1/N19-1306Google ScholarCross Ref
- Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu. 2019. ERNIE: Enhanced Language Representation with Informative Entities. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 1441–1451. https://doi.org/10.18653/v1/P19-1139Google ScholarCross Ref
- Yaowei Zheng, Richong Zhang, Samuel Mensah, and Yongyi Mao. 2020. Replicate, walk, and stop on syntax: an effective neural network model for aspect-level sentiment classification. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 9685–9692. https://doi.org/10.1609/aaai.v34i05.6517Google ScholarCross Ref
- Jie Zhou, Jimmy Xiangji Huang, Qinmin Vivian Hu, and Liang He. 2020. SK-GCN: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Systems 205 (2020), 106292. https://doi.org/10.1016/j.knosys.2020.106292Google ScholarCross Ref
- SCAN:Syntactic Knowledge and Commonsense Knowledge Adapter Based Network for Aspect-level Sentiment Classification
Recommendations
Graph Attention Network with Dependency Parsing for Aspect-level Sentiment Classification
CSSE '21: Proceedings of the 4th International Conference on Computer Science and Software EngineeringThe purpose of Aspect-level Sentiment Classification (ASC) is to judge the sentiment polarity of words or phrases with subjective emotions in a sentence. The existing mainstram method is to extract the context semantics of aspect targets words based on ...
Commonsense knowledge graph-based adapter for aspect-level sentiment classification
Highlights- A commonsense knowledge graph-based adapter (CKGA) is proposed.
- A large-scale commonsense knowledge graph is set as the source of CKGA.
- CKGA can be adapted to other ALSC works without modifying the original models.
- Experiments ...
AbstractAttention- and graph-based models are widely applied to existing aspect-level sentiment classification (ALSC) tasks. In spite of the effectiveness, most of these studies ignore commonsense knowledge of aspects. When sentences have the same ...
Building a Concept-Level Sentiment Dictionary Based on Commonsense Knowledge
Sentiment dictionaries are essential for research in the sentiment analysis field. A two-step method integrates iterative regression and random walk with in-link normalization to build a concept-level sentiment dictionary. The approach uses ConceptNet ...
Comments