Nikos Engonopoulos
ABSTRACT
We introduce ELS, a new method for entity-level sentiment classification using sequence modeling by Conditional Random Fields (CRF). The CRF is trained to identify the sentiment of each word in a document, which is then used to determine the sentiment for the entity, based on where it appears in the text. Due to its sequential nature, the CRF classifier performs better than the common bag-of-words approaches, especially when we target the local sentiment in small parts of a larger document. Identifying the sentiment about a specific entity, mentioned in a blog post or a larger product review, is a special case of such local sentiment classification. Furthermore, the proposed approach performs well even in short pieces of text, where bag-of-words approaches usually fail, due to the sparseness of the resulting feature vector. We have implemented and tested the proposed method on a publicly available benchmark corpus of short product reviews in English. The results that we present in this paper improve significantly upon published results on the same data, thus confirming our intuition about the approach.
- E. Breck, Y. Choi, and C. Cardie. Identifying expressions of opinion in context. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI-2007), Hyderabad, India, Jan. 2007. Google Scholar
Digital Library
- X. Ding and B. Liu. The utility of linguistic rules in opinion mining. In SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 811--812, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- M. Hu and B. Liu. Mining and summarizing customer reviews. In Proceedings of ACM Special Interest Group on Knowlenge Discovery and Data Mining, pages 168--177, 2004. Google ScholarDigital Library
- N. Jakob and I. Gurevych. Extracting Opinion Targets in a Single-and Cross-Domain Setting with Conditional Random Fields. In Proceedings of Empirical Methods in Natural Language Processing, pages 1035--1045, 2010. Google ScholarDigital Library
- J. Lafferty, F. Pereira, and A. McCallum. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In International Conference on Machine Learning, 2001. Google ScholarDigital Library
- C. D. Manning and H. Schütze. Foundations of Statistical Natural Language Processing. MIT Press, Cambridge, MA, 1999. Google ScholarDigital Library
- Y. Mao and G. Lebanon. Isotonic conditional random fields and local sentiment flow. In Advances in Neural Information Processing Systems, 2007.Google Scholar
- T. Nakagawa, K. Inui, and S. Kurohashi. Dependency tree-based sentiment classification using CRFs with hidden variables. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pages 786--794. Association for Computational Linguistics, 2010. Google ScholarDigital Library
- B. Pang and L. Lee. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1--2):1--135, 2008. Google ScholarDigital Library
- B. Pang, L. Lee, and S. Vaithyanathan. Thumbs up? sentiment classification using machine learning techniques. In Proceedings of Empirical Methods on Natural Language Processing., 6:79--86, 2002. Google ScholarDigital Library
- A.-M. Popescu and O. Etzioni. Extracting product features and opinions from reviews. In Proceedings of Empirical Methods on Natural Language Processing, pages 339--346, 2005. Google ScholarDigital Library
- K. Sadamitsu, S. Sekine, and M. Yamamot. Sentiment analysis based on probabilistic models using inter-sentence information. In Proceedings of the Sixth International Language Resources and Evaluation, 2008.Google Scholar
- M. Sharifi and W. Cohen. Finding domain specific polar words for sentiment classification. Presented in Language Technologies Institute Student Research Symposium, 2008.Google Scholar
- P. D. Turney. Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In Proceedings of the Fortieth Annual Meeting of the Association for Computational Linguistics, 2002. Google ScholarDigital Library
- P. D. Turney and M. L. Littman. Measuring praise and criticism: Inference of semantic orientation from association. ACM Transactions on Information Systems, 2003. Google ScholarDigital Library
- J. Wiebe and E. Riloff. Creating subjective and objective sentence classifiers from unannotated texts. Proceedings of the Conference on Computational Linguistics and Intelligent Text Processing, pages 486--497, 2005. Google ScholarDigital Library
- T. Wilson, J. Wiebe, and P. Hoffmann. Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of Empirical Methods on Natural Language Processing, pages 347--354, 2005. Google ScholarDigital Library
- H. Yu and V. Hatzivassiloglou. Towards answering opinion questions: Separating facts from opinions and identifying the polarity of opinion sentences. In Proceedings of Empirical Methods on Natural Language Processing., 2003. Google ScholarDigital Library
- J. Zhao, K. Liu, and G. Wang. Adding redundant features for CRFs-based sentence sentiment classification. In Proceedings of Empirical Methods in Natural Language Processing, pages 117--126, 2008. Google ScholarDigital Library
Index Terms
- ELS: a word-level method for entity-level sentiment analysis
Recommendations
Sentence Subjectivity Analysis in Social Domains
WI-IAT '13: Proceedings of the 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 01Subjectivity analysis recognizes the contextual polarity of opinions, attitudes, emotions, feelings etc. regarding products, services, topics, or issues. Subjectivity classification categorizes the given text as subjective or objective. While an ...
Domain customization for aspect-oriented opinion analysis with multi-level latent sentiment clues
CIKM '11: Proceedings of the 20th ACM international conference on Information and knowledge managementAspect-oriented opinion mining detects the reviewers' sentiment orientation (e.g. positive, negative or neutral) towards different product-features. Domain customization is a big challenge for opinion mining due to the accuracy loss across domains. In ...
Meta-level sentiment models for big social data analysis
People react to events, topics and entities by expressing their personal opinions and emotions. These reactions can correspond to a wide range of intensities, from very mild to strong. An adequate processing and understanding of these expressions has ...
Comments