ABSTRACT
Opinion summarization is the task of summarizing opinions expressed for an entity or a product. Traditionally, all approaches use customer reviews or ratings to extract opinions and generate summaries. In this work, we propose using four sources of information: product description, product specification, customer reviews, and question-answers for aspect-sentiment-based opinion summarization. We use a transfer-learning approach to fine-tune a pre-trained model to generate summaries. Our experiments demonstrate the importance of all the four information sources resulting in improved quality of summaries. More specifically, product description and customer reviews contribute to detecting aspects and generating aspect-level and general summaries. Product specifications help in enriching the aspects whereas question-answers provide additional information. We make our annotated dataset containing the four information sources publicly available.
- Reinald Kim Amplayo, Stefanos Angelidis, and Mirella Lapata. 2021. Aspect-controllable opinion summarization. arXiv preprint arXiv:2109.03171(2021).Google Scholar
- Stefanos Angelidis, Reinald Kim Amplayo, Yoshihiko Suhara, Xiaolan Wang, and Mirella Lapata. 2021. Extractive opinion summarization in quantized transformer spaces. Transactions of the Association for Computational Linguistics 9 (2021), 277–293.Google ScholarCross Ref
- Stefanos Angelidis and Mirella Lapata. 2018. Multiple instance learning networks for fine-grained sentiment analysis. Transactions of the Association for Computational Linguistics 6 (2018), 17–31.Google ScholarCross Ref
- Stefanos Angelidis and Mirella Lapata. 2018. Summarizing opinions: Aspect extraction meets sentiment prediction and they are both weakly supervised. arXiv preprint arXiv:1808.08858(2018).Google Scholar
- Arthur Bražinskas, Mirella Lapata, and Ivan Titov. 2019. Unsupervised opinion summarization as copycat-review generation. arXiv preprint arXiv:1911.02247(2019).Google Scholar
- Arthur Bražinskas, Mirella Lapata, and Ivan Titov. 2021. Learning Opinion Summarizers by Selecting Informative Reviews. arXiv preprint arXiv:2109.04325(2021).Google Scholar
- Giuseppe Carenini, Jackie Chi Kit Cheung, and Adam Pauls. 2013. Multi-document summarization of evaluative text. Computational Intelligence 29, 4 (2013), 545–576.Google ScholarCross Ref
- Giuseppe Carenini, Raymond Ng, and Adam Pauls. 2006. Multi-Document Summarization of Evaluative Text. In 11th Conference of the European Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, Trento, Italy, 305–312. https://aclanthology.org/E06-1039Google Scholar
- Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement 20, 1 (1960), 37–46.Google Scholar
- Giuseppe Di Fabbrizio, Amanda Stent, and Robert Gaizauskas. 2014. A hybrid approach to multi-document summarization of opinions in reviews. In Proceedings of the 8th International Natural Language Generation Conference (INLG). 54–63.Google ScholarCross Ref
- Kavita Ganesan, ChengXiang Zhai, and Jiawei Han. 2010. Opinosis: A graph based approach to abstractive summarization of highly redundant opinions. (2010).Google Scholar
- Ruidan He, Wee Sun Lee, Hwee Tou Ng, and Daniel Dahlmeier. 2017. An unsupervised neural attention model for aspect extraction. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 388–397.Google ScholarCross Ref
- Minqing Hu and Bing Liu. 2004. Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. 168–177.Google ScholarDigital Library
- Loshchilov Ilya, Hutter Frank, 2019. Decoupled weight decay regularization. Proceedings of ICLR (2019).Google Scholar
- Wenjun Ke, Jinhua Gao, Huawei Shen, and Xueqi Cheng. 2022. ConsistSum: Unsupervised Opinion Summarization with the Consistency of Aspect, Sentiment and Semantic. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 467–475.Google ScholarDigital Library
- Jim Keeler and David Rumelhart. 1991. A self-organizing integrated segmentation and recognition neural net. Advances in neural information processing systems 4 (1991).Google Scholar
- Dimitrios Kotzias, Misha Denil, Nando De Freitas, and Padhraic Smyth. 2015. From group to individual labels using deep features. In Proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 597–606.Google ScholarDigital Library
- LW Ku, LY Lee, and HH Chen. 2006. Opinion extraction, summarizationandtrackinginnewsandblogcorpora. In Proceedings ofAAAIGCAAWG06, the Spring Symposia on ComputationalApproachestoAnalyzing Weblogs. Stanford, USA: AAAI.Google Scholar
- Pengfei Liu, Shafiq Joty, and Helen Meng. 2015. Fine-grained opinion mining with recurrent neural networks and word embeddings. In Proceedings of the 2015 conference on empirical methods in natural language processing. 1433–1443.Google ScholarCross Ref
- Rajdeep Mukherjee, Hari Chandana Peruri, Uppada Vishnu, Pawan Goyal, Sourangshu Bhattacharya, and Niloy Ganguly. 2020. Read what you need: Controllable aspect-based opinion summarization of tourist reviews. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval. 1825–1828.Google ScholarDigital Library
- Nikolaos Pappas and Andrei Popescu-Belis. 2017. Explicit document modeling through weighted multiple-instance learning. Journal of Artificial Intelligence Research 58 (2017), 591–626.Google ScholarDigital Library
- Michael Paul, ChengXiang Zhai, and Roxana Girju. 2010. Summarizing contrastive viewpoints in opinionated text. In Proceedings of the 2010 conference on empirical methods in natural language processing. 66–76.Google ScholarDigital Library
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, Peter J Liu, 2020. Exploring the limits of transfer learning with a unified text-to-text transformer.J. Mach. Learn. Res. 21, 140 (2020), 1–67.Google Scholar
- Wenya Wang, Sinno Jialin Pan, Daniel Dahlmeier, and Xiaokui Xiao. 2016. Recursive neural conditional random fields for aspect-based sentiment analysis. arXiv preprint arXiv:1603.06679(2016).Google Scholar
- Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, 2019. Huggingface’s transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771(2019).Google Scholar
- Yichun Yin, Furu Wei, Li Dong, Kaimeng Xu, Ming Zhang, and Ming Zhou. 2016. Unsupervised word and dependency path embeddings for aspect term extraction. arXiv preprint arXiv:1605.07843(2016).Google Scholar
Index Terms
- Aspect-Sentiment-based Opinion Summarization using Multiple Information Sources
Recommendations
Opinion summarization on spontaneous conversations
HighlightsInvestigated opinion summarization in conversations.Annotated Switchboard conversations with sentiment, summary, and pronoun info.Compared graph-based and supervised summarization methods for opinion summarization.Evaluated summarization ...
Sentiment diversification for short review summarization
WI '17: Proceedings of the International Conference on Web IntelligenceWith the abundance of reviews published on the Web about a given product, consumers are looking for ways to view major opinions that can be presented in a quick and succinct way. Reviews contain many different opinions, making the ability to show a ...
Opinion summarization methods
Research about some aspect-based opinion summarization methods.A new content selection strategy to produce extractive summaries is proposed.A novel NLG template-based system to generate abstractive summaries is proposed.Extractive and abstractive ...
Comments