tutorial

Beyond Opinion Mining: Summarizing Opinions of Customer Reviews

Authors:

Reinald Kim Amplayo,

Arthur Brazinskas,

Bing LiuAuthors Info & Claims

SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

Pages 3447 - 3450

https://doi.org/10.1145/3477495.3532676

Published: 07 July 2022 Publication History

Abstract

Customer reviews are vital for making purchasing decisions in the Information Age. Such reviews can be automatically summarized to provide the user with an overview of opinions. In this tutorial, we present various aspects of opinion summarization that are useful for researchers and practitioners. First, we will introduce the task and major challenges. Then, we will present existing opinion summarization solutions, both pre-neural and neural. We will discuss how summarizers can be trained in the unsupervised, few-shot, and supervised regimes. Each regime has roots in different machine learning methods, such as auto-encoding, controllable text generation, and variational inference. Finally, we will discuss resources and evaluation methods and conclude with the future directions. This three-hour tutorial will provide a comprehensive overview over major advances in opinion summarization. The listeners will be well-equipped with the knowledge that is both useful for research and practical applications.

References

[1]

Reinald Kim Amplayo, Stefanos Angelidis, and Mirella Lapata. 2021. Aspect-Controllable Opinion Summarization. In EMNLP. 6578--6593.

[2]

Reinald Kim Amplayo, Stefanos Angelidis, and Mirella Lapata. 2021. Unsupervised Opinion Summarization with Content Planning. In AAAI, Vol. 35. 12489--12497.

[3]

Reinald Kim Amplayo and Mirella Lapata. 2020. Unsupervised Opinion Summarization with Noising and Denoising. In ACL. 1934--1945.

[4]

Reinald Kim Amplayo and Mirella Lapata. 2021. Informative and Controllable Opinion Summarization. In EACL. 2662--2672.

[5]

Stefanos Angelidis, Reinald Kim Amplayo, Yoshihiko Suhara, Xiaolan Wang, and Mirella Lapata. 2021. Extractive opinion summarization in quantized transformer spaces. TACL 9 (2021), 277--293.

[6]

Stefanos Angelidis and Mirella Lapata. 2018. Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised. In EMNLP. 3675--3686.

[7]

Iz Beltagy, Matthew E. Peters, and Arman Cohan. 2020. Longformer: The Long-Document Transformer. arXiv:2004.05150 (2020).

[8]

Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, Andrew Dai, Rafal Jozefowicz, and Samy Bengio. 2016. Generating Sentences from a Continuous Space. In CoNLL. 10--21.

[9]

Arthur Brazinskas, Mirella Lapata, and Ivan Titov. 2020. Few-Shot Learning for Opinion Summarization. In EMNLP. 4119--4135.

[10]

Arthur Brazinskas, Mirella Lapata, and Ivan Titov. 2020. Unsupervised Opinion Summarization as Copycat-Review Generation. In ACL. 5151--5169.

[11]

Arthur Brazinskas, Mirella Lapata, and Ivan Titov. 2021. Learning Opinion Summarizers by Selecting Informative Reviews. In EMNLP. 9424--9442.

[12]

Arthur Brazinskas, Ramesh Nallapati, Mohit Bansal, and Markus Dreyer. 2022. Efficient Few-Shot Fine-Tuning for Opinion Summarization. In Findings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).

[13]

Giuseppe Carenini, Raymond Ng, and Adam Pauls. 2006. Multi-Document Summarization of Evaluative Text. In EACL. 305--312.

[14]

Eric Chu and Peter Liu. 2019. Meansum: a neural model for unsupervised multidocument abstractive summarization. In ICML. PMLR, 1223--1232.

[15]

Maximin Coavoux, Hady Elsahar, and Matthias Gallé. 2019. Unsupervised aspectbased multi-document abstractive summarization. In Proceedings of the 2ndWorkshop on New Frontiers in Summarization. 42--47.

[16]

Hady Elsahar, Maximin Coavoux, Jos Rozen, and Matthias Gallé. 2021. Self-Supervised and Controlled Multi-Document Opinion Summarization. In EACL. 1646--1662.

[17]

Günes Erkan and Dragomir R Radev. 2004. Lexrank: Graph-based lexical centrality as salience in text summarization. Journal of artificial intelligence research 22 (2004), 457--479.

[18]

Kavita Ganesan, ChengXiang Zhai, and Jiawei Han. 2010. Opinosis: A Graph Based Approach to Abstractive Summarization of Highly Redundant Opinions. In COLING. Coling 2010 Organizing Committee, 340--348.

[19]

Shima Gerani, Yashar Mehdad, Giuseppe Carenini, Raymond Ng, and Bita Nejat. 2014. Abstractive summarization of product reviews using discourse structure. In EMNLP. 1602--1613.

[20]

Geoffrey E Hinton, Alex Krizhevsky, and Sida D Wang. 2011. Transforming auto-encoders. In ICANN. Springer, 44--51.

[21]

Minqing Hu and Bing Liu. 2004. Mining and Summarizing Customer Reviews. In KDD. 168--177.

[22]

Minqing Hu and Bing Liu. 2006. Opinion extraction and summarization on the web. In AAAI, Vol. 7. 1621--1624.

[23]

Jinbae Im, Moonki Kim, Hoyeop Lee, Hyunsouk Cho, and Sehee Chung. 2021. Self-Supervised Multimodal Opinion Summarization. In ACL. 388--403.

[24]

Hayate Iso, Xiaolan Wang, Yoshihiko Suhara, Stefanos Angelidis, and Wang-Chiew Tan. 2021. Convex Aggregation for Opinion Summarization. In EMNLP Findings. 3885--3903.

[25]

Masaru Isonuma, Junichiro Mori, Danushka Bollegala, and Ichiro Sakata. 2021. Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidance. TACL 9 (09 2021), 945--961.

[26]

Wenjun Jiang, Jing Chen, Xiaofei Ding, JieWu, Jiawei He, and GuojunWang. 2021. Review Summary Generation in Online Systems: Frameworks for Supervised and Unsupervised Scenarios. ACM Trans. Web 15, 3, Article 13 (May 2021), 33 pages.

Digital Library

[27]

Wenjun Ke, Jinhua Gao, Huawei Shen, and Xueqi Cheng. 2022. ConsistSum: Unsupervised Opinion Summarization with the Consistency of Aspect, Sentiment and Semantic. In WSDM. 467--475.

[28]

Hyun Duk Kim, Kavita Ganesan, Parikshit Sondhi, and ChengXiang Zhai. 2011. Comprehensive Review of Opinion Summarization. Technical Report. University of Illinois at Urbana-Champaign.

[29]

Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. CoRR abs/1312.6114 (2014).

[30]

Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics, 74--81.

[31]

Yue Lu, ChengXiang Zhai, and Neel Sundaresan. 2009. Rated aspect summarization of short comments. In WWW. 131--140.

[32]

Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020. On Faithfulness and Factuality in Abstractive Summarization. In ACL. 1906--1919.

[33]

Kathleen McKeown. 1992. Text generation. Cambridge University Press.

[34]

Rada Mihalcea and Paul Tarau. 2004. Textrank: Bringing order into text. In EMNLP. 404--411.

[35]

Arjun Mukherjee and Bing Liu. 2012. Aspect Extraction through Semi-Supervised Modeling. In ACL. 339--348.

[36]

Rajdeep Mukherjee, Hari Chandana Peruri, Uppada Vishnu, Pawan Goyal, Sourangshu Bhattacharya, and Niloy Ganguly. 2020. Read what you need: Controllable aspect-based opinion summarization of tourist reviews. In SIGIR. 1825--1828.

[37]

G. Murray, E. Hoque, and G. Carenini. 2017. Chapter 11 - Opinion Summarization and Visualization. In Sentiment Analysis in Social Networks, Federico Alberto Pozzi, Elisabetta Fersini, Enza Messina, and Bing Liu (Eds.). Morgan Kaufmann, Boston, 171--187.

[38]

Nadav Oved and Ran Levy. 2021. PASS: Perturb-and-Select Summarizer for Product Reviews. In ACL. 351--365.

[39]

Haojie Pan, Rongqin Yang, Xin Zhou, Rui Wang, Deng Cai, and Xiaozhong Liu. 2020. Large scale abstractive multi-review summarization (lsars) via aspect alignment. In SIGIR. 2337--2346.

[40]

Bo Pang and Lillian Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2, 1--2 (2008), 1--135.

Digital Library

[41]

Bo Pang, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up? Sentiment Classification using Machine Learning Techniques. In EMNLP. 79--86.

[42]

Alexander M. Rush, Sumit Chopra, and Jason Weston. 2015. A Neural Attention Model for Abstractive Sentence Summarization. In EMNLP. 379--389.

[43]

Abigail See, Peter J. Liu, and Christopher D. Manning. 2017. Get To The Point: Summarization with Pointer-Generator Networks. In ACL. 1073--1083.

[44]

Ori Shapira and Ran Levy. 2020. Massive multi-document summarization of product reviews with weak supervision. arXiv preprint arXiv:2007.11348 (2020).

[45]

Yoshihiko Suhara, Xiaolan Wang, Stefanos Angelidis, and Wang-Chiew Tan. 2020. OpinionDigest: A Simple Framework for Opinion Summarization. In ACL. 5789--5798.

[46]

Ivan Titov and Ryan McDonald. 2008. A joint model of text and aspect ratings for sentiment summarization. In ACL:HLT. 308--316.

[47]

Ke Wang and Xiaojun Wan. 2021. TransSum: Translating Aspect and Sentiment Embeddings for Self-Supervised Opinion Summarization. In ACL Findings. 729--742.

[48]

Lu Wang and Wang Ling. 2016. Neural Network-Based Abstract Generation for Opinions and Arguments. In NAACL. 47--57.

[49]

Lu Wang, Hema Raghavan, Claire Cardie, and Vittorio Castelli. 2014. Query- Focused Opinion Summarization for User-Generated Content. In COLING. 1660--1669.

[50]

Penghui Wei, Jiahao Zhao, and Wenji Mao. 2021. A Graph-to-Sequence Learning Framework for Summarizing Opinionated Texts. TASLP 29 (2021), 1650--1660.

[51]

Jingqing Zhang, Yao Zhao, Mohammad Saleh, and Peter Liu. 2020. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization. In ICML (Proceedings of Machine Learning Research, Vol. 119), Hal Daumé III and Aarti Singh (Eds.). PMLR, 11328--11339.

[52]

Chao Zhao and Snigdha Chaturvedi. 2020. Weakly-supervised opinion summarization by leveraging external information. In AAAI, Vol. 34. 9644--9651.

Cited By

Jegan PSidharth NAkilandeswari VPerumalraja R(2025)Chatbot for Start-Ups and Entrepreneurs with Machine Learning and Natural Language Processing Techniques2025 International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI)10.1109/ICMSCI62561.2025.10894131(1490-1494)Online publication date: 20-Jan-2025
https://doi.org/10.1109/ICMSCI62561.2025.10894131
Liao HWang SCheng HZhang WZhang JZhou MLu KMao RXie X(2024)Aspect-Enhanced Explainable Recommendation with Multi-modal Contrastive LearningACM Transactions on Intelligent Systems and Technology10.1145/367323416:1(1-24)Online publication date: 19-Jun-2024
https://dl.acm.org/doi/10.1145/3673234
Zhao YMa JChow T(2024)Extractive Negative Opinion Summarization of Consumer Electronics ReviewsIEEE Transactions on Consumer Electronics10.1109/TCE.2023.330285170:1(3521-3528)Online publication date: Feb-2024
https://doi.org/10.1109/TCE.2023.3302851
Show More Cited By

Index Terms

Beyond Opinion Mining: Summarizing Opinions of Customer Reviews
1. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals

Recommendations

Opinion Mining and Summarization of Hotel Reviews
CICN '14: Proceedings of the 2014 International Conference on Computational Intelligence and Communication Networks

Everyday many users purchases product, book travel tickets, buy goods and services through web. Users also share their views about product, hotel, news, and topic on web in the form of reviews, blogs, comments etc. Many users read review information ...
Opinion summarization on spontaneous conversations

HighlightsInvestigated opinion summarization in conversations.Annotated Switchboard conversations with sentiment, summary, and pronoun info.Compared graph-based and supervised summarization methods for opinion summarization.Evaluated summarization ...
Opinion Mining and Sentiment Analysis in Social Networks: A Retweeting Structure-Aware Approach
UCC '14: Proceedings of the 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing

Microblogs have become quick and easy online information sharing platforms with the explosive growth of online social media. Weibo, a Twitter-like microblog service in China, is characterized by timeliness and interactivity. A Weibo message carries the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 2022

3569 pages

ISBN:9781450387323

DOI:10.1145/3477495

General Chairs:
Enrique Amigo
UNED
,
Pablo Castells
UAM and Amazon
,
Julio Gonzalo
UNED
,
Program Chairs:
Ben Carterette
Spotify
,
J. Shane Culpepper
RMIT University
,
Gabriella Kazai
Waseda University

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial

Conference

SIGIR '22

Sponsor:

SIGIR

SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 11 - 15, 2022

Madrid, Spain

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
383
Total Downloads

Downloads (Last 12 months)77
Downloads (Last 6 weeks)7

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jegan PSidharth NAkilandeswari VPerumalraja R(2025)Chatbot for Start-Ups and Entrepreneurs with Machine Learning and Natural Language Processing Techniques2025 International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI)10.1109/ICMSCI62561.2025.10894131(1490-1494)Online publication date: 20-Jan-2025
https://doi.org/10.1109/ICMSCI62561.2025.10894131
Liao HWang SCheng HZhang WZhang JZhou MLu KMao RXie X(2024)Aspect-Enhanced Explainable Recommendation with Multi-modal Contrastive LearningACM Transactions on Intelligent Systems and Technology10.1145/367323416:1(1-24)Online publication date: 19-Jun-2024
https://dl.acm.org/doi/10.1145/3673234
Zhao YMa JChow T(2024)Extractive Negative Opinion Summarization of Consumer Electronics ReviewsIEEE Transactions on Consumer Electronics10.1109/TCE.2023.330285170:1(3521-3528)Online publication date: Feb-2024
https://doi.org/10.1109/TCE.2023.3302851
Hayatin NAlias SHung L(2024)Trends and challenges in sentiment summarization: a systematic review of aspect extraction techniquesKnowledge and Information Systems10.1007/s10115-024-02075-w66:7(3671-3717)Online publication date: 9-May-2024
https://dl.acm.org/doi/10.1007/s10115-024-02075-w
Asaad WAllami RAli Y(2024)Machine Learning Algorithms are Used for Fake Review DetectionEmerging Trends and Applications in Artificial Intelligence10.1007/978-3-031-56728-5_25(292-302)Online publication date: 30-Apr-2024
https://doi.org/10.1007/978-3-031-56728-5_25
Zhao YChow T(2023)Opinion Summarization via Submodular Information MeasuresIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.323533735:11(11708-11721)Online publication date: 9-Jan-2023
https://dl.acm.org/doi/10.1109/TKDE.2023.3235337
Mansouri JCavarretta FSwaileh WKotzinos D(2023)Extracting Unique Discussions of Interests for Entrepreneurs and Managers in a Set of Business Tweets Without Any Human BiasIEEE Access10.1109/ACCESS.2023.334375611(144258-144273)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3343756

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten