Skip to main content
SpringerLink
Log in

What do people think about this monument? Understanding negative reviews via deep learning, clustering and descriptive rules

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Aspect-based sentiment analysis enables the extraction of fine-grained information, as it connects specific aspects that appear in reviews with a polarity. Although we detect that the information from these algorithms is very accurate at local level, it does not contribute to obtain an overall understanding of reviews. To fill this gap, we propose a methodology to portray opinions through the most relevant associations between aspects and polarities. Our methodology combines three off-the-shelf algorithms: (1) deep learning for extracting aspects, (2) clustering for joining together similar aspects, and (3) subgroup discovery for obtaining descriptive rules that summarize the polarity information of set of reviews. Concretely, we aim at depicting negative opinions from three cultural monuments in order to detect those features that need to be improved. Experimental results show that our approach clearly gives an overview of negative aspects, therefore it will be able to attain a better comprehension of opinions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://levyomer.wordpress.com/2014/04/25/dependency-based-word-embeddings/.

  2. Source:https://tripadvisor.mediaroom.com/uk-about-us.

References

  • Agrawal R, Mannila H, Srikant R, Toivonen H, Verkamo AI (1996) Fast discovery of association rules. Adv Knowl Discov Data Min 12(1):307–328

    Google Scholar 

  • Atzmueller M (2015) Subgroup discovery. Wiley Interdiscip Rev Data Min Knowl Discov 5(1):35–49. https://doi.org/10.1002/widm.1144

    Article  Google Scholar 

  • Bay SD, Pazzani MJ (2001) Detecting group differences: mining contrast sets. Data Min Knowl Discov 5(3):213–246

    Article  Google Scholar 

  • Cambria E (2016) Affective computing and sentiment analysis. IEEE Intell Syst 31(2):102–107

    Article  Google Scholar 

  • Cambria E, Poria S, Hazarika D, Kwok K (2018) SenticNet 5: discovering conceptual primitives for sentiment analysis by means of context embeddings. In: AAAI, pp 1795–1802

  • Carmona C, del Jesus M, Herrera F (2018) A unifying analysis for the supervised descriptive rule discovery via the weighted relative accuracy. Knowl Based Syst 139:89–100

    Article  Google Scholar 

  • Carmona CJ, González P, Del Jesus M, Navío-Acosta M, Jiménez-Trevino L (2011) Evolutionary fuzzy rule extraction for subgroup discovery in a psychiatric emergency department. Soft Comput 15(12):2435–2448

    Article  Google Scholar 

  • Carmona CJ, González P, del Jesus MJ, Herrera F (2014) Overview on evolutionary subgroup discovery: analysis of the suitability and potential of the search performed by evolutionary algorithms. Wiley Int Rev Data Min Knowl Discov 4(2):87–103

    Article  Google Scholar 

  • Chaturvedi I, Ragusa E, Gastaldo P, Zunino R, Cambria E (2018) Bayesian network based extreme learning machine for subjectivity detection. J Frankl Inst 355(4):1780–1797

    Article  MathSciNet  Google Scholar 

  • Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537

    MATH  Google Scholar 

  • De Boom C, Van Canneyt S, Demeester T, Dhoedt B (2016) Representation learning for very short texts using weighted word embedding aggregation. Pattern Recognit Lett 80:150–156

    Article  Google Scholar 

  • Dong G, Li J (1999) Efficient mining of emerging patterns: discovering trends and differences. In: KDD, ACM, pp 43–52

  • Fan H, Ramamohanarao K (2003) A bayesian approach to use emerging patterns for classification. In: ADC, Australian Computer Society, Inc., pp 39–48

  • García-Vico A, Carmona C, Martín D, García-Borroto M, del Jesus M (2017) An overview of emerging pattern mining in supervised descriptive rule discovery: taxonomy, empirical study, trends, and prospects. Wiley Interdiscip Rev Data Min Knowl Discov 8(1):e1231

    Article  Google Scholar 

  • Hai Z, Chang K, Kim Jj (2011) Implicit feature identification via co-occurrence association rule mining. In: CICLING, Springer, pp 393–404

    Chapter  Google Scholar 

  • Herrera F, Carmona CJ, González P, Del Jesus MJ (2011) An overview on subgroup discovery: foundations and applications. Knowl Inform Syst 29(3):495–525

    Article  Google Scholar 

  • Hu M, Liu B (2004) Mining and summarizing customer reviews. In: KDD, ACM, pp 168–177

  • Jakob N, Gurevych I (2010) Extracting opinion targets in a single- and cross-domain setting with conditional random fields. In: EMNLP, ACL, pp 1035–1045

  • Jovanoski V, Lavrač N (2001) Classification rule learning with apriori-c. In: EPIA, Springer, pp 44–51

    Chapter  Google Scholar 

  • Kasper W, Vela M (2011) Sentiment analysis for hotel reviews. Comput Linguist Appl Conf 231527:45–52

    Google Scholar 

  • Kavšek B, Lavrač N (2006) Apriori-sd: adapting association rule learning to subgroup discovery. Appl Artif Intell 20(7):543–583

    Article  Google Scholar 

  • Klösgen W (1996) Explora: A multipattern and multistrategy discovery assistant. In: Advances in knowledge discovery and data mining, American Association for Artificial Intelligence, pp 249–271

  • Lavrač N, Flach P, Zupan B (1999) Rule evaluation measures: a unifying view. In: ILP, Springer, pp 174–185

    Chapter  Google Scholar 

  • Lavrač N, Kavšek B, Flach P, Todorovski L (2004) Subgroup discovery with cn2-sd. J Mach Learn Res 5:153–188

    MathSciNet  Google Scholar 

  • Levy O, Goldberg Y (2014) Dependency-based word embeddings. ACL 2:302–308

    Google Scholar 

  • Li G, Law R, Rong J, Vu HQ (2010) Incorporating both positive and negative association rules into the analysis of outbound tourism in Hong Kong. J Travel Tour Market 27(8):812–828

    Article  Google Scholar 

  • Li G, Law R, Vu HQ, Rong J, Zhao XR (2015) Identifying emerging hotel preferences using emerging pattern mining technique. Tour Manage 46:311–321

    Article  Google Scholar 

  • Liu B (2015) Sentiment analysis: mining opinions, sentiments, and emotions. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Lu B, Ott M, Cardie C, Tsou BK (2011) Multi-aspect sentiment analysis with topic models. In: 2011 IEEE 11th international conference on data mining workshops (ICDMW), IEEE, pp 81–88

  • Marrese-Taylor E, Velásquez JD, Bravo-Marquez F, Matsuo Y (2013) Identifying customer preferences about tourism products using an aspect-based opinion mining approach. Proc Comput Sci 22:182–191

    Article  Google Scholar 

  • Mihelčić M, Džeroski S, Lavrač N, Šmuc T (2017) A framework for redescription set construction. Expert Syst Appl 68:196–215

    Article  Google Scholar 

  • Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:13013781

  • Nguyen HL, Jung JE (2017) Statistical approach for figurative sentiment analysis on social networking services: a case study on twitter. Multimed Tools Appl 76(6):8901–8914

    Article  Google Scholar 

  • Novak PK, Lavrač N, Webb GI (2009) Supervised descriptive rule discovery: a unifying survey of contrast set, emerging pattern and subgroup mining. J Mach Learn Res 10:377–403

    MATH  Google Scholar 

  • Plutchik R (1984) Emotions: a general psychoevolutionary theory. Approaches Emot 1984:197–219

    Google Scholar 

  • Poria S, Gelbukh A, Cambria E, Das D, Bandyopadhyay S (2012a) Enriching senticnet polarity scores through semi-supervised fuzzy clustering. In: ICDMW, pp 709–716

  • Poria S, Gelbukh A, Cambria E, Yang P, Hussain A, Durrani T (2012b) Merging senticnet and wordnet-affect emotion lists for sentiment analysis. ICSP 2:1251–1255

    Google Scholar 

  • Poria S, Cambria E, Ku LW, Gui C, Gelbukh A (2014) A rule-based approach to aspect extraction from product reviews. SocialNLP 2014:28

    Google Scholar 

  • Poria S, Cambria E, Gelbukh A (2016) Aspect extraction for opinion mining with a deep convolutional neural network. Knowl Based Syst 108:42–49

    Article  Google Scholar 

  • Rajagopal D, Cambria E, Olsher D, Kwok K (2013) A graph-based approach to commonsense concept extraction and semantic similarity detection. In: WWW, pp 565–570

  • Schouten K, Frasincar F (2016) Survey on aspect-level sentiment analysis. IEEE Trans Knowl Data Eng 28(3):813–830

    Article  Google Scholar 

  • Thorndike RL (1953) Who belongs in the family? Psychometrika 18(4):267–276

    Article  Google Scholar 

  • Toh Z, Wang W (2014) Dlirec: aspect term extraction and term polarity classification system. In: SemEval, pp 235–240

  • Valdivia A, Luzón MV, Herrera F (2017) Sentiment analysis in tripadvisor. IEEE Intell Syst 32(4):72–77

    Article  Google Scholar 

  • Wrobel S (1997) An algorithm for multi-relational discovery of subgroups. In: European symposium on principles of data mining and knowledge discovery, Springer, pp 78–87

  • Zhao Y, Qin B, Hu S, Liu T (2010) Generalizing syntactic structures for product attribute candidate extraction. In: HLT-NAACL, Association for Computational Linguistics, pp 377–380

Download references

Acknowledgements

We would like to thank the reviewers for their thoughtful comments and efforts towards improving our manuscript. This research work was supported by the TIN2017-89517-P project from the Spanish Government. Eugenio Martínez-Cámara was supported by the Juan de la Cierva Formación Programme (FJCI-2016-28353) also from the Spanish Government.

Author information

Authors and Affiliations

  1. Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada, Granada, Spain

    Ana Valdivia, Eugenio Martínez-Cámara, M. Victoria Luzón & Francisco Herrera

  2. School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore

    Iti Chaturvedi, Erik Cambria & Yew-Soon Ong

Authors
  1. Ana Valdivia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eugenio Martínez-Cámara
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Iti Chaturvedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Victoria Luzón
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Erik Cambria
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yew-Soon Ong
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Francisco Herrera
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eugenio Martínez-Cámara.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Valdivia, A., Martínez-Cámara, E., Chaturvedi, I. et al. What do people think about this monument? Understanding negative reviews via deep learning, clustering and descriptive rules. J Ambient Intell Human Comput 11, 39–52 (2020). https://doi.org/10.1007/s12652-018-1150-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-018-1150-3

Keywords

Search

Navigation