Skip to main content

Advertisement

Springer Nature Link
Log in

Cascaded Convolutional Neural Networks for Aspect-Based Opinion Summary

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

This paper studies aspect-based opinion summary (AOS) of reviews on particular products. In practice, an AOS system needs to address two core subtasks, aspect extraction and sentiment classification. Most existing approaches to aspect extraction, using linguistic analysis or topic modeling, are general across different products but not precise enough or suitable for particular products. Instead we take a less general but more precise scheme, which directly maps each review sentence into pre-defined aspects. To tackle aspect mapping and sentiment classification, we propose a convolutional neural network (CNN) based method, cascaded CNN (C-CNN). C-CNN contains two levels of convolutional networks. Multiple CNNs at level 1 deal with aspect mapping task. If a review sentence belongs to pre-defined aspect categories, a single CNN at level 2 determines its sentiment polarity. Experimental results show that C-CNN with pre-trained word embedding outperform cascaded SVM with feature engineering. We also build a system called OpiSum with C-CNN. The demo of OpiSum can be found at http://114.215.167.42.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. http://www.amazon.com.

  2. http://www.taobao.com.

  3. http://scikit-learn.org.

References

  1. Gao Z-K, Cai Q, Yang Y-X, Dang W-D, Zhang S-S (2016) Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series. Sci Rep 6:35622. doi:10.1038/srep35622

    Article  Google Scholar 

  2. Gao Z-K, Cai Q, Yang Y-X, Dong N, Zhang S-S (2017) Visibility graph from adaptive optimal kernel time-frequency representation for classification of epileptiform EEG. Int J Neural Syst 27:1750005

    Article  Google Scholar 

  3. Gao Z-K, Jin N-D (2012) A directed weighted complex network for characterizing chaotic dynamics from time series. Nonlinear Anal Real World Appl 13(2):947–952. doi:10.1016/j.nonrwa.2011.08.029

    Article  MathSciNet  MATH  Google Scholar 

  4. Gao Z-K, Yang Y-X, Fang P-C, Zou Y, Xia C-Y, Du M (2015) Multiscale complex network for analyzing experimental multivariate time series. EPL (Europhys Lett) 109(3):30005

    Article  Google Scholar 

  5. Hu M, Liu B (2004) Mining opinion features in customer reviews. AAAI 4:755–760

    Google Scholar 

  6. Blair-Goldensohn S, Hannan K, McDonald R, Neylon T, Reis GA, Reynar J (2008) Building a sentiment summarizer for local service reviews. In: Proceedings of WWW workshop on NLP in the information explosion era, pp 339–348

  7. Kim S, Zhang J, Chen Z, Oh AH, Liu S (2013) A hierarchical aspect-sentiment model for online reviews. In: AAAI

  8. Kobayashi N, Inui K, Matsumoto Y (2007) Extracting aspect-evaluation and aspect-of relations in opinion mining. In: EMNLP-CoNLL, Citeseer, pp 1065–1074

  9. Sauper C, Barzilay R (2013) Automatic aggregation by joint modeling of aspects and values. J Artif Intell Res 46:89–127

  10. Yang B, Cardie C (2012) Extracting opinion expressions with semi-Markov conditional random fields. In: Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning, Association for Computational Linguistics, pp 1335–1345

  11. Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 56–65

  12. Joshi M, Penstein-Rosé C (2009) Generalizing dependency features for opinion mining. In: Proceedings of the ACL-IJCNLP 2009 conference short papers, Association for Computational Linguistics, pp 313–316

  13. Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27

    Article  Google Scholar 

  14. Wu Y, Zhang Q, Huang X, Wu L (2009) Phrase dependency parsing for opinion mining. In: Proceedings of the 2009 conference on empirical methods in natural language processing: volume 3, Association for Computational Linguistics, pp 1533–1541

  15. Zhuang L, Jing F, Zhu X-Y (2006) Movie review mining and summarization. In: Proceedings of the 15th ACM international conference on information and knowledge management, ACM, pp 43–50

  16. Breck E, Choi Y, Cardie C (2007) Identifying expressions of opinion in context. In: Proceedings of the 20th international joint conference on artificial intelligence, pp 2683–2688

  17. Irsoy O, Cardie C (2014) Opinion mining with deep recurrent neural networks. In: Proceedings of the 2014 conference on empirical methods in natural language processing, pp 720–728

  18. Jakob N, Gurevych I (2010) Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 1035–1045

  19. Jin W, Ho HH, Srihari RK (2009) A novel lexicalized HMM-based learning framework for web opinion mining. In: Proceedings of the 26th annual international conference on machine learning, Citeseer, pp 465–472

  20. Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Paper presented at the human language technologies: the 2010 annual conference of the North American Chapter of the Association for Computational Linguistics. Los Angeles, California

  21. Chen Z, Mukherjee A, Liu B (2014) Aspect extraction with automated prior knowledge learning. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 347–358

  22. Jo Y, Oh AH (2011) Aspect and sentiment unification model for online review analysis. In: Proceedings of the fourth ACM international conference on Web search and data mining, ACM, pp 815–824

  23. Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing. pp 1746–1751

  24. Moghaddam S, Ester M (2012) On the design of LDA models for aspect-based opinion mining. In: Proceedings of the 21st ACM international conference on Information and knowledge management, ACM, pp 803–812

  25. Mukherjee A, Liu B (2012) Aspect extraction through semi-supervised modeling. In: Proceedings of the 50th annual meeting of the Association for Computational Linguistics: Long Papers-vol 1, Association for Computational Linguistics, pp 339–348

  26. Sauper C, Haghighi A, Barzilay R (2011) Content models with attitude. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies, volume 1, Association for Computational Linguistics, pp 350–358

  27. Bespalov D, Bai B, Qi Y, Shokoufandeh (2011) A Sentiment classification based on supervised latent n-gram analysis. In: Proceedings of the 20th ACM international conference on information and knowledge management, ACM, pp 375–382

  28. Davidov D, Tsur O, Rappoport (2010) A Enhanced sentiment learning using twitter hashtags and smileys. In: Proceedings of the 23rd international conference on computational linguistics: posters, Association for Computational Linguistics, pp 241–249

  29. Nakagawa T, Inui K, Kurohashi S (2010) Dependency tree-based sentiment classification using CRFs with hidden variables. In: Human language technologies: the 2010 annual conference of the North American chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp 786–794

  30. Ng V, Dasgupta S, Arifin S (2006) Examining the role of linguistic knowledge sources in the automatic identification and classification of reviews. In: Proceedings of the COLING/ACL on main conference poster sessions, Association for Computational Linguistics, pp 611–618

  31. Paltoglou G, Thelwall M (2010) A study of information retrieval weighting schemes for sentiment analysis. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics, Association for Computational Linguistics, pp 1386–1395

  32. Pang B, Lee L, Vaithyanathan S (2002) Thumbs up: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing, vol 10, Association for Computational Linguistics, pp 79–86

  33. Riloff E, Patwardhan S, Wiebe J (2006) Feature subsumption for opinion analysis. In: Proceedings of the 2006 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 440–448

  34. Wu H, Gu X, Gu Y (2016) Balancing between over-weighting and under-weighting in supervised term weighting. Inf Process Manag. doi:10.1016/j.ipm.2016.10.003

  35. Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 655–665

  36. Santos CND, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of the 25th international conference on computational linguistics, pp 69–78

  37. Lin C, He Y (2009) Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM conference on Information and knowledge management, ACM, pp 375–384

  38. Jin W, Ho HH, Srihari RK (2009) OpinionMiner: a novel machine learning system for web opinion mining and extraction. In: Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 1195–1204

  39. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012:1097–1105

    Google Scholar 

  40. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  41. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12(Aug):2493–2537

    MATH  Google Scholar 

  42. Shen Y, He X, Gao J, Deng L, Mesnil G (2014) A latent semantic model with convolutional-pooling structure for information retrieval. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, ACM, pp 101–110

  43. Shen Y, He X, Gao J, Deng L, Mesnil G (2014) Learning semantic representations using convolutional neural networks for web search. In: Proceedings of the 23rd international conference on world wide web, ACM, pp 373–374

  44. Santos CND, Xiang B, Zhou B (2015) Classifying relations by ranking with convolutional neural networks. In: Proceedings of ACL-IJCNLP 2015, ACL, pp 626–634

  45. Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: Proceedings of the 25th international conference on computational linguistics, pp 2335–2344

  46. Le QV, Mikolov T (2014) Distributed representations of sentences and documents. In: Proceedings of The 31st international conference on machine learning, pp 1188–1196

  47. Nair V, Hinton GE (2010) Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814

  48. Wu H, Gu X (2015) Towards dropout training for convolutional neural networks. Neural Netw 71:1–10

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by National Natural Science Foundation of China under Grant 61371148.

Author information

Authors and Affiliations

  1. Department of Electronic Engineering, Fudan University, Shanghai, 200433, China

    Xiaodong Gu, Yiwei Gu & Haibing Wu

Authors
  1. Xiaodong Gu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yiwei Gu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haibing Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaodong Gu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gu, X., Gu, Y. & Wu, H. Cascaded Convolutional Neural Networks for Aspect-Based Opinion Summary. Neural Process Lett 46, 581–594 (2017). https://doi.org/10.1007/s11063-017-9605-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-017-9605-7

Keywords