skip to main content
10.1145/3368926.3369699acmotherconferencesArticle/Chapter ViewAbstractPublication PagessoictConference Proceedingsconference-collections
research-article

Exploiting User Comments for Document Summarization with Matrix Factorization

Published:04 December 2019Publication History

ABSTRACT

Social media presents a new method for readers who can freely discuss the content of an event mentioned in a Web document by posting relevant comments. The comments provide additional information which can be used to enrich the information of the main document. This paper introduces a new model which integrates user comments into the summarization process. While prior methods consider the same topic number between sentences and comments of a document, we argue that sentences and comments should own their different topics and they also share common hidden topics in term of same or inferred words. From this, we define a new objective function which jointly combines sentences and comments to achieve global optimization. The objective function is optimized by our non-negative matrix factorization algorithm to find out weights of sentence-matrix and comment-matrix for ranking sentences and comments. Experimental results on two datasets in English and Vietnamese show that our model achieves promising results for single-document summarization.

References

  1. Kathleen McKeown Ani Nenkova. 2011. Automatic Summarization. Foundations and Trends in Information Retrieval, 5(2-3): 103--233 (2011).Google ScholarGoogle ScholarCross RefCross Ref
  2. Siddhartha Banerjee, Prasenjit Mitra, and Kazunari Sugiyama. 2015. Multi-Document Abstractive Summarization Using ILP Based Multi-Sentence Compression. In Twenty-Fourth International Joint Conference on Artificial Intelligence, pp. 1208--1214.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ziqiang Cao, Furu Wei, Sujian Li, Wenjie Li, Ming Zhou, and Houfeng Wang. 2015. Learning Summary Prior Representation for Extractive Summarization. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics ACL (2), pp. 829--833. Association for Computational Linguistics.Google ScholarGoogle ScholarCross RefCross Ref
  4. Gunes Erkan and Dragomir R. Radev. 2004. Lexrank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research, 22, pp. 457--479 (2004).Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Wei Gao, Peng Li, and Kareem Darwish. 2012. Joint Topic Modeling for Event Summarization across News and Social Media Streams. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management, pp. 1173--1182. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Yihong Gong and Xin Liu. 2001. Generic Text Summarization using Relevant Measure and Latent Semantic Analysis. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 19--25. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Masahiro Kohjima, Tatsushi Matsubayashi, and Hiroshi Sawada. 2015. Probabilistic Non-negative Inconsistent-resolution Matrices Factorization. In 24th ACM International on Conference on Information and Knowledge Management (CIKM), pp. 1855--1858.Google ScholarGoogle Scholar
  8. Daniel D. Lee and H. Sebastian Seung. 1999. Learning the parts of objects by non-negative matrix factorization. Nature 401, no. 6755, pp. 788--791 (1999).Google ScholarGoogle ScholarCross RefCross Ref
  9. Daniel D. Lee and H. Sebastian Seung. 2001. Algorithms for non-negative matrix factorization, In Advances in Neural Information Processing Systems, pp. 556--562. Advances in Neural Information Processing Systems 13 (2001).Google ScholarGoogle Scholar
  10. Ju-Hong Lee, Sun Park, Chan-Min Ahn, and Daeho Kim. 2009. Automatic generic document summarization based on non-negative matrix factorization. Information Processing & Management 45(1), pp. 20--34 (2009).Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Chen Li, Zhongyu Wei, Yang Liu, Yang Jin, and Fei Huang. 2016. Using Relevant Public Posts to Enhance News Article Summarization. In COLING, pp. 557--566.Google ScholarGoogle Scholar
  12. Chih-Jen Lin. 2007. Projected gradient methods for nonnegative matrix factorization. Neural computation, 19(10), pp. 2756--2779 (2007).Google ScholarGoogle Scholar
  13. Chin-Yew Lin and Eduard H. Hovy. 2003. Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology-Volume 1, pp. 71--78. Association for Computational Linguistics.Google ScholarGoogle Scholar
  14. Preslav Nakov, Antonia Popova, and Plamen Mateev. 2001. Weight functions impact on LSA performance. In EuroConference RANLP, pp. 187--193.Google ScholarGoogle Scholar
  15. Ramesh Nallapati, Feifei Zhai, and Bowen Zhou. 2017. SummaRuNNer: A Recurrent Neural Network Based Sequence Model for Extractive Summarization of Documents. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI), pp. 3075--3081.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Ani Nenkova. 2005. Automatic text summarization of newswire: lessons learned from the document understanding conference. In AAAI, vol. 5, pp. 1436--1441.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Minh-Tien Nguyen, Tran Viet Cuong, Nguyen Xuan Hoai, and Minh-Le Nguyen. 2017. Utilizing User Posts to Enrich Web Document Summarization with Matrix Co-factorization. In Proceedings of the Eighth International Symposium on Information and Communication Technology (SoICT), pp. 70--77. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Minh-Tien Nguyen, Viet Dac Lai, Phong-Khac Do, Duc-Vu Tran, and Minh-Le Nguyen. 2016. VSoLSCSum: Building a Vietnamese Sentence-Comment Dataset for Social Context Summarization. In The 12th Workshop on Asian Language Resources, pp. 38--48. Association for Computational Linguistics.Google ScholarGoogle Scholar
  19. Minh-Tien Nguyen and Minh-Le Nguyen. 2016. SoRTESum: A Social Context Framework for Single-Document Summarization. In European Conference on Information Retrieval, pp. 3--14. Springer International Publishing.Google ScholarGoogle Scholar
  20. Minh-Tien Nguyen, Chien-Xuan Tran, Duc-Vu Tran, and Minh-Le Nguyen. 2016. SoLSCSum: A Linked Sentence-Comment Dataset for Social Context Summarization. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, pp. 2409--2412. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Minh-Tien Nguyen, Duc-Vu Tran, and Minh-Le Nguyen. 2018. Social Context Summarization using User-generated Content and Third-party Sources. Knowledge-Based Systems, 144(2018), pp. 51--64. Elsevier (2018).Google ScholarGoogle ScholarCross RefCross Ref
  22. Minh-Tien Nguyen, Viet Cuong Tran, Xuan Hoai Nguyen, and Le-Minh Nguyen. 2019. Web Document Summarization by Exploiting Social Context with Matrix Co-factorization. Information Processing & Management, 56(3), pp. 495--515 (2019).Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Sun Park, Ju-Hong Lee, Chan-Min Ahn, Jun Sik Hong, and Seok-Ju Chun. 2006. Query Based Summarization Using Non-negative Matrix Factorization. In Knowledge-Based Intelligent Information and Engineering Systems, pp. 84--89. Springer Berlin/Heidelberg.Google ScholarGoogle Scholar
  24. Dou Shen, Jian-Tao Sun, Hua Li, Qiang Yang, and Zheng Chen. 2007. Document Summarization Using Conditional Random Fields. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI), vol. 7, pp. 2862--2867.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Doina Tatar, Emma Tamaianu-Morita, Andreea Mihis, and Dana Lupsa. 2008. Summarization by logic segmentation and text entailment. In Advances in Natural Language Processing and Applications (CICLING), pp. 15--26.Google ScholarGoogle Scholar
  26. Dingding Wang, Tao Li, Shenghuo Zhu, and Chris Ding. 2008. Multidocument summarization via sentence-level semantic analysis and symmetric matrix factorization. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 307--314. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Zhongyu Wei and Wei Gao. 2014. Utilizing Microblogs for Automatic News Highlights Extraction. In COLING, pp. 872--883.Google ScholarGoogle Scholar
  28. Zhongyu Wei and Wei Gao. 2015. Gibberish, Assistant, or Master?: Using Tweets Linking to News for Extractive Single-Document Summarization. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1003--1006. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kristian Woodsend and Mirella Lapata. 2012. Multiple Aspect Summarization Using Integer Linear Programming. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp. 233--243. Association for Computational Linguistics.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Zi Yang, Keke Cai, Jie Tang, Li Zhang, Zhong Su, and Juanzi Li. 2011. Social Context Summarization. In Proceedings of the 34th International SIGIR Conference on Research and Development in Information Retrieval, pp. 255--264. ACM.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Exploiting User Comments for Document Summarization with Matrix Factorization

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SoICT '19: Proceedings of the 10th International Symposium on Information and Communication Technology
        December 2019
        551 pages
        ISBN:9781450372459
        DOI:10.1145/3368926

        Copyright © 2019 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 4 December 2019

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate147of318submissions,46%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader