Abstract
The sentence ordering is a difficult but very important task in multi-document summarization. With the aim of producing a coherent and legible summary for multiple documents, this study proposes a novel approach that is built upon a hierarchical topic model for automatic evaluation of sentence ordering. By learning topic correlations from the topic hierarchies, this model is able to automatically evaluate sentences to find a plausible order to arrange them for generating a more readable summary. The experimental results demonstrate that our proposed approach can improve the summarization performance and present a significant enhancement on the sentence ordering for multi-document summarization. In addition, the experimental results show that our model can automatically analyze the topic relationships to infer a strategy for sentence ordering. Human evaluations justify that the generated summaries, which implement this strategy, demonstrate a good linguistic performance in terms of coherence, readability, and redundancy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Andrieu, C., De Freitas, N., Doucet, A., Jordan, M.I.: An introduction to mcmc for machine learning. Machine Learning 50, 5–43 (2003)
Banko, M., Vanderwende, L.: Using n-grams to understand the nature of summaries. In: Proceedings of HLT-NAACL 2004: Short Papers. HLT-NAACL-Short 2004, pp. 1–4. Association for Computational Linguistics, Stroudsburg (2004)
Barzilay, R., Elhadad, N., McKeown, K.R.: Inferring strategies for sentence ordering in multidocument news summarization. J. Artif. Int. Res. 17(1), 35–55 (2002)
Blei, D.M., Griffiths, T.L., Jordan, M.I.: The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies. J. ACM 57(2), 7:1–7:30 (2010)
Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. The Journal of Machine Learning Research 3, 993–1022 (2003)
Bollegala, D., Okazaki, N., Ishizuka, M.: A preference learning approach to sentence ordering for multi-document summarization. Information Sciences 217, 78–95 (2012)
Celikyilmaz, A., Hakkani-Tür, D.: Discovery of topically coherent sentences for extractive summarization. In: ACL, pp. 491–499 (2011)
Jagarlamudi, J., Pingali, P., Varma, V.: Query independent sentence scoring approach to duc 2006. In: Proceeding of Document Understanding Conference (DUC 2006) (2006)
Jing, H.: Using hidden markov modeling to decompose human-written summaries. Computational linguistics 28(4), 527–543 (2002)
Kim, H.D., Park, D.H., Vydiswaran, V.V., Zhai, C.: Opinion summarization using entity features and probabilistic sentence coherence optimization: Uiuc at tac 2008 opinion summarization pilot. Urbana 51, 61801 (2008)
Lapata, M.: Automatic evaluation of information ordering: Kendall’s tau. Computational Linguistics 32(4), 471–484 (2006)
Lin, C.Y.: Rouge: A package for automatic evaluation of summaries. In: Text Summarization Branches Out: Proceedings of the ACL 2004 Workshop, pp. 74–81 (2004)
Liu, J.S.: The collapsed gibbs sampler in bayesian computations with applications to a gene regulation problem. Journal of the American Statistical Association 89(427), 958–966 (1994)
MacKay, D.J., Peto, L.C.B.: A hierarchical dirichlet language model. Natural Language Engineering 1(3), 289–308 (1995)
Minka, T.: Estimating a dirichlet distribution (2000)
Pitman, J.: Combinatorial stochastic processes, vol. 1875. Springer (2006)
Pitman, J., Yor, M.: The two-parameter poisson-dirichlet distribution derived from a stable subordinator. The Annals of Probability 25(2), 855–900 (1997)
Wallach, H.M.: Topic modeling: beyond bag-of-words. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 977–984. ACM (2006)
Wan, S., Dras, M., Dale, R., Paris, C.: Spanning tree approaches for statistical sentence generation. In: Krahmer, E., Theune, M. (eds.) Empirical Methods. LNCS, vol. 5790, pp. 13–44. Springer, Heidelberg (2010)
Wang, X., McCallum, A.: Topics over time: a non-markov continuous-time model of topical trends. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 424–433. ACM (2006)
Wang, X., McCallum, A., Wei, X.: Topical n-grams: Phrase and topic discovery, with an application to information retrieval. In: Seventh IEEE International Conference on Data Mining, ICDM 2007, pp. 697–702. IEEE (2007)
Wolf, F., Gibson, E.: Paragraph-, word-, and coherence-based approaches to sentence ranking: A comparison of algorithm and human performance. In: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics, p. 383. Association for Computational Linguistics (2004)
Yang, G., Chen, N.S., Kinshuk, S.E., Anderson, T., Wen, D.: The effectiveness of automatic text summarization in mobile learning contexts. Computers & Education 68, 233–243 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, G., Kinshuk, Wen, D., Sutinen, E. (2013). Enhancing Sentence Ordering by Hierarchical Topic Modeling for Multi-document Summarization. In: Castro, F., Gelbukh, A., González, M. (eds) Advances in Artificial Intelligence and Its Applications. MICAI 2013. Lecture Notes in Computer Science(), vol 8265. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45114-0_30
Download citation
DOI: https://doi.org/10.1007/978-3-642-45114-0_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-45113-3
Online ISBN: 978-3-642-45114-0
eBook Packages: Computer ScienceComputer Science (R0)