Skip to main content

Summary Generation and Evaluation in SumUM

  • Conference paper
  • 869 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1952))

Abstract

We describe and evaluate SumUM, a text summarization system that produces indicative-informative abstracts for technical papers. Our approach consists of the shallow syntactic and conceptual analysis of the source document and of the implementation of text re-generation techniques based on a study of abstracts produced by professional abstractors. In an evaluation of indicative content in a categorization task, we observed no differences with other automatic method, while differences are observed in an evaluation of informative content. In an evaluation of text quality, the abstracts were considered acceptable when compared with other automatic abstracts.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. H.P. Edmunson. New Methods in Automatic Extracting. Journal of the Association for Computing Machinery, 16(2):264–285, April 1969.

    Article  Google Scholar 

  2. G. Foster. Statistical Lexical Disambiguation. Master’s thesis, McGill University, School of Computer Science, 1991.

    Google Scholar 

  3. E.D. Liddy. The Discourse-Level Structure of Empirical Abstracts: An Exploratory Study. Information Processing & Management, 27(1):55–81, 1991.

    Article  Google Scholar 

  4. I. Mani, D. House, G. Klein, L. Hirshman, L. Obrst, T. Firmin, M. Chrzanowski, and B. Sundheim. The TIPSTER SUMMAC Text Summarization Evaluation. Technical report, The Mitre Corporation, 1998.

    Google Scholar 

  5. D. Marcu. From Discourse Structures to Text Summaries. In The Proceedings of the ACL’97/EACL’97 Workshop on Intelligent Scalable Text Summarization, pages 82–88, Madrid, Spain, July 11 1997.

    Google Scholar 

  6. C.D. Paice and P.A. Jones. The Identification of Important Concepts in Highly Structured Technical Papers. In R. Korfhage, E. Rasmussen, and P. Willett, editors, Proc. of the 16th ACM-SIGIR Conference, pages 69–78, 1993.

    Google Scholar 

  7. L.H.M. Rino and D. Scott. A Discourse Model for Gist Preservation. In D.L. Borges and C.A.A. Kaestner, editors, Proceedings of the 13th Brazilian Symposium on Artificial Intelligence, SBIA’96, Advances in Artificial Intelligence, pages 131–140. Springer, October 23–25, Curitiba, Brazil 1996.

    Google Scholar 

  8. H. Saggion and G. Lapalme. Where does Information come from? Corpus Analysis for Automatic Abstracting. In Rencontre Internationale sur l’Extraction le Filtrage et le Résumé Automatique. RIFRA’98, pages 72–83, Sfax, Tunisie, Novembre 11–14 1998.

    Google Scholar 

  9. H. Saggion and G. Lapalme. Concept Identification and Presentation in the Context of Technical Text Summarization. In Proceedings of the Workshop on Automatic Summarization. ANLP-NAACL2000, Seattle, WA, USA, 30 April 2000. Association for Computational Linguistics.

    Google Scholar 

  10. G. Salton, A. Singhal, M. Mitra, and C. Buckley. Automatic Text Structuring and Summarization. Information Processing & Management, 33(2):193–207, 1997.

    Article  Google Scholar 

  11. S. Teufel and M. Moens. Argumentative classification of extracted sentences as a first step towards flexible abstracting. In I. Mani and M.T. Maybury, editors, Advances in Automatic Text Summarization, pages 155–171. The MIT Press, 1999.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Saggion, H., Lapalme, G. (2000). Summary Generation and Evaluation in SumUM. In: Monard, M.C., Sichman, J.S. (eds) Advances in Artificial Intelligence. IBERAMIA SBIA 2000 2000. Lecture Notes in Computer Science(), vol 1952. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44399-1_34

Download citation

  • DOI: https://doi.org/10.1007/3-540-44399-1_34

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-41276-2

  • Online ISBN: 978-3-540-44399-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics