Skip to main content

Text Compression by Syntactic Pruning

  • Conference paper
Advances in Artificial Intelligence (Canadian AI 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4013))

Abstract

We present a method for text compression, which relies on pruning of a syntactic tree. The syntactic pruning applies to a complete analysis of sentences, performed by a French dependency grammar. Sub-trees in the syntactic analysis are pruned when they are labelled with targeted relations. Evaluation is performed on a corpus of sentences which have been manually compressed. The reduction ratio of extracted sentences averages around 70%, while retaining grammaticality or readability in a proportion of over 74%. Given these results on a limited set of syntactic relations, this shows promise for any application which requires compression of texts, including text summarization.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abeillé, A., Clément, L., Toussenel, F.: Building a treebank for french. In: Abeillé, A. (ed.) Treebanks: Building and Using Parsed Corpora, pp. 165–188. Kluwer Academic Publishers, Dordrecht (2003)

    Google Scholar 

  2. Barzilay, R., McKeown, K., Elhadad, M.: Information fusion in the context of multi-document summarization. In: Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, New Brunswick, NJ, pp. 550–557. Association for Computational Linguistics (1999)

    Google Scholar 

  3. Blache, P., Morin, J.-Y.: Une grille d’évaluation pour les analyseurs syntaxiques. In: TALN 2003, Batz-sur-mer, juin 11-14, 2003, pp. 77–86 (2003)

    Google Scholar 

  4. Coulombe, C., Doll, F., Drouin, P.: Intégration d’un analyseur syntaxique à large couverture dans un outil de langage contrôlé en français. Lingvisticae Investigationes (Machine Translation, Controlled Languages and Specialised Languages) 28(1) (2005)

    Google Scholar 

  5. Fiszman, M., Rindflesch, T.C., Kilicoglu, H.: Abstraction summarization for managing the biomedical research literature. In: Proceedings of the Computational Lexical Semantics Workshop, HLT-NAACL 2004, Boston, Massachussetts, USA, May 2-7, 2004, pp. 76–83 (2004)

    Google Scholar 

  6. Gagnon, M., Da Sylva, L.: Text summarization by sentence extraction and syntactic pruning. In: Computational Linguistics in the North-East (CLiNE), Gatineau (2005)

    Google Scholar 

  7. Goulet, M.-J., Bourgeoys, J.: Le projet gÉraf: guide pour l’évaluation des résumés automatiques français. In: TALN 2004, avril 19-21, 2004, pp. 19–21 (2004)

    Google Scholar 

  8. Grefenstette, G.: Producing intelligent telegraphic text reduction to provide an audio scanning service for the blind. In: Working Notes of the Workshop on Intelligent Text Summarization, Menlo Park, CA. American Association for Artificial Intelligence Spring Symposium Series, pp. 111–117 (1998)

    Google Scholar 

  9. Grefenstette, G.: Light parsing as finite-state filtering. In: Proceedings ECAI 1996 Workshop on Extended Finite State Models of Language, August 11-12 (1996)

    Google Scholar 

  10. Inderjeet, M., Maybury, M.T.: Advances in Automatic Text Summarization. MIT Press, Cambridge (1999)

    Google Scholar 

  11. Jing, H., McKeown, K.: The decomposition of human-written summary sentences. In: Proceedings of the 22nd International Conference on Research and Development in Information Retrieval (SIGIR 1999), New York, pp. 129–136. Association for Computing Machinery (1999)

    Google Scholar 

  12. Knight, K., Marcu, D.: Summarization beyond sentence extraction: A probabilistic approach to sentence compression. Artificial Intelligence 139, 91–107 (2002)

    Article  MATH  Google Scholar 

  13. Lin, C.-Y.: Improving summarization performance by sentence compression - a pilot study. In: Proceedings of the Sixth International Workshop on Information Retrieval with Asian Languages (IRAL 2003), Sapporo, Japan (July 7, 2003)

    Google Scholar 

  14. Mani, I.: Automatic Summarization. John Benjamins, Amsterdam, Philadelphia (2001)

    MATH  Google Scholar 

  15. Minel, J.-L.: Résumé automatique de textes. Traitement automatique des langues 45(1) (2004)

    Google Scholar 

  16. NIST. Document understanding conference - introduction. Technical report, http://www-nlpir.nist.gov/projects/duc/intro.html

  17. Saggion, H., Lapalme, G.: Selective analysis for the automatic generation of summaries. In: Beghtol, C., Howarth, L., Williamson, N. (eds.) Dynamism and Stability in Knowledge Organization – Proceedings of the Sixth International ISKO Conference, Toronto, july 2000, pp. 176–181. International Society of Knowledge Organization, Ergon Verlag (2000)

    Google Scholar 

  18. Thione, G.L., van den Berg, M.H., Polanyi, L., Culy, C.: Hybrid text summarization: Combining external relevance measures with structural analysis. In: Proceedings of the ACL2004 Workshop Text Summarization Branches Out, Barcelona, Spain, July 25-26 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gagnon, M., Da Sylva, L. (2006). Text Compression by Syntactic Pruning. In: Lamontagne, L., Marchand, M. (eds) Advances in Artificial Intelligence. Canadian AI 2006. Lecture Notes in Computer Science(), vol 4013. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11766247_27

Download citation

  • DOI: https://doi.org/10.1007/11766247_27

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34628-9

  • Online ISBN: 978-3-540-34630-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics