Skip to main content

SEMIR: Semantic Indexing and Retrieving Web Document Using Rhetorical Structure Theory

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2690))

Abstract

The amount of information available on the Internet is currently growing at an incredible rate. The lack of efficient indexing is, however, still a major barrier to effective information retrieval of documents from the web. This paper proposes the design of a technique for content-based indexing and retrieval of relevant documents from a large collection of documents such as the Internet. The technique aims at improving the quality of retrieval by capturing the semantics of these documents. It performs the conventional keyword-based indexing and introduces a thematic relationship between parts of text using a linguistics theory called Rhetorical Structure Theory (RST). The indexing and retrieval technique described in this paper is currently under development, and initial results obtained from a small number of documents has been found to be more satisfactory, compared to those obtained using keyword-based indexing and retrieval techniques we have been using.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pollitt, A.S.: Information Storage and Retrieval Systems. Ellis Horwood Ltd., Chichester (1989)

    Google Scholar 

  2. Gerard, S.: Automatic Text Processing. Addison-Wesley, USA (1989)

    Google Scholar 

  3. Frants, Valery, I., Shapiro, Jacob, V., Vladimir, G.: Automated Information Retrieval: theory and Methods. Academic Press, California (1997)

    Google Scholar 

  4. Sparck-Jones, Willet, K., Peter: Readings in Information Retrieval. Morgan Kauffman, California (1997)

    Google Scholar 

  5. Liu, G.Z.: Semantic vector space model: implementation and evaluation. Journal of the American Society for Information Science 48(5), 395–417 (1997)

    Article  Google Scholar 

  6. Korfhage, R.: Information Storage and Retrieval. John Wiley and Sons, London (1997)

    Google Scholar 

  7. Losee, R.M.: Comparing boolean and probabilistic information retrieval systems across queries and disciplines. Journal of the American Society for Information Science 48(2), 143–156 (1997)

    Article  Google Scholar 

  8. Smeaton, A.F.: Progress in the application of natural language processing to information retrieval. The Computer Journal 35, 268–278 (1992)

    Article  Google Scholar 

  9. Lalmas, Mounia, B., Peter, D.: The use of logic in information retrieval modelling. The Knowledge Engineering Review 13(3), 263–295 (1998)

    Article  Google Scholar 

  10. Hagen, Eric,: An Information Retrieval System for performing Hierarchical document Clustering, Thesis, Dartmouth college (1997)

    Google Scholar 

  11. Mann, W.C., Thompson, S.A.: Rhetorical Structure Theory: Towards a functional theory of text organization. Text 8(3), 228–243 (1988)

    Google Scholar 

  12. Rosener, D., Stede, M.: Customizing RST for the Automatic Production of Technical Manuals. In: Dale, R., Rösner, D., Stock, O., Hovy, E. (eds.) IWNLG 1992. LNCS, vol. 587, pp. 199–214. Springer, Heidelberg (1992)

    Google Scholar 

  13. Aristotle: The Rhetoric, in W. Rhys Roberts (translator). The Rhetoric and Poetics of Aristotle. Random House, New York (1954)

    Google Scholar 

  14. http://www.sil.org/linguistics/rst/index.htm

  15. Vadera, S., Meziane, F.: From English to Formal Specifications. The Computer Journal 37(9) (1994)

    Google Scholar 

  16. Marcu, D.: Building up Rhetorical Structure Trees. In: Proceedings of the Thirteenth National Conference on Artificial Intelligence, Portland, Oregon, vol. 2, pp. 1069–1074 (August 1996)

    Google Scholar 

  17. Marcu, D.: The rhetorical parsing of natural language texts. In: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics (ACL 1997), pp. 96–103 (1997 a)

    Google Scholar 

  18. Marcu, D.: The theory and practice of discourse parsing and summarization. In: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics (ACL 1997), pp. 96–103 (2000)

    Google Scholar 

  19. Simon, H.: Corston-Oliver. Computing representations of the structure of written discourse. Technical report MSR-TR-98-15, Microsoft research, Microsoft corporation, One Microsoft way, Redmond, WA 98052. April 3 (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Haouam, K., Marir, F. (2003). SEMIR: Semantic Indexing and Retrieving Web Document Using Rhetorical Structure Theory. In: Liu, J., Cheung, Ym., Yin, H. (eds) Intelligent Data Engineering and Automated Learning. IDEAL 2003. Lecture Notes in Computer Science, vol 2690. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45080-1_81

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-45080-1_81

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40550-4

  • Online ISBN: 978-3-540-45080-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics