Skip to main content
SpringerLink
Log in

Using intelligent internet robots for building topic-specific collections

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

The problem of developing an intelligent Internet search engine for creating topic-specific collections is considered. To improve the efficiency of discovering topic-related resources, a specialized network crawling algorithm is developed that uses information on the relevance of the Web pages already visited to evaluate the usefulness of new pages.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aalbersberg, I.J., Incremental Relevance Feedback,Proc. 15th Annual Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR'92), 1992, pp. 11–22.

  2. Allan, J., Incremental Relevance Feedback,Proc. 19th Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR'96), 1996, pp. 298–306.

  3. Ardö, A. and Lundberg, S., A Regional Distributed WWW Search and Indexing Service—the DESIRE Way,Comput. Networks ISDN Syst., 1998, vol. 30, pp. 173–183.

    Article  Google Scholar 

  4. Bessonov, M., Heuser, U., Nekrestyanov, I., and Patel, A., Open Architecture for Distributed Search Systems,Proc. Sixth Int. Conf. on Intelligence in Services and Networks, 1999.

  5. Ledeneva, E., O'Maera, T., Nekrestyanov, I., and Patel, A., Building Topic-Specific Collections with Intelligent Agents,Proc. Sixth Int. Conf. on Intelligence in Services and Networks, 1999.

  6. Bowman, C.M., Danzig, P.B., Hardy, D.R., Manber, U., and Schwartz, M.F., The Harvest Information Discovery and Access System,Comput. Networks ISDN Syst., 1995, December, pp. 119–125.

  7. Callan, J., Document Filtering with Inference Networks,Proc. 19th Int. ACM Conf. on Research and Development in Information Retrieval (SIGIR'96), 1996, pp. 262–269.

  8. Cheong, F.,Internet Agents: Spiders, Wanders, Brokers, and Bots, New Riders, Indian., 1996.

  9. Cho, J., Garcia-Molina, H., and Page L., Efficient Crawling through URL Ordering,Proc. Seventh Int. World Wide Web Conf., 1998.

  10. Koch, T., Ardö, A., Bremmer, A., and Lundberg, S., The Building and Maintenance of Robot Based Internet Search Services: A Review of Current Indexing and Data Collection Methods,Lund Univ. Library, State-of-the-Art Report, D3.11, Sweden, 1996.

  11. Koster, M., Robots in the Web: Threat or Treat?ConneX-ions, 1995, vol. 9, no. 4.

  12. Lawrence, S. and Giles, C.L., Searching the World Wide Web,Science, 1998, vol. 280, no. 5360, pp. 98–100.

    Article  Google Scholar 

  13. Page, L., Brin, S., and Motwani, R., The Pagerank Citation Ranking: Bringing Order to the Web,Proc. Seventh Int. World Wide Web Conf., 1998.

  14. Pincerton, B., Finding What People Want: Expierences with the Webcrawler,Proc. Second Int. World Wide Web Conf., 1994.

  15. Salton, G. and Buckley, C., Term-Weighting Approaches in Automatic Text Retrieval,Inf. Process. Manag., 1988, vol. 24, pp. 513–523.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. St. Petersburg State University, Bibliotechnaya pl. 2, 198904, Petrodvorets, Russia

    E. V. Romanova, M. V. Romanov & I. S. Nekrest'yanov

Authors
  1. E. V. Romanova
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. V. Romanov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. I. S. Nekrest'yanov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to E. V. Romanova.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Romanova, E.V., Romanov, M.V. & Nekrest'yanov, I.S. Using intelligent internet robots for building topic-specific collections. Program Comput Soft 26, 163–169 (2000). https://doi.org/10.1007/BF02759315

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02759315

Keywords

Search

Navigation