A data-mining approach for optimizing performance of an incremental crawler | IEEE Conference Publication | IEEE Xplore

A data-mining approach for optimizing performance of an incremental crawler


Abstract:

Crawlers visit the Web to maintain a local repository of Web pages up to date. We introduce another perspective to build an effective incremental crawler. Based on previo...Show More

Abstract:

Crawlers visit the Web to maintain a local repository of Web pages up to date. We introduce another perspective to build an effective incremental crawler. Based on previous work in this field, we study how we can improve the performance of a crawler using data-mining. The information collected from the users can help the crawler to know which are the popular pages and to revisit them as soon as possible.
Date of Conference: 13-17 October 2003
Date Added to IEEE Xplore: 27 October 2003
Print ISBN:0-7695-1932-6
Conference Location: Halifax, NS, Canada

References

References is not available for this document.