ParaSite: mining structural information on the Web

doi:10.1016/S0169-7552(97)00033-0

Computer Networks and ISDN Systems

Volume 29, Issues 8–13, September 1997, Pages 1205-1215

Computer Networks an...

https://doi.org/10.1016/S0169-7552(97)00033-0 Get rights and content

Abstract

Web information retrieval tools typically make use of only the text on pages, ignoring valuable information implicitly contained in links. At the other extreme, viewing the Web as a traditional hypertext system would also be mistake, because heterogeneity, cross-domain links, and the dynamic nature of the Web mean that many assumptions of typical hypertext systems do not apply. The novelty of the Web leads to new problems in information access, and it is necessary to make use of the new kinds of information available, such as multiple independent categorization, naming, and indexing of pages. This paper discusses the varieties of link information (not just hyperlinks) on the Web, how the Web differs from conventional hypertext, and how the links can be exploited to build useful applications. Specific applications presented as part of the ParaSite system find individuals' homepages, new locations of moved pages, and unindexed information.

References (23)

H.P. Frei et al.
The use of semantic links in hypertext information retrieval
U. Shardanand et al.
Social information filtering: algorithms for automating “Word of Mouth”
K. Andrews
Applying hypermedia research to the World Wide Web
S.B. Shum
The missing link: hypermedia usability research & the Web
P. Pirolli et al.
Silk from a sow's ear: extracting usable structures from the Web
G.A. Miller
Word-Net: A lexical database for English
E. Spertus
Information hierarchies
E. Selberg et al.
Multi-service search and comparison using the MetaCrawler
W.A. Woods
What's in a link: foundations for semantic networks
J. Nanard et al.
Should anchors be typed too? An experiment with MacWeb

R.H. Trigg

A network-based approach to text handling for the online scientific community

Cited by (40)

Unveiling the I2P web structure: A connectivity analysis
2021, Computer Networks
Citation Excerpt :
The Surface Web or simply the Web, has been widely studied by the research community with different and heterogeneous aims. A number of works are focused on different topics, such as performance optimization for search engines [18–21], analysis of connectivity, dimension and structure of the sites [22–25] and classification of the sites and their contents [26–28]. As we will see in the following, works on the Deep Web and darknets have also addressed similar topics than in the Surface Web.
Web is a primary and essential service to share information among users and organizations at present all over the world. Despite the current significance of such a kind of traffic on the Internet, the so-called Surface Web traffic has been estimated in just about 5% of the total. The rest of the volume of this type of traffic corresponds to the portion of the Web known as Deep Web. These contents are not accessible by usual search engines because they are authentication protected contents or pages only reachable through technologies denoted as darknets. To browse through darknet websites, special authorization or specific software and configurations are needed. TOR is one of the most used darknet nowadays, but there are several other alternatives such as I2P or Freenet, which offer different features for end users. In this work, we perform a connectivity analysis of the websites in the I2P network (named eepsites) aimed to discover if different patterns and relationships from those used in legacy webs are followed in I2P, as well as to get insights about the dimension and structure of this darknet. For that, a novel tool is specifically developed by the authors and deployed on a distributed scenario. Main results conclude the decentralized nature of the I2P network, where there is a structural part of interconnected eepsites while other several nodes are isolated probably due to their intermittent presence in the network.
Identifying website communities in mobile internet based on affinity measurement
2014, Computer Communications
Citation Excerpt :
It is important and interesting to discover these a priori unknown community structures in graphs. The purposes of initial works on investigating the community structures are for structure visualizing [9,10] and content searching [11,12] in the web environment. Subsequently, there have been a growing number of works directed at revealing community structures based on various context information.
With the rapid development of mobile devices and wireless technologies, mobile internet websites play an essential role for delivering networked services in our daily life. Thus, identifying website communities in mobile internet is of theoretical and practical significance in optimizing network resource and improving user experience. Existing solutions are, however, limited to retrieve website communities based on hyperlink structure and content similarities. The relationships between user behaviors and community structures are far from being understood. In this paper, we develop a three-step algorithm to extract communities by affinity measurement derived from user accessing information. Through experimental evaluation with massive detailed HTTP traffic records captured from a cellular core network by high performance monitoring devices, we show that our affinity measurement based method is effective in identifying hidden website communities in mobile internet, which have evaded previous link-based and content-based approaches.
Hyperlink ensembles: A case study in hypertext classification
2002, Information Fusion
In this paper, we introduce hyperlink ensembles, a novel type of ensemble classifier for classifying hypertext documents. Instead of using the text on a page for deriving features that can be used for training a classifier, we suggest to use portions of texts from all pages that point to the target page. A hyperlink ensemble is formed by obtaining one prediction for each hyperlink that points to a page. These individual predictions for each hyperlink are subsequently combined to a final prediction for the class of the target page. We explore four different ways of combining the individual predictions and four different techniques for identifying relevant text portions. The utility of our approach is demonstrated on a set of Web-pages that relate to Computer Science Departments.
Unveiling the I2P web structure: A connectivity analysis
2021, arXiv
A model of concept hierarchy-based diverse patterns with applications to recommender system
2020, International Journal of Data Science and Analytics
Social Semantic Web Mining
2015, Synthesis Lectures on the Semantic Web: Theory and Technology

View all citing articles on Scopus

View full text

ParaSite: mining structural information on the Web

Abstract

Social information filtering: algorithms for automating “Word of Mouth”

Applying hypermedia research to the World Wide Web

The missing link: hypermedia usability research & the Web

Silk from a sow's ear: extracting usable structures from the Web

Word-Net: A lexical database for English

Information hierarchies

Multi-service search and comparison using the MetaCrawler

What's in a link: foundations for semantic networks

Should anchors be typed too? An experiment with MacWeb

A network-based approach to text handling for the online scientific community