Abstract
Hidden Web databases maintain a collection of documents, which are dynamically generated using Web page templates in response to user queries. This paper presents a technique, Text with Neighbouring Adjacent Tag Segments (TNATS), to represent the contents of documents retrieved from an underlying database. TNATS exploits tag structures that surround the textual content of a document. This representation facilitates the process of detecting Web page templates and extraction of query-related information from documents. We compare the performance of TNATS with existing techniques based on tag tree and text only representations. Experimental results demonstrate that TNATS requires less processing time for information extraction than a tag tree representation. It also produces optimum results in terms of detecting Web page templates and extracting query-related information.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bergman, M.K.: The Deep Web: Surfacing Hidden Value. Appeared in The Journal of Electronic Publishing from the University of Michigan (2001)
Callan, J., Connell, M.: Query-Based Sampling of Text Databases. ACM Transactions on Information Systems 19(2), 97–130 (2001)
Caverlee, J., Buttler, D., Liu, L.: Discovering Objects in Dynamically-Generated Web Pages. Technical report, Georgia Institute of Technology (2003)
Gravano, L., Ipeirotis, P.G., Sahami, M.: QProber: A System for Automatic Classification of Hidden-Web Databases. ACM Transactions on Information Systems (TOIS)Â 21(1) (2003)
Hedley, Y.L., Younas, M., James, A., Sanderson, M.: A Two-Phase Sampling Technique for Information Extraction from Hidden Web Databases. In: Proceedings of the 6th ACM CIKM Workshop on Web Information and Data Management, WIDM (2004)
Lin, K.I., Chen, H.: Automatic Information Discovery from the Invisible Web. International Conference on Information Technology: Coding and Computing, 332–337 (2002)
Meng, W., Wang, W., Sun, H., Yu, C.: Concept Hierarchy Based Text Database Categorization. International Journal on Knowledge and Information Systems 4(2), 132–150 (2002)
Rahardjo, B., Yap, R.: Automatic Information Extraction from Web Pages. In: Proceedings of the 24th Annual International ACM SIGIR Conference, pp. 430–431 (1999)
Ramaswamy, L., Iyengar, A., Liu, L., Douglis, F.: Automatic Detection of Fragments in Dynamically Generated Web Pages. In: Proceedings of the 10th International Conference on World Wide Web, pp. 443–453 (2004)
Salton, G., McGill, M.: Introduction to Modern Information Retrieval. McCraw-Hill, New York (1983)
Sugiura, A., Etzioni, O.: Query Routing for Web Search Engines: Architecture and Experiments. In: Proceedings of the 9th International World Wide Web Conference: The Web: The Next Generation, pp. 417–430 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hedley, YL., Younas, M., James, A. (2004). A TNATS Approach to Hidden Web Documents. In: Ghosh, R.K., Mohanty, H. (eds) Distributed Computing and Internet Technology. ICDCIT 2004. Lecture Notes in Computer Science, vol 3347. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30555-2_19
Download citation
DOI: https://doi.org/10.1007/978-3-540-30555-2_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24075-4
Online ISBN: 978-3-540-30555-2
eBook Packages: Computer ScienceComputer Science (R0)