Abstract
Our study shows that algorithms used to check the similarity of data records affect the efficiency of a wrapper. A closer examination indicates that the accuracy of a wrapper can be improved if the DOM Tree and visual properties of data records can be fully utilized. In this paper, we develop algorithms to check the similarity of data records based on the distinct tags and visual cue of the tree structure of data records and the voting algorithm which can detect the similarity of data records of a relevant data region which may contain irrelevant information such as search identifiers to distinguish the potential data regions more correctly and eliminate data region only when necessary. Experimental results show that our wrapper performs better than state of the art wrapper WISH and it is highly effective in data extraction. This wrapper will be useful for meta search engine application, which needs an accurate tool to locate its source of information.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Liu, B., Grossman, R., Zhai, Y.: Mining data records in Web pages. ACM SIGKDD, 601–606 (2003)
Miao, G., Tatemura, J., Hsiung, W.-P., Sawires, A., Moser, L.E.: Extracting Data Records from the Web Using Tag Path Clustering. ACM WWW, 981–990 (2009)
Zhao, H., Meng, W., Wu, Z., Raghavan, V., Yu, C.: Fully automatic wrapper generation for search engines. ACM WWW, 66–75 (2005)
Hong, J.L., Siew, E., Egerton, S.: Information Extraction for Search Engines using Fast Heuristic Techniques. DKE 69(2), 169–196 (2010)
Simon, K., Lausen, G.: ViPER: augmenting automatic information extraction with visual perceptions. ACM CIKM, 381–388 (2005)
Liu, W., Meng, X., Meng, W.: ViDE: A Vision-based Approach for Deep Web Data Extraction. IEEE TKDE 22(3), 447–460 (2009)
Su, W., Wang, J., Lochovsky, F.H.: ODE: Ontology-assisted Data Extraction. ACM TODS 34(12) (2009)
Zhai, Y., Liu, B.: Web data extraction based on partial tree alignment. ACM WWW, 76–85 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hong, J.L., Tan, E.X., Fauzi, F. (2011). Data Extraction for Search Engine Using Safe Matching. In: Wang, D., Reynolds, M. (eds) AI 2011: Advances in Artificial Intelligence. AI 2011. Lecture Notes in Computer Science(), vol 7106. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25832-9_77
Download citation
DOI: https://doi.org/10.1007/978-3-642-25832-9_77
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25831-2
Online ISBN: 978-3-642-25832-9
eBook Packages: Computer ScienceComputer Science (R0)