Abstract
This paper presents MetaNews, an information gathering agent for news articles on the Web. MetaNews reads HTML documents from online news sites and extracts article information from them. In order to recognize and extract articles from an HTML document, MetaNews removes redundant HTML tags, builds a reference string which is a sequence of semantic components of a noise-removed document, and performs pattern matching between the reference string and each of pre-defined information patterns for articles. With a few training inputs from the operator with intermediate-level skills, MetaNews is capable of adding new sites easily and extracting articles in real time. By reducing the complexity of designing and creating wrapper interfaces, the proposed techniques in MetaNews are useful for many information-mediator applications such as meta-search engines, information-push solutions, and comparison-shopping agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Angluin, D.: Interface of reversible languages. Journal of ACM 29(3), 741–765 (1982)
Ashish, N., Knoblock, C.: Wrapper generation for semi-structured Internet sources. In: Proc. Workshop on Management of Semistructured Data, Tucson, Arizona (1997)
Choi, J.: A customized comparison-shopping agent. IEICE Trans. Comm. E84-B(6), 1694–1696 (2001)
Cohen, W.: A web-based information system that reasons with structured collections of text. In: Proc. 2nd International Conf. on Autonomous Agent, May 1998, pp. 400–407. Minneapolis/ St. Paul, Minnesota (1998)
Doorenbos, R., Etzioni, O., Weld, D.: A scalable comparison-shopping agent for the World Wide Web. In: Proc. 1st International Conf. on Autonomous Agent, Marina del Rey, California, February 1997, pp. 39–48 (1997)
Hammer, J., Garcia-Molina, H., Cho, J., Aranha, R., Crespo, A.: Extracting semistructured information from the Web. In: Proc. Workshop on Management of Semistructured Data, Tucson, Arizona (1997)
Kushmerick, N.: Wrapper induction: efficiency and expressiveness. Artificial Intelligence 118, 15–68 (2000)
Muslea, I., Minton, S., Knoblock, C.: A hierarchical approach to wrapper induction. In: Proc. 3rd International Conf. on Autonomous Agents, pp. 190–197 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kang, DK., Choi, J. (2003). MetaNews: An Information Agent for Gathering News Articles on the Web. In: Zhong, N., Raś, Z.W., Tsumoto, S., Suzuki, E. (eds) Foundations of Intelligent Systems. ISMIS 2003. Lecture Notes in Computer Science(), vol 2871. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39592-8_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-39592-8_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20256-1
Online ISBN: 978-3-540-39592-8
eBook Packages: Springer Book Archive