ABSTRACT
This work studies the problem of extracting articles from Web pages for better printing. Different from existing approaches of article extraction, Web printing poses several unique requirements: 1) Identifying just the boundary surrounding the text-body is not the ideal solution for article extraction. It is highly desirable to filter out some uninformative links and advertisements within this boundary. 2) It is necessary to identify paragraphs, which may not be readily separated as DOM nodes, for the purpose of better layout of the article. 3) Its performance should be independent of content domains, written languages, and Web page templates. Toward these goals we propose a novel method of article extraction using both DOM (Document Object Model) and visual features. The main components of our method include: 1) a text segment/paragraph identification algorithm based on line-breaking features, 2) a global optimization method, Maximum Scoring Subsequence, based on text segments for identifying the boundary of the article body, 3) an outlier elimination step based on left or right alignment of text segments with the article body. Our experiments showed the proposed method is effective in terms of precision and recall at the level of text segments.
- J. Pasternack and D. Roth. Extracting article text from the web with maximum subsequence segmentation. In Proceedings of the 18th WWW, 2009. Google ScholarDigital Library
- W. Ruzzo and M. Tompa. A linear time algorithm for finding all maximal scoring subsequences. In Proceedings of ISMB, 1999. Google ScholarDigital Library
- J. Wang, X. He, C. Wang, J. Pei, J. Bu, C. Chen, Z. Guan, and W. V. Zhang. Can we learn a template-independent wrapper for news article extraction from a single training site? In Proceedings of the 15th SIGKDD, 2009. Google ScholarDigital Library
Index Terms
- Web article extraction for web printing: a DOM+visual based approach
Recommendations
Print-friendly page extraction for web printing service
DocEng '11: Proceedings of the 11th ACM symposium on Document engineeringPrinting Web pages from browsers usually results in unsatisfactory printouts because the pages are typically ill formatted and contain non-informative content such as navigation menu and ads. Thus, print-worthy Web pages such as articles generally ...
Visual Area Classification for Article Identification in Web Documents
DEXA '10: Proceedings of the 2010 Workshops on Database and Expert Systems ApplicationsIn the World Wide Web, the news and other articles are usually published in complex HTML documents containing many types of additional information that is not explicitly marked. In this paper, we propose a visual information analysis approach to the ...
qRead: A Fast and Accurate Article Extraction Method from Web Pages using Partition Features Optimizations
IC3K 2015: Proceedings of the International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge ManagementWe present a new method called qRead to achieve real-time content extractions from web pages with high
accuracy. Early approaches to content extractions include empirical filtering rules, Document Object Model
(DOM) trees, and machine learning models. ...
Comments