demonstration

Visual oXPath: robust wrapping by example

Authors:

Jochen Kranzdorf,

Andrew Sellers,

Giovanni Grasso,

Christian Schallhart,

Tim FurcheAuthors Info & Claims

WWW '12 Companion: Proceedings of the 21st International Conference on World Wide Web

Pages 369 - 372

https://doi.org/10.1145/2187980.2188051

Published: 16 April 2012 Publication History

Get Access

Abstract

Good examples are hard to find, particularly in wrapper induction: Picking even one wrong example can spell disaster by yielding overgeneralized or overspecialized wrappers. Such wrappers extract data with low precision or recall, unless adjusted by human experts at significant cost.

Visual OXPath is an open-source, visual wrapper induction system that requires minimal examples and eases wrapper refinement: Often it derives the intended wrapper from a single example through sophisticated heuristics that determine the best set of similar examples. To ease wrapper refinement, it offers a list of wrappers ranked by example similarity and robustness. Visual OXPath offers extensive visual feedback for this refinement which can be performed without any knowledge of the underlying wrapper language. Where further refinement by a human wrapper is needed, Visual OXPath profits from being based on OXPath, a declarative wrapper language that extends XPath with a thin layer of features necessary for extraction and page navigation.

References

[1]

T. Furche, G. Gottlob, G. Grasso, C. Schallhart, and A. Sellers, "OXPath: A language for scalable, memory-efficient data extraction from web applications," Proceedings of the VLDB Endowment, 2011.

Google Scholar

[2]

M. Marx, "Conditional XPath," ACM Transactions on Database Systems (TODS), vol. 30, no. 4, pp. 929--959, 2005.

Digital Library

Google Scholar

[3]

B. Fazzinga, S. Flesca, and A. Tagarelli, "Schema-based web wrapping," Knowledge and Information Systems, pp. 1--47, 2011.

Digital Library

Google Scholar

[4]

M. Abe and M. Hori, "Robust pointing by XPath language: Authoring support and empirical evaluation," in IEEE Symposium on Applications and the Internet, 2003, pp. 156--165.

Digital Library

Google Scholar

[5]

A. Laender, B. Ribeiro-Neto, A. da Silva, and J. Teixeira, "A brief survey of web data extraction tools," ACM SIGMOD Record, vol. 31, no. 2, pp. 84--93, 2002.

Digital Library

Google Scholar

[6]

C. Chang, M. Kayed, M. Girgis, and K. Shaalan, "A survey of web information extraction systems," IEEE Transactions on Knowledge and Data Engineering, pp. 1411--1428, 2006.

Digital Library

Google Scholar

Cited By

View all

Fayzrakhmanov RSallinger ESpencer BFurche TGottlob GChampin PGandon FMédini LLalmas MIpeirotis P(2018)Browserless Web Data ExtractionProceedings of the 2018 World Wide Web Conference10.1145/3178876.3186008(1095-1104)Online publication date: 10-Apr-2018
https://dl.acm.org/doi/10.1145/3178876.3186008
Barman SChasins SBodik RGulwani S(2016)Ringer: web automation by demonstrationACM SIGPLAN Notices10.1145/3022671.298402051:10(748-764)Online publication date: 19-Oct-2016
https://dl.acm.org/doi/10.1145/3022671.2984020
Barman SChasins SBodik RGulwani SVisser ESmaragdakis Y(2016)Ringer: web automation by demonstrationProceedings of the 2016 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications10.1145/2983990.2984020(748-764)Online publication date: 19-Oct-2016
https://dl.acm.org/doi/10.1145/2983990.2984020
Show More Cited By

Index Terms

Visual oXPath: robust wrapping by example
1. Information systems
  1. World Wide Web
    1. Web applications
    2. Web services

Recommendations

Taking the OXPath down the deep web
EDBT/ICDT '11: Proceedings of the 14th International Conference on Extending Database Technology

Although deep web analysis has been studied extensively, there is no succinct formalism to describe user interactions with AJAX-enabled web applications.

Toward this end, we introduce OXPath as a superset of XPath 1.0. Beyond XPath, OXPath is able (1) ...
Effective web scraping with OXPath
WWW '13 Companion: Proceedings of the 22nd International Conference on World Wide Web

Even in the third decade of the Web, scraping web sites remains a challenging task: Most scraping programs are still developed as ad-hoc solutions using a complex stack of languages and tools. Where comprehensive extraction solutions exist, they are ...
OXPath: A language for scalable data extraction, automation, and crawling on the deep web

The evolution of the web has outpaced itself: A growing wealth of information and increasingly sophisticated interfaces necessitate automated processing, yet existing automation and data extraction technologies have been overwhelmed by this very growth. ...

Comments

Information & Contributors

Information

Published In

WWW '12 Companion: Proceedings of the 21st International Conference on World Wide Web

April 2012

1250 pages

ISBN:9781450312301

DOI:10.1145/2187980

General Chairs:
Alain Mille
Université de Lyon, France
,
Fabien Gandon
INRIA, France
,
Jacques Misselis
HP, France
,
Program Chairs:
Michael Rabinovich
Case Western Reserve University, USA
,
Steffen Staab
University of Koblenz-Landau, Germany

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

WWW 2012

Sponsor:

Univ. de Lyon

WWW 2012: 21st World Wide Web Conference 2012

April 16 - 20, 2012

Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
164
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Fayzrakhmanov RSallinger ESpencer BFurche TGottlob GChampin PGandon FMédini LLalmas MIpeirotis P(2018)Browserless Web Data ExtractionProceedings of the 2018 World Wide Web Conference10.1145/3178876.3186008(1095-1104)Online publication date: 10-Apr-2018
https://dl.acm.org/doi/10.1145/3178876.3186008
Barman SChasins SBodik RGulwani S(2016)Ringer: web automation by demonstrationACM SIGPLAN Notices10.1145/3022671.298402051:10(748-764)Online publication date: 19-Oct-2016
https://dl.acm.org/doi/10.1145/3022671.2984020
Barman SChasins SBodik RGulwani SVisser ESmaragdakis Y(2016)Ringer: web automation by demonstrationProceedings of the 2016 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications10.1145/2983990.2984020(748-764)Online publication date: 19-Oct-2016
https://dl.acm.org/doi/10.1145/2983990.2984020
Furche TGrasso GHuemer MSchallhart CSchrefl M(2016)PeaCE-Ful Web Event Extraction and Processing as Bitemporal Mutable EventsACM Transactions on the Web10.1145/291198910:3(1-47)Online publication date: 16-Aug-2016
https://dl.acm.org/doi/10.1145/2911989
Díaz OArellano C(2015)The Augmented WebACM Transactions on the Web10.1145/27356339:2(1-30)Online publication date: 19-May-2015
https://dl.acm.org/doi/10.1145/2735633

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Taking the OXPath down the deep web

Effective web scraping with OXPath

OXPath: A language for scalable data extraction, automation, and crawling on the deep web

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations