Abstract
Intelligent pipeline inspection gauges (PIGs) are inspection vehicles that move along within a gas (or oil) pipeline and acquire signals from their surrounding rings of sensors. By analyzing the signals captured by intelligent PIGs, we can detect pipeline defects, such as holes, curvatures and other potential causes of gas explosions. We notice that the size of collected data using a PIG is usually in GB range. Thus, analyzer software must handle such scalable data and provide various kinds of visualization tools so that analysts can easily detect any defects in the pipeline. In this paper, we propose a scalable pipeline data processing framework using database and visualization techniques. Specifically, we analyze requirements for our system, giving its overall architecture of our system. Second, we describe several important subsystems in our system: such as a scalable pipeline data store, integrated multiple visualization, and automatic summary report generator. Third, by performing experiments with GB-range real data, we show that our system is scalable to handle such large pipeline data. Experimental results show that our system outperforms a relational database management system (RDBMS) based repository by up to 31.9 times.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
SCADA in the Energy Industry – A Janus View, EnergyPulse (2004), (also available at http://www.newton-evans.com/news/EnergyPulseArticle.pdf )
http://www.businessweek.com/magazine/content/02_17/b3780129.htm
BJ Pipeline Inspection Services, GEODENT/GEODISPLAY Software Manual (1997)
Westwood, S., Hektner, D.: Data Integration Ensures Integrity, BJ Services company (March 2003)
Michailides, P., et al.: NPS 8 Geopig: Inertial Measurement and Mechanical Caliper Technology, BJ Services company (June 2002)
Kim, D.K., et al.: Development of the Caliper System for a Geometry PIG Based on Magnetic Field Analysis. KSME International Journal 17(12), 1835–1843 (2003)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Han, WS. et al. (2007). A Scalable Pipeline Data Processing Framework Using Database and Visualization Techniques. In: Huang, DS., Heutte, L., Loog, M. (eds) Advanced Intelligent Computing Theories and Applications. With Aspects of Theoretical and Methodological Issues. ICIC 2007. Lecture Notes in Computer Science, vol 4681. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74171-8_33
Download citation
DOI: https://doi.org/10.1007/978-3-540-74171-8_33
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74170-1
Online ISBN: 978-3-540-74171-8
eBook Packages: Computer ScienceComputer Science (R0)