Abstract
Space applications’ users have been relying for the past decades on custom developed software tools capable of addressing short term necessities during critical Spacecraft control periods. Advances in computing power and storage solutions have made possible the development of innovative decision support systems. These systems are capable of providing high quality integrated data to both near real time and historical data analysis applications. This paper describes the implementation of a new approach for a distributed and loosely coupled data extraction and transformation solution capable of extracting, transforming and perform loading of relevant real-time and historical Space Weather and Spacecraft data from semi-structured text files into an integrated space-domain decision support system. The described solution takes advantage of XML and Web Service technologies and is currently working under operational environment at the European Space Agency as part of the Space Environment Information System for Mission Control Purposes (SEIS) project.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Schmieder, B., et al.: Climate and Weather of the Sun Earth System: CAWSES, SCOSTEP’S Program for 2003-2008. In: SOLSPA: The Second Solar Cycle and Space Weather Euroconference (2002)
Daily, E.: Space Weather: A Brief Review. In: Second Solar Cycle and Space Weather Euroconference (2002)
Pantoquilho, M., et al.: SEIS: A Decision Support System for Optimizing Spacecraft Operations Strategies. In: IEEE Aerospace Conference, Montana, USA (2005)
Donati, A., et al.: Space Weather and Mission Control: A Roadmap to an Operational Multi-Mission Decision Support System. In: SpaceOps 2004 - 8th International Conference on Space Operations, Montreal, Canada (2004)
Vassiliadis, P., et al.: A generic and customizable framework for the design of ETL scenarios. Information Systems (2005)
Adelberg, B.: NoDoSE—A tool for semi-automatically extracting structured and semistructured data from text documents. In: International Conference on Management of Data (ACM SIGMOD 1998), Seattle, Washington, United States (1998)
Berkeley, Potter’s Wheel A-B-C: An Interactive Tool for Data Analysis, Cleansing, and Transformation, CONTROL - Continuous Output and Navigation Technology with Refinement On-Line, Berkeley (2000), http://control.cs.berkeley.edu/abc/
Pantoquilho, M., et al.: Online and Offline Monitoring and Diagnosis of Spacecraft and Space Weather Status. In: EUROFUSE Workshop on Data and Knowledge Engineering, Warszawa, Poland (2004)
Schmidt, M., Marco, F.D.: INTEGRAL Flight Operation Plan, Darmstadt, VEGA (2003)
Moura-Pires, J., Pantoquilho, M., Viana, N.: Space Environment Information System for Mission Control Purposes: Real-Time Monitoring and Inference of Space Craft Status. In: 2004 IEEE Multiconference on CCA/ISIC/CACSD, Taipei, Taiwan (2004)
Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Complete Guide To Dimensional Modelling, 2nd edn., p. 436. Wiley, Chichester (2002)
Belgian Institute for Space Aeronomy, Space Applications Services, and P.S. Institute, SPENVIS - Space Environment Information System (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Viana, N., Raminhos, R., Moura-Pires, J. (2005). A Real Time Data Extraction, Transformation and Loading Solution for Semi-structured Text Files. In: Bento, C., Cardoso, A., Dias, G. (eds) Progress in Artificial Intelligence. EPIA 2005. Lecture Notes in Computer Science(), vol 3808. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11595014_38
Download citation
DOI: https://doi.org/10.1007/11595014_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30737-2
Online ISBN: 978-3-540-31646-6
eBook Packages: Computer ScienceComputer Science (R0)