Abstract
All data warehousing systems architects know that is quite difficult to build a “perfect” ETL system without having primarily a model well founded on real operational requisites. Thus ETL modeling is crucial to the success of populating a data warehouse, independently from their natural complexity. Modeling will also reduce implementation costs once it allows for revealing eventual operational errors originated by misinterpreted requisites. In this demo we demonstrate the viability of modeling an ETL system, using a standard workflow language and an ETL pattern approach implemented based on a cooperative community of opportunistic agents. The demo shows how we modeled, configured and executed an ETL system prototype in YAWL, and how we used agents to implement a self-organizing general purpose ETL system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Van der Aalst, W., Hofstede, A.: YAWL: yet another workflow language. Inf. Syst. 30, 245–275 (2003)
van der Hoek, W., Wooldridge, M.: Multi-agent systems. In: van Harmelen, F., Lifschitz, V., Porter, B. (eds.) Handbook of Knowledge Representation, pp. 887–928. Elsevier, Amsterdam (2008)
Kimball, R., Caserta, J.: The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data. Wiley, New York (2004)
Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling. Wiley, New York (2002)
Oliveira, B., Belo, O.: Pattern-based ETL conceptual modeling. In: Cuzzocrea, A., Maabout, S. (eds.) MEDI 2013. LNCS, pp. 237–248. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Gomes, N., Oliveira, B., Belo, O. (2016). Modeling Agents Working on ETL Processes. In: Demazeau, Y., Ito, T., Bajo, J., Escalona, M. (eds) Advances in Practical Applications of Scalable Multi-agent Systems. The PAAMS Collection. PAAMS 2016. Lecture Notes in Computer Science(), vol 9662. Springer, Cham. https://doi.org/10.1007/978-3-319-39324-7_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-39324-7_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-39323-0
Online ISBN: 978-3-319-39324-7
eBook Packages: Computer ScienceComputer Science (R0)