Skip to main content

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9662))

  • 1019 Accesses

Abstract

All data warehousing systems architects know that is quite difficult to build a “perfect” ETL system without having primarily a model well founded on real operational requisites. Thus ETL modeling is crucial to the success of populating a data warehouse, independently from their natural complexity. Modeling will also reduce implementation costs once it allows for revealing eventual operational errors originated by misinterpreted requisites. In this demo we demonstrate the viability of modeling an ETL system, using a standard workflow language and an ETL pattern approach implemented based on a cooperative community of opportunistic agents. The demo shows how we modeled, configured and executed an ETL system prototype in YAWL, and how we used agents to implement a self-organizing general purpose ETL system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Van der Aalst, W., Hofstede, A.: YAWL: yet another workflow language. Inf. Syst. 30, 245–275 (2003)

    Article  Google Scholar 

  2. van der Hoek, W., Wooldridge, M.: Multi-agent systems. In: van Harmelen, F., Lifschitz, V., Porter, B. (eds.) Handbook of Knowledge Representation, pp. 887–928. Elsevier, Amsterdam (2008)

    Chapter  Google Scholar 

  3. Kimball, R., Caserta, J.: The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data. Wiley, New York (2004)

    Google Scholar 

  4. Kimball, R., Ross, M.: The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling. Wiley, New York (2002)

    Google Scholar 

  5. Oliveira, B., Belo, O.: Pattern-based ETL conceptual modeling. In: Cuzzocrea, A., Maabout, S. (eds.) MEDI 2013. LNCS, pp. 237–248. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Orlando Belo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Gomes, N., Oliveira, B., Belo, O. (2016). Modeling Agents Working on ETL Processes. In: Demazeau, Y., Ito, T., Bajo, J., Escalona, M. (eds) Advances in Practical Applications of Scalable Multi-agent Systems. The PAAMS Collection. PAAMS 2016. Lecture Notes in Computer Science(), vol 9662. Springer, Cham. https://doi.org/10.1007/978-3-319-39324-7_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-39324-7_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-39323-0

  • Online ISBN: 978-3-319-39324-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics