Skip to main content
SpringerLink
Log in

A Multi-layer Modeling for the Generation of New Architectures for Big Data Warehousing

  • Conference paper
  • First Online:
Advanced Information Networking and Applications (AINA 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 450))

Abstract

With the explosion of new data processing and storage technologies nowadays, businesses are looking to harness the hidden value of data, each in their own way. Many contributions were proposed defining pipelines dedicated to Big Data processing and storage, but they target usually particular types of data and specific technologies to meet precise needs without considering the evolution of requirements or the data characteristics’ change. Thus, no approach has defined a generic architecture for Big Data warehousing process. In this paper, we propose a multi-layer model that integrates all the necessary elements and concepts in the different phases of a data warehousing process. It also contributes to generate an architecture that considers the specificity of data and applications and the suitable technologies. To illustrate our contribution, we have implemented the proposed model through a Business model and a Big Data architecture for the analysis of multi-source and social networks data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://milinda.pathirage.org/kappa-architecture.com/.

  2. 2.

    https://libguides.lib.msu.edu/covid-datasets-social-media.

  3. 3.

    https://ourworldindata.org/coronavirus.

References

  1. Yangui, R., Nabli, A., Gargouri, F.: ETL based framework for NoSQL warehousing. In: Themistocleous, M., Morabito, V. (eds.) EMCIS 2017. LNBIP, vol. 299, pp. 40–53. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-65930-5_4

    Chapter  Google Scholar 

  2. Leclercq, É.: Approches Multi-Paradigmes Et Contextuelles Pour La Gestion Des Masses De Données. Université de Bourgogne, Habilitation à Diriger des Recherches (2019)

    Google Scholar 

  3. Mallek, H., Ghozzi, F., Gargouri, F.: Towards extract-transform-load operations in a big data context. Int. J. Sociotechnol. Knowl. Devel. (IJSKD) 12(2), 7–95 (2020)

    Google Scholar 

  4. Gillet, A., Leclercq, É., Cullot, N.: Lambda+, the renewal of the lambda architecture: category theory to the rescue. In: La Rosa, M., Sadiq, S., Teniente, E. (eds.) CAiSE 2021. LNCS, vol. 12751, pp. 381–396. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-79382-1_23

    Chapter  Google Scholar 

  5. Mukherjee, R., Kar, P.: A comparative review of data warehousing ETL tools with new trends and industry insight. In: 2017 IEEE 7th International Advance Computing Conference (IACC), pp. 943–948. IEEE (2017)

    Google Scholar 

  6. Sureddy, M.R., Yallamula, P.: Approach to help choose right data warehousing tool for an enterprise. Int. J. Adv. Res. Ideas Innov. Technol. 6(4), 579–583 (2020)

    Google Scholar 

  7. Sreemathy, J., Brindha, R., Nagalakshmi, M.S., Suvekha, N., Ragul, N.K., Praveennandha, M.: Overview of ETL tools and talend-data integration. In: 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS), Vol. 1. IEEE. pp. 1650–1654 (2021)

    Google Scholar 

  8. Mayuk, V., Falchuk, I., Muryjas, P.: The comparative analysis of modern ETL tools. J. Comput. Sci. Instit. 19, 126–131 (2021)

    Article  Google Scholar 

  9. Bala, M., Boussaid, O., Alimazighi, Z.: Extracting-transforming-loading modeling approach for big data analytics. Int. J. Dec. Supp. Syst. Technol. (IJDSST) 8(4), 50–69 (2016). https://doi.org/10.4018/IJDSST.2016100104

    Article  Google Scholar 

  10. Model Driven Architecture (MDA), Object Management Group, and MDA Guide rev. 2.0, OMG Document ormsc/2014-06-01. https://www.omg.org/mda/specs.htm. Accessed 22 Dec 2021

  11. Belaunde, M., et al.: MDA Guide Version 1.0. 1. OMG, Document Number: omg/2003-06-01, (2003). Accessed 22 Dec 2021

    Google Scholar 

  12. Maté, A., Trujillo, J.: A trace metamodel proposal based on the model driven architecture framework for the traceability of user requirements in data warehouses. Inf. Syst. 37(8), 753–766 (2012). https://doi.org/10.1016/j.is.2012.05.003

    Article  Google Scholar 

  13. Lavalle, A., Maté, A., Trujillo, J.: Requirements-driven visualizations for big data analytics: a model-driven approach. In: Laender, A.H.F., Pernici, B., Lim, E.-P., de José Palazzo, M., Oliveira, (eds.) ER 2019. LNCS, vol. 11788, pp. 78–92. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33223-5_8

    Chapter  Google Scholar 

  14. Warren, J., Marz, N.: Big Data: Principles and Best Practices of Scalable Realtime Data Systems. Simon and Schuster (2015)

    Google Scholar 

  15. Sanla, A., Numnonda, T.: A Comparative performance of real-time big data analytic architectures. In 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC), IEEE. pp. 1–5 (2019)

    Google Scholar 

  16. Antoniu, G., Costan, A., Pérez, M., Stojanovic, N.: The Sigma Data Processing Architecture: Leveraging Future Data for Extreme-Scale Data Analytics to Enable High-Precision Decisions (2018)

    Google Scholar 

  17. Sarbanoglu, H., Ottmann, B.: Business-Model-Driven Data Warehousing: Keeping Data Warehouses Connected to Your Business. White Paper (2008)

    Google Scholar 

  18. Fan, Z., Zhou, H., Chen, Z., Hong, D., Wang, Y., Dong, Q.: Design and implementation of scientific research big data service platform for experimental data managing. Proc. Comput. Sci. 192, 3875–3884 (2021)

    Article  Google Scholar 

  19. Yeoh, W., Popovič, A.: Extending the understanding of critical success factors for implementing business intelligence systems. J. Am. Soc. Inf. Sci. 67(1), 134–147 (2016)

    Google Scholar 

  20. Trujillo, J., Davis, K.C., Du, X., Damiani, E., Storey, V.C.: Conceptual modeling in the era of big data and artificial intelligence: research topics and introduction to the special issue. Data Knowl. Eng. 135, 101911 (2021)

    Article  Google Scholar 

  21. Tardío, R., Maté, A., Trujillo, J.: An iterative methodology for defining big data analytics architectures. IEEE Access 8, 210597–210616 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. LISTIC Lab, Université Savoie Mont Blanc, France Annecy – Chambéry, 74940, Chambéry, France

    Asma Dhaouadi, Khadija Bousselmi & Sébastien Monnet

  2. RIADI Lab, Université Tunis El Manar, 1068, Tunis, Tunisia

    Asma Dhaouadi

  3. ECRI research Team, RIADI Lab, ISAMM, University of Manouba, 2010, Mannouba, Tunisia

    Mohamed Mohsen Gammoudi

  4. ERIS, ESEO-TECH, 49100, Angers, France

    Slimane Hammoudi

Authors
  1. Asma Dhaouadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Khadija Bousselmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sébastien Monnet
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mohamed Mohsen Gammoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Slimane Hammoudi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Asma Dhaouadi .

Editor information

Editors and Affiliations

  1. Department of Information and Communication Engineering, Fukuoka Institute of Technology, Fukuoka, Japan

    Leonard Barolli

  2. University of Technology Sydney, Sydney, NSW, Australia

    Farookh Hussain

  3. Faculty of Bussiness Administration, Rissho University, Tokyo, Japan

    Tomoya Enokido

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dhaouadi, A., Bousselmi, K., Monnet, S., Gammoudi, M.M., Hammoudi, S. (2022). A Multi-layer Modeling for the Generation of New Architectures for Big Data Warehousing. In: Barolli, L., Hussain, F., Enokido, T. (eds) Advanced Information Networking and Applications. AINA 2022. Lecture Notes in Networks and Systems, vol 450. Springer, Cham. https://doi.org/10.1007/978-3-030-99587-4_18

Download citation

Publish with us

Policies and ethics

Search

Navigation