Skip to main content

Towards a Model-Driven Approach for Big Data Analytics in the Genomics Field

  • Conference paper
  • First Online:
Advances in Conceptual Modeling (ER 2022)

Abstract

The use of techniques such as Next Generation Sequencing has allowed a fast increase in data generation due to the reduction of processing costs. What at the beginning seemed to be an important step forward for the development of new approaches such as Precision Medicine, turned into an exponential growth of data that currently challenges healthcare professionals and researchers. Since the problems derived from the storage and management of vast amounts of heterogeneous data are well-known for the Big Data and Information Systems communities, the application of this knowledge to the genomic data domain can help to improve the management of the data, reduce the bottlenecks, and reveal new insights on the causes of human disease. In this way, this work is focused on the problem of data storage by proposing a Big Data architecture supported by a model-driven approach to ensure an efficient and dynamic storage of genomic data. The proposed architecture has been designed considering the main requirements for an efficient data integration and for supporting data analysis tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    JSON schema specification: https://json-schema.org/.

  2. 2.

    Python Package Index: https://pypi.org/,.

  3. 3.

    https://hadoop.apache.org/.

  4. 4.

    https://hive.apache.org/.

  5. 5.

    https://spark.apache.org/.

References

  1. León, A., Pastor, Ó.: Smart data for genomic information systems: the SILE method. Complex Syst. Inf. Model. Q. 17, 1–23 (2018). https://doi.org/10.7250/csimq.2018-17.01

    Article  Google Scholar 

  2. Galvão, J., Leon, A., Costa, C., Santos, M.Y., López, Ó.P.: Automating data integration in adaptive and data-intensive information systems. In: Themistocleous, M., Papadaki, M., Kamal, M.M. (eds.) EMCIS 2020. LNBIP, vol. 402, pp. 20–34. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-63396-7_2

    Chapter  Google Scholar 

  3. León, A.: SILE: a method for the efficient management of smart genomic information (2019). https://riunet.upv.es/handle/10251/131698

  4. Tziovara, V., Vassiliadis, P., Simitsis, A.: Deciding the physical implementation of ETL workflows. In: Proceedings of the ACM 10th International Workshop on Data Warehousing and OLAP, pp. 49–56 (2007). https://doi.org/10.1145/1317331.1317341

  5. Luján-Mora, S., Trujillo, J.: Physical modeling of data warehouses using UML. In: Proceedings of the 7th ACM International Workshop on Data Warehousing and OLAP, pp. 48–57 (2004). https://doi.org/10.1145/1031763.1031772

  6. Thomsen, C., Bach Pedersen, T.: pygrametl: a powerful programming framework for extract-transform-load programmers. In: Proceedings of the ACM 12th International Workshop on Data Warehousing and OLAP, pp. 49–56 (2009). https://doi.org/10.1145/1651291.1651301

  7. Bifulco, I., Cirillo, S., Esposito, C., Guadagni, R., Polese, G.: An intelligent system for focused crawling from big data sources. Expert Syst. Appl. 184, 115560 (2021). https://doi.org/10.1016/j.eswa.2021.115560

    Article  Google Scholar 

  8. León, A., Pastor, O.: Enhancing precision medicine: a big data-driven approach for the management of genomic data. Big Data Res. 26, 100253 (2021). https://doi.org/10.1016/j.bdr.2021.100253

    Article  Google Scholar 

  9. Masseroli, M., et al.: GenoMetric query language: a novel approach to large-scale genomic data management. Bioinformatics 31(12), 1881–1888 (2015). https://doi.org/10.1093/bioinformatics/btv048

    Article  Google Scholar 

  10. García, A., et al.: Towards the understanding of the human genome: a holistic conceptual modeling approach. IEEE Access 8, 197111–197123 (2020). https://doi.org/10.1109/ACCESS.2020.3034793

    Article  Google Scholar 

  11. García, A., et al.: A conceptual model-based approach to improve the representation and management of omics data in precision medicine. IEEE Access 9, 154071–154085 (2021). https://doi.org/10.1109/ACCESS.2021.3128757

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported by FCT - Fundação para a Ciência e Tecnologia within the R &D Units Project Scope: UIDB/00319/2020, and by the Spanish Ministry of Universities and the Universitat Politècnica de València under the Margarita Salas Next Generation EU grant.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ana Xavier Fernandes .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fernandes, A.X., Ferreira, F., León, A., Santos, M.Y. (2022). Towards a Model-Driven Approach for Big Data Analytics in the Genomics Field. In: Guizzardi, R., Neumayr, B. (eds) Advances in Conceptual Modeling. ER 2022. Lecture Notes in Computer Science, vol 13650. Springer, Cham. https://doi.org/10.1007/978-3-031-22036-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-22036-4_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-22035-7

  • Online ISBN: 978-3-031-22036-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics