Skip to main content

Modification of the Algorithm for Dynamic Data Transformation Based on Blockchain Technology for Data Management Systems

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2023 Workshops (ICCSA 2023)

Abstract

The rapid growth of data and increasing complexity in various domains necessitate advanced data management solutions that address data quality, security, and interoperability challenges. This paper presents a modified algorithm for dynamic data transformation based on blockchain technology for Master Data Management Systems (MDM), incorporating Ethereum, IPFS and semantic data. Based on the proposed algorithm, an architectural approach is also described that allows developing semantic data management systems. The algorithm assumes data validation, enrichment, and deduplication processes, while also ensuring consistency and trust among multiple participants through the decentralized nature of the blockchain. The semantic data management aspect of the system is achieved using Apache Jena and local ontology, which facilitate semantic interoperability and efficient data processing. The proposed approach addresses the challenge of applying blockchain technology to semantic MDM systems and demonstrates an approach to using the system in Semantic Web, as well as in areas such as finance, healthcare, public administration, and logistics. We evaluated the algorithm using a customer information dataset from an e-commerce platform. The results confirmed the potential of blockchain technology in data management and showed improvements in data accuracy, consistency, completeness, but with some loss in storage efficiency due to the use of blockchain. This paper contributes to developing and evaluating a novel algorithm and architecture, combining blockchain technology, MDM principles, and semantic data management for improving data quality, security, and performance in decentralized systems. However, further research and assessment may be required for the full implementation and evaluation of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Total data volume worldwide 2010–2025. https://www.statista.com/statistics/871513/worldwide-data-created. Accessed 11 Apr 2023

  2. The DAMA Guide to the Data Management Body of Knowledge First Edition. https://www.academia.edu/19992490/The_DAMA_Guide_to_the_Data_Management_Body_of_Knowledge_First_Edition. Accessed 19 Mar 2023

  3. Master Data Management (MDM) Solutions Reviews 2023. https://www.gartner.com/reviews/market/master-data-management-solutions. Accessed 30 Mar 2023

  4. Zhang, J., Wang, F.: Digital asset management system architecture based on blockchain for power grid big data. Signal Process. 16(8), 1–7 (2018)

    Google Scholar 

  5. Wen, L., Zhang, L., Li, J.: Application of blockchain technology in data management: advantages and solutions. In: Li, J., Meng, X., Zhang, Y., Cui, W., Du, Z. (eds.) BigSDM 2018. LNCS, vol. 11473, pp. 239–254. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-28061-1_24

    Chapter  Google Scholar 

  6. Wei, Q., Li, B., Chang, W., Jia, Z., Shen, Z., Shao, Z.: A survey of blockchain data management systems. ACM Trans. Embed. Comput. Syst. (TECS) 21(25), 1–28 (2022)

    Google Scholar 

  7. Knez, T., Gašperlin, D., Bajec, M., Žitnik, S.: Blockchain-based transaction manager for ontology databases. Informatica 33(2), 343–364 (2022)

    Article  Google Scholar 

  8. Vo, H.T., Kundu, A., Mohania, M.K.: Research directions in blockchain data management and analytics. In: EDBT, pp. 445–448 (2018)

    Google Scholar 

  9. Lohmer, J., Bohlen, L., Lasch, R.: Blockchain-based master data management in supply chains: a design science study. In: Dolgui, A., Bernard, A., Lemoine, D., von Cieminski, G., Romero, D. (eds.) APMS 2021. IAICT, vol. 633, pp. 51–61. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85910-7_6

    Chapter  Google Scholar 

  10. Master Data Management (MDM): What it is and Why it Matters. https://www.informatica.com/resources/articles/what-is-master-data-management.html. Accessed 11 Apr 2023

  11. Proof-of-stake (PoS). https://ethereum.org/en/developers/docs/consensus-mechanisms/pos. Accessed 24 Mar 2023

  12. Bright Data | eCommerce Data - Global Coverage - Pricing Data, Seller Ratings Data, Customer Reviews Data. https://datarade.ai/data-products/retail-data-luminati. Accessed 21 Apr 2023

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nikita Olimpiev .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Olimpiev, N., Vodyaho, A., Zhukova, N. (2023). Modification of the Algorithm for Dynamic Data Transformation Based on Blockchain Technology for Data Management Systems. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2023 Workshops. ICCSA 2023. Lecture Notes in Computer Science, vol 14104. Springer, Cham. https://doi.org/10.1007/978-3-031-37105-9_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-37105-9_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-37104-2

  • Online ISBN: 978-3-031-37105-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics