skip to main content
10.1145/3183519.3183520acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
research-article

A data decomposition method for stepwise migration of complex legacy data

Published:27 May 2018Publication History

ABSTRACT

Sooner or later, in almost every company, the maintenance and further development of large enterprise IT applications reaches its limit. From the point of view of cost as well as technical capability, legacy applications must eventually be replaced by new enterprise IT applications. Data migration is an inevitable part of making this switch. While different data migration strategies can be applied, incremental data migration is one of the most popular strategies, due to its low level of risk: The entire data volume is split into several data tranches, which are then migrated in individual migration steps. The key to a successful migration is the strategy for decomposing the data into suitable tranches.

This paper presents an approach for data decomposition where the entire data volume of a monolithic enterprise IT application is split into independent data migration tranches. Each tranche comprises the data to be migrated in one migration step, which is usually executed during the application's downtime window. Unlike other approaches, which describe data migration in a highly abstract way, we propose specific heuristics for data decomposition into independent data packages (tranches).

The data migration approach described here is being applied in one of the largest migration projects currently underway in the European healthcare sector, comprising millions of customer records.

References

  1. Lerina Aversano, Gerardo Canfora, Aniello Cimitile, and Andrea De Lucia. 2001. Migrating legacy systems to the web: an experience report. In Software Maintenance and Reengineering, 2001. Fifth European Conference on. IEEE, 148--157. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mario Bernhart, Andreas Mauczka, Michael Fiedler, Stefan Strobl, and Thomas Grechenig. 2012. Incremental reengineering and migration of a 40 year old airport operations system. In Software Maintenance (ICSM), 2012 28th IEEE International Conference on. IEEE, 503--510. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Jesús Bisbal, Deirdre Lawless, Bing Wu, and Jane Grimson. 1999. Legacy information systems: Issues and directions. IEEE software 16, 5 (1999), 103--111. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Matthias Book, Simon Grapenthin, and Volker Gruhn. 2014. Value-based migration of legacy data structures. In International Conference on Software Quality. Springer, 115--134.Google ScholarGoogle ScholarCross RefCross Ref
  5. Michael L Brodie and Michael Stonebraker. 1995. Legacy Information Systems Migration: Gateways, Interfaces, and the Incremental Approach. Morgan Kaufmann Publishers Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Klaus Haller. 2008. Data Migration Project Management and Standard Software-Experiences in Avaloq Implementation Projects.. In Data Warehousing Conference (DW2008): Synergien durch Integration und Informationslogistik. 391--406.Google ScholarGoogle Scholar
  7. Klaus Haller. 2009. Towards the industrialization of data migration: concepts and patterns for standard software implementation projects. In International Conference on Advanced Information Systems Engineering.Springer, 63--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. F Matthes and C Schulz. 2011. Towards an integrated data migration process model-State of the art & literature overview. Technische Universität München, Garching bei München, Germany, Tech. Rep (2011).Google ScholarGoogle Scholar
  9. Johny Morris. 2012. Practical data migration. BCS, The Chartered Institute. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Ricardo Perez-Castillo. 2012. MARBLE: Modernization approach for recovering business processes from legacy information systems. In Software Maintenance (ICSM), 2012 28th IEEE International Conference on. IEEE, 671--676. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Andreas Rüping. 2013. Transform! Patterns for Data Migration. In Transactions on Pattern Languages of Programming III. Springer, 1--23.Google ScholarGoogle Scholar
  12. Philip Russom. 2006. Best practices in data migration. Renton/USA (2006).Google ScholarGoogle Scholar
  13. Pramod J Sadalage and Martin Fowler. 2012. NoSQL distilled: a brief guide to the emerging world of polyglot persistence. Pearson Education. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Karla Saur, Tudor Dumitraş, and Michael Hicks. 2016. Evolving nosql databases without downtime. In Software Maintenance and Evolution (ICSME), 2016 IEEE International Conference on. IEEE, 166--176.Google ScholarGoogle ScholarCross RefCross Ref
  15. Harry M Sneed, Heidi Heilmann, and Ellen Wolf. 2016. Softwaremigration in der Praxis: übertragung alter Softwaresysteme in eine moderne Umgebung. dpunkt. verlag.Google ScholarGoogle Scholar
  16. Sabine Wachter and Thomas Zaelke. 2015. Systemkonsolidierung und Datenmigration als Erfolgsfaktoren. Springer-Verlag.Google ScholarGoogle Scholar
  17. Martin Wagner and Tim Wellhausen. 2010. Patterns for Data Migration Projects. In 15th European Conference on Pattern Languages of Programs (EuroPLoP) - Writer's Workshops.Google ScholarGoogle Scholar
  18. Bing Wu, Deirdre Lawless, Jesus Bisbal, Ray Richardson, Jane Grimson, Vincent Wade, and Donie O'Sullivan. 1997. The butterfly methodology: A gateway-free approach for migrating legacy information systems. In Engineering of Complex Computer Systems, 1997. Proceedings., Third IEEE International Conference on. IEEE, 200--205. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Nurhidayah Muhamad Zahari, Wan Ya Wan Hussin, Mohd Yunus Mohd Yussof, and Fauzi Mohd Saman. 2015. Data Quality Issues in Data Migration. In International Conference on Soft Computing in Data Science. Springer, 33--42.Google ScholarGoogle Scholar

Index Terms

  1. A data decomposition method for stepwise migration of complex legacy data

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          ICSE-SEIP '18: Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice
          May 2018
          336 pages
          ISBN:9781450356596
          DOI:10.1145/3183519

          Copyright © 2018 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 27 May 2018

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Upcoming Conference

          ICSE 2025

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader